Lesong Jia | Ph.D. Student @ PITT.

"What can be said can be said clearly."

Let's explore the boundaries of natural language in human-computer interaction

About Me

I am Lesong Jia, a Ph.D. student in Information Science at the University of Pittsburgh, advised by Dr. Na Du. My research focuses on human-computer interaction, covering applications in robotics, autonomous driving, multi-UAV coordination, and augmented/virtual reality. My research philosophy is to build theoretical frameworks that effectively guide interaction design practices based on in-depth analysis and modeling of user behavior. To this end, I use engines like Unity and Unreal to build controllable simulation environments to support different interaction tasks and activities, and comprehensively collect and analyze users' subjective data, behavioral data, and physiological signals to deeply understand users' real behavioral patterns in complex interactions.

+86 15051857337 lej50@pitt.edu Google Scholar Download CV

News

View More

Research Directions & Representative Publications

View More

  • Robots with Heart: How Emotion Regulation Shapes Human-Robot Interaction

    International Journal of Social Robotics

    Lesong Jia, Jackie Ayoub, Danyang Tian, Miao Song, Ehsan Moradi Pari, Na Du

    https://doi.org/10.1007/s12369-026-01358-2

  • Understanding Situation Awareness in Multi-UAV Supervision: Effects of Environmental Complexity, Interface Design, and Human–AI Differences

    International Journal of Human--Computer Interaction

    Lesong Jia, Kiran Shridhar Alva, Huao Li, Werner Hager, Lucia Romero, Timothy Albert Butler, and Michael Lewis

    https://doi.org/https://doi.org/10.1080/10447318.2026.2622580

  • More Than Automation: User Insights into the Functionality and Interface of Wheelchair-Mounted Robotic Arms

    2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI)

    Lesong Jia, Breelyn Kane Styler, Na Du

    https://doi.org/10.1109/HRI61500.2025.10974057

  • Modeling Driver Situational Awareness in Takeover Scenarios Using Multimodal Data and Machine Learning

    International Journal of Human--Computer Interaction

    Lesong Jia, Na Du

    https://doi.org/10.1080/10447318.2025.2546046

  • Drivers' situational awareness of surrounding vehicles during takeovers: Evidence from a driving simulator study

    Transportation Research Part F: Traffic Psychology and Behaviour

    Lesong Jia, Chenglue Huang, Na Du

    https://doi.org/10.1016/j.trf.2024.08.016

  • Non-trajectory-based gesture recognition in human-computer interaction based on hand skeleton data

    Multimedia Tools and Applications

    Lesong Jia, Xiaozhou Zhou, Chengqi Xue

    https://doi.org/10.1007/s11042-022-12355-8

  • Research on discrete semantics in continuous hand joint movement based on perception and expression

    Sensors

    Lesong Jia, Xiaozhou Zhou, Hao Qin, Ruidong Bai, Liuqing Wang, Chengqi Xue

    https://doi.org/10.3390/s21113735

  • How bare-hand clicking influences eye movement behavior in virtual button selection tasks: a comparative analysis with keyboard control

    Journal on Multimodal User Interfaces

    Xiaoxi Du, Lesong Jia, Jinchun Wu, Ningyue Peng, Xiaozhou Zhou, Chengqi Xue

    https://doi.org/10.1007/s12193-025-00455-2

  • DigCode—a generic mid-air gesture coding method on human-computer interaction

    International Journal of Human-Computer Studies

    Xiaozhou Zhou, Lesong Jia, Ruidong Bai, Chengqi Xue

    https://doi.org/10.1016/j.ijhcs.2024.103302

  • One size does not fit all: Designing and evaluating criticality-adaptive displays in highly automated vehicles

    Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

    Yaohan Ding, Lesong Jia, Na Du

    https://doi.org/10.1145/3613904.3642648

  • Speech+ Posture: A Method for Interaction with Multiple and Large Interactive Displays

    Intelligent Human Systems Integration (IHSI 2022)

    Xiaoxi Du, Lesong Jia, Weiye Xiao, Xiaozhou Zhou, Mu Tong, Jinchun Wu, Chengqi Xue

    https://doi.org/10.54941/ahfe100950

  • Predicting User Attention States from Multimodal Eye--Hand Data in VR Selection Tasks

    Electronics

    Xiaoxi Du, Jinchun Wu, Xinyi Tang, Xiaolei Lv, Lesong Jia, Chengqi Xue

    https://doi.org/10.3390/electronics14102052

  • A study of button size for virtual hand interaction in virtual environments based on clicking performance

    Multimedia Tools and Applications

    Xiaozhou Zhou, Yibing Guo, Lesong Jia, Yu Jin, Helu Li, Chengqi Xue

    https://doi.org/10.1007/s11042-022-14038-w

Collaborators

View More

Na Du

Assistant Professor, School of Computing and Information, University of Pittsburgh

Michael Lewis

Professor, School of Computing and Information, University of Pittsburgh

Chengqi Xue

Professor, School of Mechanical Engineering, Southeast University

Xiaozhou Zhou

Associate Professor, School of Mechanical Engineering, Southeast University