Abbas Khawaja Profile Picture

Abbas Khawaja

VR & Haptics Researcher

About Me

I’m a Computer Science Student at the University of Texas at Dallas (UTD) and an Undergraduate Research Assistant in the UTD Multimodal Interaction (MI) Lab. I am an aspiring PhD Student and have strong experience in Game Development through my Research in Virtual Reality (VR) and Video Game Projects.

Publications

Understanding Latency Sensitivity in Thermal and Tactile Feedback for Multimodal Haptics in VR

Ayush Bhardwaj, Ashish Pratap, Abbas Khawaja, Yatharth Singhal, Hyunjae Gil, Jin Ryong Kim

Proceedings of the 2025 31st ACM Symposium on Virtual Reality Software and Technology (VRST '25)

@inproceedings{10.1145/3756884.3766050, author = {Bhardwaj, Ayush and Pratap, Ashish and Khawaja, Abbas and Singhal, Yatharth and Gil, Hyunjae and Kim, Jin Ryong}, title = {Understanding Latency Sensitivity in Thermal and Tactile Feedback for Multimodal Haptics in VR}, year = {2025}, isbn = {9798400721182}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/3756884.3766050}, doi = {10.1145/3756884.3766050}, abstract = {Low-latency multimodal feedback is essential for maintaining a high-quality user experience in VR; however, unpredictable network conditions can introduce latency that negatively impacts user experience. This work investigates how users perceive multimodal haptic feedback—specifically thermal (hot/cold) and tactile stimuli—and how latency in such feedback affects user experience. We first measured users’ response times for thermal, tactile, and combined thermal-tactile stimuli. Subsequently, we conducted a psychophysical study to identify delay thresholds for each modality by examining temporal congruency between visual and haptic cues. We designed a haptic delay network simulator to emulate a realistic network environment. Results highlighted that combined thermal-tactile feedback has higher latency tolerance than thermal-only feedback, indicating that multimodal integration can buffer the negative effects of latency. Using these thresholds, we designed controlled latency conditions and assessed user experience. Based on our findings, we propose design recommendations for haptic data transmission in networked VR systems.}, booktitle = {Proceedings of the 2025 31st ACM Symposium on Virtual Reality Software and Technology}, articleno = {53}, numpages = {11}, keywords = {Haptics, Thermal Feedback, Tactile Feedback, Multimodal Latency Tolerance, Visual-Haptic Congruency}, location = { }, series = {VRST '25} }

UltraEdit: In-Situ Design Environment for Ultrasound Haptization

Richard Huynh Noeske, Ayush Bhardwaj, Abbas Khawaja, Jin Ryong Kim

Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology (UIST '25)

@inproceedings{10.1145/3746059.3747775, author = {Noeske, Richard Huynh and Bhardwaj, Ayush and Khawaja, Abbas and Kim, Jin Ryong}, title = {UltraEdit: In-Situ Design Environment for Ultrasound Haptization}, year = {2025}, isbn = {9798400720376}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/3746059.3747775}, doi = {10.1145/3746059.3747775}, abstract = {We present UltraEdit, an in-situ design environment that enables users to directly edit ultrasound haptic sensations in VR using barehand interactions. UltraEdit represents haptic sensations as tangible objects, called blobs, which users can modify or apply to 3D objects through intuitive hand gestures. Users can create, edit, copy, and apply blobs, allowing them to work with multiple haptic sensations to design virtual objects with diverse tactile feedback. Additionally, UltraEdit allows users to create spatial and temporal haptic patterns using time blobs and spatial drawing features. Users can draw custom-shaped haptic patterns directly on their hands, adapting to comprehensive design scenarios. To evaluate UltraEdit, we conducted an exploratory user study assessing its usability, effectiveness, and ease of learning. We also compared its performance to an existing desktop-based haptic editing tool. Participants found UltraEdit intuitive to learn, enjoyable to use, and effective for adding haptic feedback to virtual objects.}, booktitle = {Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology}, articleno = {164}, numpages = {18}, keywords = {Immersive authoring tool, Mid-air haptics, Ultrasound haptic display, 3D user interface}, location = {}, series = {UIST '25} }

Virtual Streamer with Conversational and Tactile Interaction

Vaishnavi Josyula, Sowresh Mecheri-Senthil, Abbas Khawaja, Jose M. Garcia, Ayush Bhardwaj, Ashish Pratap, Jin Ryong Kim

2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)

@INPROCEEDINGS{10536248, author={Josyula, Vaishnavi and Mecheri-Senthil, Sowresh and Khawaja, Abbas and Garcia, Jose M. and Bhardwaj, Ayush and Pratap, Ashish and Kim, Jin Ryong}, booktitle={2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)}, title={Virtual Streamer with Conversational and Tactile Interaction}, year={2024}, volume={}, number={}, pages={1072-1073}, abstract={This paper introduces an approach to an interactive virtual streamer that provides conversational and tactile interactions, offering insights into levels of immersion and personalization for the user. User interaction is categorized into various types, such as the spatial nature of the virtual streamer's stream, along with conversational and tactile interactions with the streamer. We deploy the virtual streamer in a VR environment and conclude the efficiency of user interactions with the virtual streamer via a scenario-based assessment.}, keywords={Solid modeling;Three-dimensional displays;Conferences;Avatars;Prototypes;Immersive experience;User interfaces;Virtual Streamer;Haptic Interaction;Conversational Interaction;Avatar Interaction;Large Language Models}, doi={10.1109/VRW62533.2024.00332}, ISSN={}, month={March}, }

Demonstrating Virtual Streamer with Conversational and Tactile Interaction

Vaishnavi Josyula, Sowresh Mecheri-Senthil, Abbas Khawaja, Jose M. Garcia, Ayush Bhardwaj, Ashish Pratap, Jin Ryong Kim

2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)

@INPROCEEDINGS{10536542, author={Josyula, Vaishnavi and Garcia, Jose M. and Mecheri-Senthil, Sowresh and Bhardwaj, Ayush and Kim, Jin Ryong and Khawaja, Abbas and Pratap, Ashish}, booktitle={2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)}, title={Demonstrating Virtual Streamer with Conversational and Tactile Interaction}, year={2024}, volume={}, number={}, pages={1202-1203}, abstract={This paper introduces an approach to an interactive virtual streamer that provides conversational and tactile interactions, demonstrating insights into levels of immersion and personalization for the user. User interaction is categorized into various types, such as the spatial nature of the virtual streamer's stream, along with conversational and tactile interactions with the streamer. We demonstrate the virtual streamer in VR and conclude the efficiency of user interactions with the virtual streamer via a scenario-based assessment.}, keywords={Three-dimensional displays;Conferences;Virtual reality;User interfaces;Virtual Human;Haptic Interaction;Conversational Interaction;Avatar Interaction}, doi={10.1109/VRW62533.2024.00395}, ISSN={}, month={March}, }

Research Projects

UltraEdit

Developed an in-situ design environment for ultrasound haptization, enabling real-time feedback and adjustments during the design process.

Haptic Editing Tool Ultrasound Haptics Interaction Design

Latency Sensitivity

Investigated the sensitivity of latency in haptic feedback, focusing on increased latency tolerance with multimodal haptics.

Virtual Reality Multimodal Haptics Network Latency

VR-Dialogues

Developed an immersive VR conversational system that generates realistic, dynamic interactions between a user and two virtual agents.

Virtual Reality Human-AI Interaction Prompt Engineering

Virtual Streamer

Developed a VR environment where users can interact with a full-body virtual agent using haptic feedback and voice commands.

Virtual Reality Vibrotactile Haptics Human-AI Interaction Prompt Engineering

AR Voice Captions

Developed an AR application for the MagicLeap 2 that provides real-time captions for users through speech bubbles next to the speaker's face.

Augmented Reality Speech Recognition/Diarization Accessibility HTTP Communication

Technical Skills

Unity & Unreal Engine C/C++/C# Python Haptics Virtual Reality 3D Modeling/Printing UX/UI Design Computer Animation HTTP/TCP/UDP Communication

Get In Touch

Want to learn more about my research? Feel free to reach out!