Publications

2026

Thumbnail for Multimodal Sensory E-skin and Synchronized Haptic Interfaces for Augmented Human-Robot Interaction

Multimodal Sensory E-skin and Synchronized Haptic Interfaces for Augmented Human-Robot Interaction

Nature ElectronicsAccepted

Inbo Sim, Byungjoon Bae, Shaid Hasan, Yongmin Baek, Dong Hyun Seo, Wonjun Cho, Jikai Liu, Young Min Song, Seokho Kim, Junseok Heo, Tariq Iqbal, Seongkook Heo, Kyusang Lee

Thumbnail for BrowserLens: Interactive Diagnosis of Web Agent Trajectories with a Layered State-Action Graph

BrowserLens: Interactive Diagnosis of Web Agent Trajectories with a Layered State-Action Graph

UIST 2026 Poster

Junyeong Song, Mingyu Kim, Seongkook Heo

Thumbnail for Balancing User Preference and Positional Stability through Optic Flow Speed in Walk-in-Place Locomotion

Balancing User Preference and Positional Stability through Optic Flow Speed in Walk-in-Place Locomotion

UIST 2026 Poster

Taeyun Noh, Minseo Kim, Sung Woo Oh, Tae Hoon Oh, Seongkook Heo, Jaeyeon Lee

Thumbnail for Physical surfaces make touch interactions in virtual reality precise, efficient, and bimanual

Physical surfaces make touch interactions in virtual reality precise, efficient, and bimanual

International Journal of Human-Computer Studies (IJHCS)

Wen Ying, Seongkook Heo

Thumbnail for Applying Machine Learning to Distinguish Individualized Brushing Styles

Applying Machine Learning to Distinguish Individualized Brushing Styles

Eurohaptics 2026

Matthew Clark, Zackary Todd Landsman, Seongkook Heo, Gregory John Gerling, Afsaneh Doryab

Thumbnail for Redirected Pinch: Efficient and Comfortable Bare-Hand Interaction for 2D Windows in VR

Redirected Pinch: Efficient and Comfortable Bare-Hand Interaction for 2D Windows in VR

CHI 2026

Wen Ying, Yeonsu Kim, Adil Rahman, Erzhen Hu, Geehyuk Lee, Seongkook Heo

Thumbnail for "It Feels Like I am Invited to Communicate": Mediating Ad-Hoc Bystander-VR User Interruptions Through Proactive Proxies

"It Feels Like I am Invited to Communicate": Mediating Ad-Hoc Bystander-VR User Interruptions Through Proactive Proxies

CHI 2026

Adil Rahman, Wen Ying, Md Aashikur Rahman Azim, Michelle Annett, Seongkook Heo

Thumbnail for PrevizWhiz: Combining Rough 3D Scenes and 2D Video to Guide Generative Video Previsualization

PrevizWhiz: Combining Rough 3D Scenes and 2D Video to Guide Generative Video Previsualization

CHI 2026

Erzhen Hu, Frederik Brudy, David Ledo, George Fitzmaurice, Fraser Anderson

Thumbnail for DataSpeck: An AI-Driven Human-in-the-Loop System for Automating Transformations in Data Conversion Workflows

DataSpeck: An AI-Driven Human-in-the-Loop System for Automating Transformations in Data Conversion Workflows

CHI 2026

Adil Rahman, Koichiro Ninuma, Aakar Gupta

2025

Thumbnail for DialogLab: Authoring, Simulating, and Testing Dynamic Human-AI Group Conversations

DialogLab: Authoring, Simulating, and Testing Dynamic Human-AI Group Conversations

UIST 2025

Erzhen Hu, Yanhe Chen, Mingyi Li, Vrushank Phadnis, Pingmei Xu, Xun Qian, Alex Olwal, David Kim, Seongkook Heo, Ruofei Du

Thumbnail for Thing2Reality: Enabling Spontaneous Creation of 3D Objects from 2D Content using Generative AI in XR Meetings

Thing2Reality: Enabling Spontaneous Creation of 3D Objects from 2D Content using Generative AI in XR Meetings

UIST 2025

Erzhen Hu, Mingyi Li, Jungtaek Hong, Xun Qian, Alex Olwal, David Kim, Seongkook Heo, Ruofei Du

Thumbnail for CustomSight: Enhancing LLM-Powered Visual Assistance for Blind Individuals using Goal-Directed Dynamic Filters

CustomSight: Enhancing LLM-Powered Visual Assistance for Blind Individuals using Goal-Directed Dynamic Filters

UIST 2025 Poster Best Poster Award

Adil Rahman, Rifat Rahman Khan, Jonggi Hong, Stephanie Valencia, Seongkook Heo

Thumbnail for SpaceShare: Leveraging Multimodal Context for Fluid Sharing of Spaces in Video Meetings

SpaceShare: Leveraging Multimodal Context for Fluid Sharing of Spaces in Video Meetings

UIST 2025 Poster

Hyeongjin Kim, Erzhen Hu, Seongkook Heo

Thumbnail for Evaluating the Physics and Repeatability of Human Brushers in Delivering Affective Touch

Evaluating the Physics and Repeatability of Human Brushers in Delivering Affective Touch

IEEE Transactions on Haptics

Zackary T. Landsman, Matthew Clark, Seongkook Heo, Afsaneh Doryab, Gregory J. Gerling

Thumbnail for ThingMoji: User-Captured Cut-Outs For In-Stream Visual Communication

ThingMoji: User-Captured Cut-Outs For In-Stream Visual Communication

CSCW 2025

Erzhen Hu, Qian Wan, Changkong Zhou, Md Aashikur Rahman Azim, PiaoHong Wang, Xingyi Hu, Yuhan Zeng, Zhicong Lu, Seongkook Heo

Thumbnail for Exploring Older Adults’ Perceptions of Personalities of LLM-powered Conversational Companions

Exploring Older Adults’ Perceptions of Personalities of LLM-powered Conversational Companions

CHI 2025 Late-Breaking Work

Ajwa Shahid, Jane Chung, Seongkook Heo

Thumbnail for Your Hands Can Tell: Detecting Redirected Hand Movements in Virtual Reality

Your Hands Can Tell: Detecting Redirected Hand Movements in Virtual Reality

CHI 2025 Honorable Mention Award

Md Aashikur Rahman Azim, Zihao Su, Seongkook Heo

Thumbnail for Diversifying grain-based compliance illusion by varying base compliance

Diversifying grain-based compliance illusion by varying base compliance

CHI 2025

Buyoung Mun, Junsu Lee, Jiseong Kim, Seongkook Heo, Jaeyeon Lee

2024

Thumbnail for MoiréTag: A Low-cost Tag for High-precision Tangible Interactions Without Active Components

MoiréTag: A Low-cost Tag for High-precision Tangible Interactions Without Active Components

ISS 2024 Honorable Mention Award

Peiyu Zhang, Wen Ying, Sara Riggs, Seongkook Heo

Thumbnail for Experiencing Thing2Reality: Transforming 2D Content into Conditioned Multiviews and 3D Gaussian Objects for XR Communication

Experiencing Thing2Reality: Transforming 2D Content into Conditioned Multiviews and 3D Gaussian Objects for XR Communication

UIST 2024 Demo

Erzhen Hu, Mingyi Li, Xun Qian, Alex Olwal, David Kim, Seongkook Heo, Ruofei Du

Thumbnail for Enhancing VR Sketching with a Dynamic Shape Display

Enhancing VR Sketching with a Dynamic Shape Display

VRST 2024 Honorable Mention Award

Wen Ying, Seongkook Heo

Thumbnail for ViObject: Harness Passive Vibrations for Daily Object Recognition with Commodity Smartwatches

ViObject: Harness Passive Vibrations for Daily Object Recognition with Commodity Smartwatches

IMWUT

Wenqiang Chen, Shupei Lin, Zhencan Peng, Farshid Salemi Parizi, Seongkook Heo, Shwetak Patel, Wojciech Matusik, Wei Zhao, John Stankovic

2023

Thumbnail for Frappé: An Ultra Lightweight Mobile UI Framework for Rapid API-based Prototyping and Environmental Deployment

Frappé: An Ultra Lightweight Mobile UI Framework for Rapid API-based Prototyping and Environmental Deployment

MobileHCI 2023 Best Paper Award

Adil Rahman, Seongkook Heo

Thumbnail for UnifiedSense: Enabling Without-Device Gesture Interactions Using Over-the-shoulder Training Between Redundant Wearable Sensors

UnifiedSense: Enabling Without-Device Gesture Interactions Using Over-the-shoulder Training Between Redundant Wearable Sensors

MobileHCI 2023

Md Aashikur Rahman Azim, Adil Rahman, Seongkook Heo

Thumbnail for SequenceSense: A Tool for Designing Usable Foot-Based Gestures Using a Sequence-Based Gesture Recognizer

SequenceSense: A Tool for Designing Usable Foot-Based Gestures Using a Sequence-Based Gesture Recognizer

International Journal of Human-Computer Studies (IJHCS)

Md Aashikur Rahman Azim, Adil Rahman, Seongkook Heo

Thumbnail for Take my hand: Automated hand-based spatial guidance for the visually impaired

Take my hand: Automated hand-based spatial guidance for the visually impaired

CHI 2023 Best Paper Award

Adil Rahman, Md Aashikur Rahman Azim, Seongkook Heo

Thumbnail for ThingShare: Ad-Hoc Digital Copies of Physical Objects for Sharing Things in Video Meetings

ThingShare: Ad-Hoc Digital Copies of Physical Objects for Sharing Things in Video Meetings

CHI 2023

Erzhen Hu, Jens Emil Sloth Grønbæk, Wen Ying, Ruofei Du, Seongkook Heo

Thumbnail for OpenMic: Utilizing proxemic metaphors for conversational floor transitions in multiparty video meetings

OpenMic: Utilizing proxemic metaphors for conversational floor transitions in multiparty video meetings

CHI 2023

Erzhen Hu, Jens Emil Sloth Grønbæk, Austin Kendrick Houck, Seongkook Heo

Thumbnail for Mimicking real forces on a drone through a haptic suit to enable cost-effective validation

Mimicking real forces on a drone through a haptic suit to enable cost-effective validation

ICRA 2023

Carl Hildebrandt, Wen Ying, Seongkook Heo, Sebastian Elbaum

Thumbnail for VRScroll: A Shape-Changing Device for Precise Sketching in Virtual Reality

VRScroll: A Shape-Changing Device for Precise Sketching in Virtual Reality

IEEE VR 2023 Poster Best Poster Award

Wen Ying, Seongkook Heo

Thumbnail for MaterialSense: Estimating and Utilizing Material Properties of Contact Objects in Multi-touch interaction

MaterialSense: Estimating and Utilizing Material Properties of Contact Objects in Multi-touch interaction

International Journal of Human-Computer Studies (IJHCS)

Sanghwa Hong, Seongkook Heo, Byungjoo Lee

2022

Thumbnail for Over-The-Shoulder Training Between Redundant Wearable Sensors for Unified Gesture Interactions

Over-The-Shoulder Training Between Redundant Wearable Sensors for Unified Gesture Interactions

UIST 2022 Poster

Md Aashikur Rahman Azim, Adil Rahman, Seongkook Heo

Thumbnail for Fringer: A Finger-Worn Passive Device Enabling Computer Vision Based Force Sensing Using Moiré Fringes

Fringer: A Finger-Worn Passive Device Enabling Computer Vision Based Force Sensing Using Moiré Fringes

UIST 2022 Poster

Peiyu Zhang, Wen Ying, Seongkook Heo

Thumbnail for Enabling Remote Hand Guidance in Video Calls Using Directional Force Illusion

Enabling Remote Hand Guidance in Video Calls Using Directional Force Illusion

CSCW 2022 Poster

Archana Narayanan, Erzhen Hu, Seongkook Heo

Thumbnail for Enjoy the ride consciously with CAWA: Context-aware advisory warnings for automated driving

Enjoy the ride consciously with CAWA: Context-aware advisory warnings for automated driving

AutoUI 2022

Erfan Pakdamanian, Erzhen Hu, Shili Sheng, Sarit Kraus, Seongkook Heo, and Lu Feng

Thumbnail for Fluidmeet: Enabling frictionless transitions between in-group, between-group, and private conversations during virtual breakout meetings

Fluidmeet: Enabling frictionless transitions between in-group, between-group, and private conversations during virtual breakout meetings

CHI 2022

Erzhen Hu, Md Aashikur Rahman Azim, Seongkook Heo

Thumbnail for Perception Hacking for 2D Cursorjacking in Virtual Reality

Perception Hacking for 2D Cursorjacking in Virtual Reality

CHI 2022 Workshop on Novel Challenges of Safety, Security, and Privacy in XR

Zihao Su, Faysal Hossain Shezan, Yuan Tian, David Evans, Seongkook Heo

2021

Thumbnail for DeepTake: Prediction of driver takeover behavior using multimodal data

DeepTake: Prediction of driver takeover behavior using multimodal data

CHI 2021

Erfan Pakdamanian, Shili Sheng, Sonia Baee, Seongkook Heo, Sarit Kraus, Lu Feng

Thumbnail for Realitybrush: An ar authoring system that captures and utilizes kinetic properties of everyday objects

Realitybrush: An ar authoring system that captures and utilizes kinetic properties of everyday objects

Multimedia Tools and Applications

Hyunju Kim, Sanghwa Hong, Junki Kim, Taesoo Jang, Woontack Woo, Seongkook Heo, Byungjoo Lee

2020

Thumbnail for Magtouch: Robust finger identification for a smartwatch using a magnet ring and a built-in magnetometer

Magtouch: Robust finger identification for a smartwatch using a magnet ring and a built-in magnetometer

CHI 2020

Keunwoo Park, Daehwa Kim, Seongkook Heo, Geehyuk Lee

Thumbnail for Tactile glance: Encoding notifications using illusive movement constraints for eyes- and ears-free interaction

Tactile glance: Encoding notifications using illusive movement constraints for eyes- and ears-free interaction

IEEE Haptics Symposium 2020 Works-in-progress

Anastasia Lalamentik, Seongkook Heo

2019

Thumbnail for Pseudobend: Producing haptic illusions of stretching, bending, and twisting using grain vibrations

Pseudobend: Producing haptic illusions of stretching, bending, and twisting using grain vibrations

UIST 2019

Seongkook Heo, Jaeyeon Lee, Daniel Wigdor

Thumbnail for Plane, ray, and point: Enabling precise spatial manipulations with shape constraints

Plane, ray, and point: Enabling precise spatial manipulations with shape constraints

UIST 2019

Devmardeep Hayatpur, Seongkook Heo, Haijun Xia, Wolfgang Sturzlinger, Daniel Wigdor

2018

Thumbnail for FDSense: Estimating young's modulus and stiffness of end effectors to facilitate kinetic interaction on touch surfaces

FDSense: Estimating young's modulus and stiffness of end effectors to facilitate kinetic interaction on touch surfaces

UIST 2018

Sanghwa Hong, Eunseok Jeong, Seongkook Heo, Byungjoo Lee

Thumbnail for StreamWiki: Enabling Viewers of Knowledge Sharing Live Streams to Collaboratively Generate Archival Documentation for Effective In-Stream and Post Hoc Learning

StreamWiki: Enabling Viewers of Knowledge Sharing Live Streams to Collaboratively Generate Archival Documentation for Effective In-Stream and Post Hoc Learning

CSCW 2018

Zhicong Lu, Seongkook Heo, Daniel Wigdor

Thumbnail for You Watch, You Give, and You Engage: A Study of Live Streaming Practices in China

You Watch, You Give, and You Engage: A Study of Live Streaming Practices in China

CHI 2018

Zhicong Lu, Haijun Xia, Seongkook Heo, Daniel Wigdor

Thumbnail for Thor's Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force

Thor's Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force

CHI 2018

Seongkook Heo, Christina Chung, Geehyuk Lee, Daniel Wigdor