← All publications

ACM UIST'26Conference C4

CineHaptic: Context-Aware Real-Time Audiovisual-to-Haptic Rendering System for In-Vehicle 4D Cinematic Experiences

Junwoo Kim, Hyunuk Kim, Hyun-Bin Oh, Jeonggoo Kang, Tae-Hyun Oh, Seungmoon Choi

ACM Symposium on User Interface Software and Technology (ACM UIST), 2026 · Article 56 · pp. 1–14

PaperWatch videoCitation details
CineHaptic pipeline from audiovisual event localization, salience classification, and audio processing to seat-based haptic patterns for an in-car 4D experience
CineHaptic pipeline from audiovisual event localization, salience classification, and audio processing to seat-based haptic patterns for an in-car 4D experience.

At a glance

Which movie sounds should a passenger feel, and where on the seat?

CineHaptic turns an action scene into vibrations a passenger can feel through a car seat. It works during playback without a manually authored haptic track.

Audiovisual-to-hapticReal-time renderingIn-vehicle experience

Project video

Watch on YouTube

The approach

The system rates each sound event on a four-level scale, then uses the image and sound together to locate its source on screen. The event's importance determines how many of the six seat actuators fire. Its location guides which ones fire, and the sound shapes how the vibration rises and falls.

Key takeaways

  1. Selective feedback

    The seat can skip dialogue and background noise while reproducing impacts at positions that correspond to their sources on screen.

  2. Timing held over an hour of playback

    During a 60-minute movie, the seat response lagged the audiovisual event by an average of 38.47 ms.

  3. Matching the location improved immersion

    In a parked vehicle, 28 participants compared four rendering methods across six clips. They rated the version that combined event importance and location highest for immersion and preference.

Summary based on Published paper · ACM Digital Library.

Citation

Publication details & BibTeX
Conference
ACM Symposium on User Interface Software and Technology (ACM UIST)
Proceedings
Proceedings of the 39th Annual ACM Symposium on User Interface Software and Technology
Year
2026
Published online
Nov 1, 2026
Article number
56
Pages
1–14
Acceptance rate
20.1%
Publisher
Association for Computing Machinery
DOI
10.1145/3830398.3830655
BibTeX 

@inproceedings{Kim26CineHaptic,
  author = {Kim, Junwoo and Kim, Hyunuk and Oh, Hyun-Bin and Kang, Jeonggoo and Oh, Tae-Hyun and Choi, Seungmoon},
  title = {{CineHaptic: Context-Aware Real-Time Audiovisual-to-Haptic Rendering System for In-Vehicle 4D Cinematic Experiences}},
  booktitle = {Proceedings of the 39th Annual ACM Symposium on User Interface Software and Technology},
  series = {UIST '26},
  year = {2026},
  month = nov,
  publisher = {Association for Computing Machinery},
  isbn = {9798400728563},
  location = {Detroit, Michigan, USA},
  articleno = {56},
  numpages = {14},
  pages = {1--14},
  doi = {10.1145/3830398.3830655},
  url = {https://doi.org/10.1145/3830398.3830655}
}

BibTeX: ACM Digital Library · publication record