Dae Hyeon Kim RESEARCH 한국어

Dual-stream interaction modeling

Researching a dual-stream architecture that connects continuous physiological encoders with dialogue models.

Related research: fr-ptt-bp
Role
Research contributor and model co-developer
Contribution
Studying physiological state representations and LLM interfaces. Co-developed the related FR-PTT contactless blood-pressure model.
Period & affiliation
2026.03 ~ Present NRF

01 / RESEARCH DETAILRelated FR-PTT encoder and dual-stream research

Challenge
Contactless blood-pressure estimation requires information beyond the pulse waveform alone.
Approach
Combined pulse morphology with 28 pulse-transit-time relations among eight facial regions in a three-branch model.
Contribution and ongoing work
Co-developed FR-PTT and contributed to its IJCNN 2026 oral presentation. Studying physiological state representations and LLM interfaces.
Separate encoders for waveforms, morphology and facial PTT
Separate encoders for waveforms, morphology and facial PTT
View full-size figure
Facial PTT extraction and invalid-peak exclusion
Facial PTT extraction and invalid-peak exclusion
View full-size figure
Effect of branch fusion (mmHg) Waveform only: SBP 15.89, DBP 11.14; Full model: SBP 13.13, DBP 7.56 0 5 10 15 19 15.89 13.13 SBP 11.14 7.56 DBP Waveform only Full model
Effect of branch fusion (mmHg)
FR-PTT error (mmHg) and ongoing research
Evaluation dataset SBP MAE DBP MAE
VitalVideos 13.13 7.56
V4V 12.16 8.96
Evaluation conditions and scopeFR-PTT evaluation on VitalVideos and V4V. The dual-stream foundation model is in development.