Huck C.-H. Yang
Sr. Research Scientist, Nvidia Research
Creux du Van, Swiss
Hello! I am a Senior Research Scientist at Nvidia Research.
I obtained my Ph.D. from Georgia Institute of Technology. My dissertation focused on “a perturbation approach to differential privacy for large speech models,” advised by Chin-Hui Lee. I was a research intern at Google Speech & Brain, co-hosted by Bo Li and Yu Zhang, in Tara Sainath’s team; worked full-time at Amazon AGI with Andreas Stolcke in Ivan Bulyko’s team.
My primary research lies in the area of Acoustic Model Alignments and Speech-Language Modeling. Specifically:
-
Speech-Language Model Alignment: I explore new cross-modal alignment alogrithms (task-activating prompting, whispering-LLaMA, LLM-ASR) for adapting large language model (LLM) for noise-robust speech recognition, audio captioning, and generative error correction.
-
Parameter-Efficient Acoustic Modeling: I study new in-context learning, prompt-tuning, adapter, and their theoretical justifications (Voice2Series) to improve the current class of large-scale acoustic model adaptation (TIH) and general time series understanding.
-
Data Privacy and Robust Evaluation: My earlier work includes developing privacy-preserving, intervention-resilient algorithms (Causal-Inference Q-Network), and benchmark (HyPoradise) for audio and general deep reinforcement learning that comply with data protection regulations, aimed at human-oriented interaction with conversational signals.
Tutorial Presenter: IJCAI 2021, ICASSP 2022, 2023, 2024, Interspeech 2023
Reviewer or Program Committee: ICASSP (2019-24), NeurIPS (2020-23), AAAI (2020-23), ICML (2021-24), ASRU 2023
Technical Committee: Applied Signal Processing Systems, IEEE Signal Processing Society
news
Feb 2, 2024 | 2 ICLR, 2 ASRU, and 4 ICASSP papers are accepted |
Oct 2, 2023 | 1 UAI 23, 1 EMNLP 23, and 1 NeurIPS 23 papers are accepted |
May 17, 2023 | 7 papers and 1 tutorial are accepted to Interspeech 23 |
Feb 16, 2023 | 4 papers and 1 tutorial are accepted to ICASSP 23 |
Jan 16, 2022 | 4 papers and 2 tutorials are accepted to ICASSP 22 |