Learning Visual Composition through Improved Semantic Guidance. - Stone, Austin; Soltau, Hagen; Geirhos, Robert; Yi, Xi; Xia, Ye; Cao, Bingyi; Chen, Kaifeng; Ogale, Abhijit; Shlens, Jonathon (2025)

Retrieval Augmented End-to-End Spoken Dialog Models. - Wang, Mingqiu; Shafran, Izhak; Soltau, Hagen; Han, Wei; Cao, Yuan; Yu, Dian; Shafey, Laurent El (2024)

Retrieval Augmented End-to-End Spoken Dialog Models. - Wang, Mingqiu; Shafran, Izhak; Soltau, Hagen; Han, Wei; Cao, Yuan; Yu, Dian; Shafey, Laurent El (CoRR, 2024)

Knowledge Graph Reasoning with Self-supervised Reinforcement Learning. - Ma, Ying; Burns, Owen; Wang, Mingqiu; Li, Gang; Du, Nan; Shafey, Laurent El; Wang, Liqiang; Shafran, Izhak; Soltau, Hagen (CoRR, 2024)

Learning Visual Composition through Improved Semantic Guidance. - Stone, Austin; Soltau, Hagen; Geirhos, Robert; Yi, Xi; Xia, Ye; Cao, Bingyi; Chen, Kaifeng; Ogale, Abhijit; Shlens, Jonathon (CoRR, 2024)

Detecting Speech Abnormalities With a Perceiver-Based Sequence Classifier that Leverages a Universal Speech Model. - Soltau, Hagen; Shafran, Izhak; Ottenwess, Alex; Duffy, Joseph R.; Utianski, Rene L.; Barnard, Leland R.; Stricker, John L.; Wiepert, Daniela A.; Jones, David T.; Botha, Hugo (2023)

SLM: Bridge the Thin Gap Between Speech and Text Foundation Models. - Wang, Mingqiu; Han, Wei; Shafran, Izhak; Wu, Zelin; Chiu, Chung-Cheng; Cao, Yuan; Chen, Nanxin; Zhang, Yu; Soltau, Hagen; Rubenstein, Paul K.; Zilka, Lukas; Yu, Dian; et al. (2023)

AnyTOD: A Programmable Task-Oriented Dialog System. - Zhao, Jeffrey; Cao, Yuan; Gupta, Raghav; Lee, Harrison; Rastogi, Abhinav; Wang, Mingqiu; Soltau, Hagen; Shafran, Izhak; Wu, Yonghui (2023)

Speech Aware Dialog System Technology Challenge (DSTC11). - Soltau, Hagen; Shafran, Izhak; Wang, Mingqiu; Rastogi, Abhinav; Zhao, Jeffrey; Jia, Ye; Han, Wei; Cao, Yuan; Miranda, Aramys (2023)

Google USM: Scaling Automatic Speech Recognition Beyond 100 Languages. - Zhang, Yu; Han, Wei; Qin, James; Wang, Yongqiang; Bapna, Ankur; Chen, Zhehuai; Chen, Nanxin; Li, Bo; Axelrod, Vera; Wang, Gary; Meng, Zhong; Hu, Ke; et al. (CoRR, 2023)

Speech-to-Text Adapter and Speech-to-Entity Retriever Augmented LLMs for Speech Understanding. - Wang, Mingqiu; Shafran, Izhak; Soltau, Hagen; Han, Wei; Cao, Yuan; Yu, Dian; Shafey, Laurent El (CoRR, 2023)

Efficient Adapters for Giant Speech Models. - Chen, Nanxin; Shafran, Izhak; Zhang, Yu; Chiu, Chung-Cheng; Soltau, Hagen; Qin, James; Wu, Yonghui (CoRR, 2023)

SLM: Bridge the thin gap between speech and text foundation models. - Wang, Mingqiu; Han, Wei; Shafran, Izhak; Wu, Zelin; Chiu, Chung-Cheng; Cao, Yuan; Wang, Yongqiang; Chen, Nanxin; Zhang, Yu; Soltau, Hagen; Rubenstein, Paul K.; Zilka, Lukas; et al. (CoRR, 2023)

Detecting Speech Abnormalities with a Perceiver-based Sequence Classifier that Leverages a Universal Speech Model. - Soltau, Hagen; Shafran, Izhak; Ottenwess, Alex; Duffy, Joseph R.; Utianski, Rene L.; Barnard, Leland R.; Stricker, John L.; Wiepert, Daniela A.; Jones, David T.; Botha, Hugo (CoRR, 2023)

Knowledge-grounded Dialog State Tracking. - Yu, Dian; Wang, Mingqiu; Cao, Yuan; Shafey, Laurent El; Shafran, Izhak; Soltau, Hagen (2022)

RNN Transducers for Named Entity Recognition with constraints on alignment for understanding medical conversations. - Soltau, Hagen; Shafran, Izhak; Wang, Mingqiu; Shafey, Laurent El (2022)

Unsupervised Slot Schema Induction for Task-oriented Dialog. - Yu, Dian; Wang, Mingqiu; Cao, Yuan; Shafran, Izhak; Shafey, Laurent El; Soltau, Hagen (2022)

RNN Transducers for Nested Named Entity Recognition with constraints on alignment for long sequences. - Soltau, Hagen; Shafran, Izhak; Wang, Mingqiu; Shafey, Laurent El (CoRR, 2022)

Unsupervised Slot Schema Induction for Task-oriented Dialog. - Yu, Dian; Wang, Mingqiu; Cao, Yuan; Shafran, Izhak; Shafey, Laurent El; Soltau, Hagen (CoRR, 2022)

Knowledge-grounded Dialog State Tracking. - Yu, Dian; Wang, Mingqiu; Cao, Yuan; Shafran, Izhak; Shafey, Laurent El; Soltau, Hagen (CoRR, 2022)

Speech Aware Dialog System Technology Challenge (DSTC11). - Soltau, Hagen; Shafran, Izhak; Wang, Mingqiu; Rastogi, Abhinav; Zhao, Jeffrey; Jia, Ye; Han, Wei; Cao, Yuan; Miranda, Aramys (CoRR, 2022)

AnyTOD: A Programmable Task-Oriented Dialog System. - Zhao, Jeffrey; Cao, Yuan; Gupta, Raghav; Lee, Harrison; Rastogi, Abhinav; Wang, Mingqiu; Soltau, Hagen; Shafran, Izhak; Wu, Yonghui (CoRR, 2022)

Word-Level Confidence Estimation for RNN Transducers. - Wang, Mingqiu; Soltau, Hagen; Shafey, Laurent El; Shafran, Izhak (2021)

Understanding Medical Conversations: Rich Transcription, Confidence Scores & Information Extraction. - Soltau, Hagen; Wang, Mingqiu; Shafran, Izhak; Shafey, Laurent El (2021)

Understanding Medical Conversations: Rich Transcription, Confidence Scores & Information Extraction. - Soltau, Hagen; Wang, Mingqiu; Shafran, Izhak; Shafey, Laurent El (CoRR, 2021)

Word-level confidence estimation for RNN transducers. - Wang, Mingqiu; Soltau, Hagen; Shafey, Laurent El; Shafran, Izhak (CoRR, 2021)

The Medical Scribe: Corpus Development and Model Performance Analyses. - Shafran, Izhak; Du, Nan; Tran, Linh; Perry, Amanda; Keyes, Lauren; Knichel, Mark; Domin, Ashley; Huang, Lei; Chen, Yuhui; Li, Gang; Wang, Mingqiu; Shafey, Laurent El; et al. (2020)

The Medical Scribe: Corpus Development and Model Performance Analyses. - Shafran, Izhak; Du, Nan; Tran, Linh; Perry, Amanda; Keyes, Lauren; Knichel, Mark; Domin, Ashley; Huang, Lei; Chen, Yuhui; Li, Gang; Wang, Mingqiu; Shafey, Laurent El; et al. (CoRR, 2020)

Monotonic Recurrent Neural Network Transducer and Decoding Strategies. - Tripathi, Anshuman; Lu, Han; Sak, Hasim; Soltau, Hagen (2019)

Joint Speech Recognition and Speaker Diarization via Sequence Transduction. - Shafey, Laurent El; Soltau, Hagen; Shafran, Izhak (2019)

Joint Speech Recognition and Speaker Diarization via Sequence Transduction. - Shafey, Laurent El; Soltau, Hagen; Shafran, Izhak (CoRR, 2019)

Reducing the computational complexity for whole word models. - Soltau, Hagen; Liao, Hank; Sak, Hasim (2017)

Neural Speech Recognizer: Acoustic-to-Word LSTM Model for Large Vocabulary Speech Recognition. - Soltau, Hagen; Liao, Hank; Sak, Hasim (2017)

Neural Speech Recognizer: Acoustic-to-Word LSTM Model for Large Vocabulary Speech Recognition. - Soltau, Hagen; Liao, Hank; Sak, Hasim (CoRR, 2016)

Deep Convolutional Neural Networks for Large-scale Speech Tasks. - Sainath, Tara N.; Kingsbury, Brian; Saon, George; Soltau, Hagen; Mohamed, Abdel-rahman; Dahl, George E.; Ramabhadran, Bhuvana (Neural Networks, 2015)

Analyzing convolutional neural networks for speech activity detection in mismatched acoustic conditions. - Thomas, Samuel; Ganapathy, Sriram; Saon, George; Soltau, Hagen (2014)

Progress in dynamic network decoding. - Nolden, David; Soltau, Hagen; Ney, Hermann (2014)

A comparison of two optimization techniques for sequence discriminative training of deep neural networks. - Saon, George; Soltau, Hagen (2014)

Joint training of convolutional and non-convolutional neural networks. - Soltau, Hagen; Saon, George; Sainath, Tara N. (2014)

Out-of-vocabulary word detection in a speech-to-speech translation system. - Kuo, Hong-Kwang; Kislal, Ellen Eide; Mangu, Lidia; Soltau, Hagen; Beran, Tomás (2014)

Efficient spoken term detection using confusion networks. - Mangu, Lidia; Kingsbury, Brian; Soltau, Hagen; Kuo, Hong-Kwang; Picheny, Michael (2014)

Unfolded recurrent neural networks for speech recognition. - Saon, George; Soltau, Hagen; Emami, Ahmad; Picheny, Michael (2014)

Removing redundancy from lattices. - Nolden, David; Soltau, Hagen; Povey, Daniel; Ghahremani, Pegah; Mangu, Lidia; Ney, Hermann (2014)

Automatic Speech Recognition. - Soltau, Hagen; Saon, George; Mangu, Lidia; Kuo, Hong-Kwang; Kingsbury, Brian; Chu, Stephen M.; Biadsy, Fadi (2014)

Optimization Techniques to Improve Training Speed of Deep Neural Networks for Large Speech Tasks. - Sainath, Tara N.; Kingsbury, Brian; Soltau, Hagen; Ramabhadran, Bhuvana (IEEE Trans. Speech Audio Process., 2013)

Speaker adaptation of neural network acoustic models using i-vectors. - Saon, George; Soltau, Hagen; Nahamoo, David; Picheny, Michael (2013)

The IBM keyword search system for the DARPA RATS program. - Mangu, Lidia; Soltau, Hagen; Kuo, Hong-Kwang; Saon, George (2013)

Improvements to Deep Convolutional Neural Networks for LVCSR. - Sainath, Tara N.; Kingsbury, Brian; Mohamed, Abdel-rahman; Dahl, George E.; Saon, George; Soltau, Hagen; Beran, Tomás; Aravkin, Aleksandr Y.; Ramabhadran, Bhuvana (2013)

Exploiting diversity for spoken term detection. - Mangu, Lidia; Soltau, Hagen; Kuo, Hong-Kwang; Kingsbury, Brian; Saon, George (2013)

Morpheme-based feature-rich language models using Deep Neural Networks for LVCSR of Egyptian Arabic. - Mousa, Amr El-Desoky; Kuo, Hong-Kwang Jeff; Mangu, Lidia; Soltau, Hagen (2013)

Neural network acoustic models for the DARPA RATS program. - Soltau, Hagen; Kuo, Hong-Kwang; Mangu, Lidia; Saon, George; Beran, Tomás (2013)

The IBM speech activity detection system for the DARPA RATS program. - Saon, George; Thomas, Samuel; Soltau, Hagen; Ganapathy, Sriram; Kingsbury, Brian (2013)

Improvements to deep convolutional neural networks for LVCSR. - Sainath, Tara N.; Kingsbury, Brian; Mohamed, Abdel-rahman; Dahl, George E.; Saon, George; Soltau, Hagen; Beran, Tomás; Aravkin, Aleksandr Y.; Ramabhadran, Bhuvana (CoRR, 2013)

Boosting systems for large vocabulary continuous speech recognition. - Saon, George; Soltau, Hagen (Speech Commun., 2012)

Scalable Minimum Bayes Risk Training of Deep Neural Network Acoustic Models Using Distributed Hessian-free Optimization. - Kingsbury, Brian; Sainath, Tara N.; Soltau, Hagen (2012)

From Modern Standard Arabic to Levantine ASR: Leveraging GALE for dialects. - Soltau, Hagen; Mangu, Lidia; Biadsy, Fadi (2011)

The IBM 2011 GALE Arabic speech transcription system. - Mangu, Lidia; Kuo, Hong-Kwang; Chu, Stephen M.; Kingsbury, Brian; Saon, George; Soltau, Hagen; Biadsy, Fadi (2011)

The IBM 2009 GALE Arabic speech transcription system. - Kingsbury, Brian; Soltau, Hagen; Saon, George; Chu, Stephen M.; Kuo, Hong-Kwang; Mangu, Lidia; Ravuri, Suman V.; Morgan, Nelson; Janin, Adam (2011)

The IBM 2008 GALE Arabic speech transcription system. - Saon, George; Soltau, Hagen; Chaudhari, Upendra V.; Chu, Stephen M.; Kingsbury, Brian; Kuo, Hong-Kwang; Mangu, Lidia; Povey, Daniel (2010)

A comparative study on system combination schemes for LVCSR. - Ma, Chengyuan; Kuo, Hong-Kwang Jeff; Soltau, Hagen; Cui, Xiaodong; Chaudhari, Upendra V.; Mangu, Lidia; Lee, Chin-Hui (2010)

Decoding with shrinkage-based language models. - Emami, Ahmad; Chen, Stanley F.; Ittycheriah, Abraham; Soltau, Hagen; Zhao, Bing (2010)

Boosting systems for LVCSR. - Saon, George; Soltau, Hagen (2010)

Discriminative Phonotactics for Dialect Recognition Using Context-Dependent Phone Classifiers. - Biadsy, Fadi; Soltau, Hagen; Mangu, Lidia; Navrátil, Jirí; Hirschberg, Julia (2010)

The IBM Attila speech recognition toolkit. - Soltau, Hagen; Saon, George; Kingsbury, Brian (2010)

Advances in Arabic Speech Transcription at IBM Under the DARPA GALE Program. - Soltau, Hagen; Saon, George; Kingsbury, Brian; Kuo, Hong-Kwang Jeff; Mangu, Lidia; Povey, Daniel; Emami, Ahmad (IEEE Trans. Speech Audio Process., 2009)

Dynamic network decoding revisited. - Soltau, Hagen; Saon, George (2009)

Large margin semi-tied covariance transforms for discriminative training. - Saon, George; Povey, Daniel; Soltau, Hagen (2009)

Fast speaker adaptive training for speech recognition. - Povey, Daniel; Kuo, Hong-Kwang Jeff; Soltau, Hagen (2008)

The IBM 2006 Gale Arabic ASR System. - Soltau, Hagen; Saon, George; Kingsbury, Brian; Kuo, Hong-Kwang Jeff; Mangu, Lidia; Povey, Daniel; Zweig, Geoffrey (2007)

Advances in speech transcription at IBM under the DARPA EARS program. - Chen, Stanley F.; Kingsbury, Brian; Mangu, Lidia; Povey, Daniel; Saon, George; Soltau, Hagen; Zweig, Geoffrey (IEEE Trans. Speech Audio Process., 2006)

Compensating hyperarticulation for automatic speech recognition. - Soltau, Hagen (2005)

The IBM 2004 Conversational Telephony System for Rich Transcription. - Soltau, Hagen; Kingsbury, Brian; Mangu, Lidia; Povey, Daniel; Saon, George; Zweig, Geoffrey (2005)

fMPE: Discriminatively Trained Features for Speech Recognition. - Povey, Daniel; Kingsbury, Brian; Mangu, Lidia; Saon, George; Soltau, Hagen; Zweig, Geoffrey (2005)

The 2003 ISL rich transcription system for conversational telephony speech. - Soltau, Hagen; Yu, Hua; Metze, Florian; Fügen, Christian; Jin, Qin; Jou, Szu-Chen Stan (2004)

Efficient language model lookahead through polymorphic linguistic context assignment. - Soltau, Hagen; Metze, Florian; Fügen, Christian; Waibel, Alex (2002)

Compensating for hyperarticulation by modeling articulatory properties. - Soltau, Hagen; Metze, Florian; Waibel, Alex (2002)

The ISL evaluation system for Verbmobil-II. - Soltau, Hagen; Schaaf, Thomas; Metze, Florian; Waibel, Alex (2001)

Speaker compensation with sine-log all-pass transforms. - McDonough, John W.; Metze, Florian; Soltau, Hagen; Waibel, Alex (2001)

Advances in automatic meeting record creation and access. - Waibel, Alex; Bett, Michael; Metze, Florian; Ries, Klaus; Schaaf, Thomas; Schultz, Tanja; Soltau, Hagen; Yu, Hua; Zechner, Klaus (2001)

Speech recognition over netmeeting connections. - Metze, Florian; McDonough, John W.; Soltau, Hagen (2001)

Advances in meeting recognition. - Waibel, Alex; Yu, Hua; Schultz, Tanja; Pan, Yue; Bett, Michael; Westphal, Martin; Soltau, Hagen; Schaaf, Thomas; Metze, Florian (2001)

Specialized acoustic models for hyperarticulated speech. - Soltau, Hagen; Waibel, Alex (2000)

Confidence measure based language identification. - Metze, Florian; Kemp, Thomas; Schaaf, Thomas; Schultz, Tanja; Soltau, Hagen (2000)

Phone dependent modeling of hyperarticulated effects#. - Soltau, Hagen; Waibel, Alex (2000)

Recognition of music types. - Soltau, Hagen; Schultz, Tanja; Westphal, Martin; Waibel, Alex (1998)

On the influence of hyperarticulated speech on recognition performance. - Soltau, Hagen; Waibel, Alex (1998)

Automatische Identifizierung spontan gesprochener Sprachen mit neuronalen Netzen. - Schultz, Tanja; Soltau, Hagen (1996)