Biography
Julia Hirschberg has been a professor in the Department of Computer Science at Columbia University since 2002, serving as Chair from July 2012 through June 2018. She was appointed Percy K. and Vida L. W. Hudson Professor of Computer Science in 2013. She received her PhD in Computer Sci-ence from the University of Pennsylvania. She worked at Bell Laboratories and AT&T Laboratories – Research from 1985-2003 as a Member of Technical Staff, Department Head, and Technology Leader, creating the Human-Computer Interface Research Department at Bell Labs. She has done research on prosody, discourse structure, conversational implicature, text-to-speech synthesis, speech summariza- tion, spoken dialogue systems, emotional speech, deceptive speech, charismatic speech, entrainment, empathetic speech and code-switching. She served as editor-in-chief of Computational Linguistics from 1993-2003 and was an editor-in-chief of Speech Communication from 2003-2006 and is now on the Ed- itorial Board. She served on the Executive Board of the Association for Computational Linguistics (ACL) from 1993-2003, the IEEE Speech and Language Processing Technical Committee (SLTC) from 2011–, the executive board of the North American chapter of the Association for Computational Lin- guistics (NAACL), 2012-2015, the AAAI Council, 2012-2015, the Board of Directors of the Computing Research Association (CRA) 2013-15; 2018–, the ACM/AAAI Alan Newell Award Committee, 2018–; as Vice Chair of the IEEE SPS Fellow Evaluation Committee, 2019–21; the American Philosophical Society Class 1 Memberships Committee, 2019–; the American Academy of Arts and Sciences Class I Section 6 Membership Panel, 2020– (currently as Chair); NAE Section 5 as Vice Chair, 2019-20, and Chair, 2020-21; the board of the International Speech Communication Association (ISCA) from 1999-2007 (as President 2005-2007); Advisory Council 2007–, chair of Distinguished Lecturers Selec-tion Committee, 2010–2012), and on the ISCA Diversity Committee (2018–). She is former co-chair of the CRA-W (now CRA-WP), 2016–2019, and was a board member 2009-22. She has been a fellow of the Association for the Advancement of Artificial Intelligence since 1994, an ISCA Fellow since 2008, a founding Fellow of the ACL since 2011, an ACM fellow since 2015, an IEEE Fellow since 2017, a Fellow of the International Academy of Artificial Intelligence Sciences (AAIS) in 2024. She was elected to the American Philosophical Society in 2014, the National Academy of Engineering in 2017 and the American Academy of Arts and Sciences in 2018. She has received honorary doctorates from the Royal Institute of Technology (KTH) Stockholm and from Tilburg University in the Netherlands.
She is the 2011 recipient of the James L. Flanagan Speech and Audio Processing Award from IEEE and of the ISCA Medal for Scientific Achievement and received the ISCA Special Service medal in 2020. She received the National Academy of Artificial Intelligence (NAAI) Artificial Intelligence Ex- ploration Award and the ACL Dragomir Radev Distinguished Service Medal in 2025. She was elected to the American Philosophical Society in 2014, was elected an honorary member of the Association for Laboratory Phonology in 2014, and was selected as the Fillmore Professor at the 2017 LSA summer Institute. She received a Columbia Engineering School Alumni Association (CESAA) Distinguished Faculty Teaching Award in 2009 and received the Columbia Janette and Armen Avanessians Diversity Award in 2018. She won best paper awards from EMNLP 2021 (Best Short Paper), Eurasip (2005) for Best Paper published in Speech Communication for 2003-2004, Interspeech 2006 (Best Student Paper), the AVIOS award for Best Paper appearing in the Journal of AVIOS in 1994, Best Paper at Coginfo Comm 2012, Best Student Paper at Speech Prosody 2014, Best Paper Award for Cognitive 2015, and 2016 Best Paper Award for an article appearing in Computer Speech and Language. She has received IBM Faculty Awards in 2005 and 2006 and has also received funding from the National Science Foundation (NSF), the National Institute of Health (NIH), the Department of Homeland Se- curity, DARPA, Google, IARPA, KDD, Lockheed Martin, the Air Force Office of Scientific Research, the Simons Foundation and Amazon. She was an Amazon Scholar (2020-2025). She holds 6 patents for text-to-speech synthesis and audio browsing/retrieval. Her h-index is 82 and citations are 34649.
Abstract
Title: Detecting Deceptive Speech
Abstract: Multimodal deception detection was supported for our group after 9/11 by a new Department of Homeland Security. The questions they wanted us to focus on were: What aspects of human behavior are valid indicators of deception? Can we create reliable automatic deception detection models to identify future terrorists? We had later support from the Air Force Office of Scientific Research focuses on identifying human trust as well deception: What aspects of human speech are trusted by other humans? What are mis-trusted? Can we build good trust models to identify and to generate trusted speech?