I’m a PhD student studying computer science at the Center for Language and Speech Processing at Johns Hopkins University, advised by Nicholas Andrews and Kevin Duh. Previously, I received my BA in computer science from Smith College, where I worked on controllable music generation. I currently work in natural language processing; my general research interest is making large language models more reliable and safer. In particular, my recent work has been on uncertainty quantification and language model agents.

Publications

2026

• RuleForge: Automated Generation and Validation for Web Vulnerability Detection at Scale (arXiv preprint)

  Ayush Garg, Sophia Hager, Jacob Montiel, Aditya Tiwari, Michael Gentile, Zach Reavis, David Magnotti, Wayne Fullen

2025

• Does Local News Stay Local?: Online Content Shifts in Sinclair-Acquired Stations (arXiv preprint)

  Miriam Wanner†, Sophia Hager†, Anjalie Field († equal contribution)

• Hell or High Water: Evaluating Agentic Recovery from External Failures (COLM 2025)

  Andrew Wang, Sophia Hager, Adi Asija, Daniel Khashabi, Nicholas Andrews

• Learning Extrapolative Sequence Transformations from Markov Chains (ICML 2025)

  Sophia Hager, Aleem Khan, Andrew Wang, Nicholas Andrews

• Uncertainty Distillation: Teaching Language Models to Express Semantic Uncertainty (arXiv preprint)

  Sophia Hager, David Mueller, Kevin Duh, Nicholas Andrews

2024

• Learning to Generate Verbalized Confidences (SFLLM @ NeurIPS, 2024)

  Sophia Hager, Nicholas Andrews

• Generating Music with Structure Using Self-Similarity as Attention (arXiv preprint)

  Sophia Hager, Kathleen Hablutzel, Katherine M. Kinnaird

2023

• Learning to Generate Text in Arbitrary Writing Styles (arXiv preprint)

  Aleem Khan, Andrew Wang, Sophia Hager, Nicholas Andrews