Natural Language Processing

In Natural Language Processing (NLP), we focus on how computers understand and interact with humans through natural conversation and text. We develop new NLP methods for collecting, processing, analyzing and understanding large amounts of natural language data for diverse applications such as intelligent conversational assistants, natural language search, document intelligence and knowledge acquisition.  

Our research projects span natural language understanding, dialogue systems, document semantics and affect understanding, document re-synthesis, text-mining, structured information extraction, knowledge acquisition and representation, joint language and vision-based understanding of images and videos, deep learning, and the use of natural language for computational creativity.  Our work includes efforts in intelligent assistants, multimodal search, document understanding, content generation, affect modelling, and multimodal content synthesis.  

Publications

All Publications
March 29, 2026 EACL 2026

A Survey on LLM-based Conversational User Simulation

Bo Ni, Yu Wang, Leyao Wang, Branislav Kveton, Franck Dernoncourt, Yu Xia, Hongjie Chen, Reuben Luera, Samyadeep Basu, Subhojyoti Mukherjee, Puneet Mathur, Nesreen K. Ahmed, Junda Wu, Li Li, Huixin Zhang, Ruiyi Zhang, Tong Yu, Sungchul Kim, Jiuxiang Gu, Zhengzhong Tu, Alexa Siu, Zichao Wang, David Seunghyun Yoon, Nedim Lipka, Namyong Park, Zihao Lin, Trung Bui, Yue Zhao, Tyler Derr, Ryan A. Rossi

December 7, 2025 NeurIPS 2025 MTI-LLM workshop

A Personalized Conversational Benchmark: Towards Simulating Personalized Conversations

Li Li, Peilin Cai, Ryan A. Rossi, Franck Dernoncourt, Branislav Kveton, Junda Wu, Tong Yu, Linxin Song, Tiankai Yang, Yuehan Qin, Nesreen K. Ahmed, Samyadeep Basu, Subhojyoti Mukherjee, Ruiyi Zhang, Zhengmian Hu, Bo Ni, Yuxiao Zhou, Zichao Wang, Yue Huang, Yu Wang, Xiangliang Zhang, Philip S. Yu, Xiyang Hu, Yue Zhao

Spotlight paper (top 5%)

October 20, 2025 ICCV 2025 LongVid Foundations Workshop

A Survey on Long-Video Storytelling Generation: Architectures, Consistency, and Cinematic Quality

Mohamed Elmoghany, Ryan A. Rossi, David Seunghyun Yoon, Subhojyoti Mukherjee, Eslam Bakr, Puneet Mathur, Gang Wu, Viet Dac Lai, Nedim Lipka, Ruiyi Zhang, Varun Manjunatha, Chien Nguyen, Daksh Dangi, Abel Salinas, Mohammad Taesiri, Hongjie Chen, Xiaolei Huang, Joe Barrow, Nesreen Ahmed, Hoda Eldardiry, Namyong Park, Yu Wang, Jaemin Cho, Anh Totti Nguyen, Zhengzhong Tu, Thien Nguyen, Dinesh Manocha, Mohamed Elhoseiny, Franck Dernoncourt

September 10, 2025 RANLP 2025

A Survey on Small Language Models

Chien Van Nguyen, Xuan Shen, Ryan Aponte, Yu Xia, Samyadeep Basu, Zhengmian Hu, Jian Chen, Mihir Parmar, Sasidhar Kunapuli, Joe Barrow, Junda Wu, Ashish Singh, Yu Wang, Jiuxiang Gu, Nesreen K. Ahmed, Nedim Lipka, Ruiyi Zhang, Xiang Chen, Tong Yu, Sungchul Kim, Hanieh Deilamsalehy, Namyong Park, Michael Rimer, Zhehao Zhang, Huanrui Yang, Puneet Mathur, Gang Wu, Franck Dernoncourt, Ryan A. Rossi, Thien Huu Nguyen

August 1, 2025 ACL 2025

From Selection to Generation: A Survey of LLM-based Active Learning

Yu Xia, Subhojyoti Mukherjee, Zhouhang Xie, Junda Wu, Xintong Li, Ryan Aponte, Hanjia Lyu, Joe Barrow, Hongjie Chen, Franck Dernoncourt, Branislav Kveton, Tong Yu, Ruiyi Zhang, Jiuxiang Gu, Nesreen K. Ahmed, Yu Wang, Xiang Chen, Hanieh Deilamsalehy, Sungchul Kim, Zhengmian Hu, Yue Zhao, Nedim Lipka, David Seunghyun Yoon, Ting-Hao Kenneth Huang, Zichao Wang, Puneet Mathur, Soumyabrata Pal, Koyel Mukherjee, Zhehao Zhang, Namyong Park, Thien Huu Nguyen, Jiebo Luo, Ryan A. Rossi, Julian McAuley

August 1, 2025 ACL 2025 Findings

Click, Type, Repeat: A Comprehensive Survey on GUI Agents

Dang Nguyen, Jian Chen, Yu Wang, Gang Wu, Namyong Park, Zhengmian Hu, Hanjia Lyu, Junda Wu, Ryan Aponte, Yu Xia, Xintong Li, Jing Shi, Hongjie Chen, Viet Lai, Zhouhang Xie, Sungchul Kim, Ruiyi Zhang, Tong Yu, Mehrab Tanjim, Nesreen K. Ahmed, Puneet Mathur, David Seunghyun Yoon, Lina Yao, Branislav Kveton, Jihyung Kil, Thien Huu Nguyen, Trung Bui, Tianyi Zhou, Ryan A. Rossi, Franck Dernoncourt

December 1, 2022 Foundations and Trends in Human–Computer Interaction

Readability Research: An Interdisciplinary Approach

Sofie Beier, Sam Berlow, Esat Boucaud, Zoya Bylinskii, Tianyuan Cai, Jenae Cohn, Kathy Crowley, Stephanie L. Day, Tilman Dingler, Jonathan Dobres, Jennifer Healey, Rajiv Jain, Marjorie Jordan, Bernard Kerr, Qisheng Li, Dave B. Miller, Susanne Nobles, Alexandra Papoutsaki, Jing Qian, Tina Rezvanian, Shelley Rodrigo, Ben D. Sawyer, Shannon M. Sheppard, Bram Stein, Rick Trietman, Jen Vanek, Shaun Wallace, Benjamin Wolfe

November 1, 2021 Proceedings of the 30th ACM International Conference on Information & Knowledge Management 2021

Generating Compositional Color Representations from Text

Paridhi Maheshwari, Nihal Jain, Praneetha Vaddamanu, Dhananjay Raut, Shraiysh Vaishay, Vishwa Vinay

August 2, 2021 Findings of the Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021)

Domain-Aware Dependency Parsing for Questions

Aparna Garimella, Laura Chiticariu, Yunyao Li

July 25, 2020 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2020)

Learning Colour Representations of Search Queries

Paridhi Maheshwari, Manoj Ghuhan, Vishwa Vinay

February 7, 2020 34th AAAI Conference on Artificial Intelligence (AAAI 2020)

Exploratory Navigation and Selective Reading

Natwar Modani, Paridhi Maheshwari, Harsh Deshpande, Saurab Sirpurkar, Diviya, Somak Aditya

September 3, 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)

Pre-trained Affective Word Representations

Kushal Chawla, Sopan Khosla, Niyati Chhaya, Kokil Jaidka

July 21, 2017 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2017

Relationship Proposal Networks

Ji Zhang, Mohamed Elhoseiny, Scott Cohen, Walter Chang, Ahmed Elgammal

April 17, 2017 18th International Conference on Intelligent Text Processing and Computational Linguistics

Generating Appealing Brand Names

Gaurush Hiranandani, Pranav Maneriker, Harsh Jhamtani

September 5, 2012 5th IAPR International Conference on Biometrics, {ICB} 2012, New Delhi, India

Joint inference of Soft Biometric Features

Niyati Chhaya, Tim Oates

August 6, 2009 In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pages 1133–1141, Singapore.

Real-time Decision Detection in Multi-party Dialogue

M. Frampton, J. Huang, Trung Bui, S. Peters