AI Agents

MusicRec: Audio, Lyrics, and Engagement Feature Enrichment for Music Recommendation

Srikar Prabhas Kandagatla, Sreehitha R. Narayana, Chandana Magapu, Swetha Mohan, Shamanth Kuthpadi Seethakantha, Hongjie Chen, Ryan A. Rossi, Franck Dernoncourt, Nesreen Ahmed

Orthrus: Memory-Efficient Parallel Token Generation via Dual-View Diffusion

Chien Van Nguyen, Chaitra Hegde, Van Cuong Pham, Ryan A. Rossi, Franck Dernoncourt, Thien Huu Nguyen

Spotlight paper

ViT-AdaLA: Adapting Vision Transformers with Linear Attention

Yifan Li, David Seunghyun Yoon, Viet Lai, Franck Dernoncourt, Jason Kuen, Yu Kong, Trung Bui

StreamGaze: Gaze-Guided Temporal Reasoning and Proactive Understanding in Streaming Videos

Daeun Lee, Subhojyoti Mukherjee, Branislav Kveton, Ryan A. Rossi, Viet Lai, David Seunghyun Yoon, Trung Bui, Franck Dernoncourt, Mohit Bansal

When Attention Closes: How LLMs Lose the Thread in Multi-Turn Interaction

Vardhan_Dongre, Joseph Hsieh, Viet Lai, David Seunghyun Yoon, Trung Bui, Dilek Hakkani-Tür

Iterative Critique-Refine Framework for Enhancing LLM Personalization

Durga Prasad Maram, Dhruvin Gandhi, Zonghai Yao, Gayathri Akkinapalli, Franck Dernoncourt, Yu Wang, Ryan A. Rossi, Nesreen K. Ahmed

Reasoning-Based Personalized Generation for Sparse Users

Bo Ni, Branislav Kveton, Samyadeep Basu, Subhojyoti Mukherjee, Leyao Wang, Franck Dernoncourt, Sungchul Kim, David Seunghyun Yoon, Jack Wang, Ruiyi Zhang, Puneet Mathur, Jihyung Kil, Jiuxiang Gu, Nedim Lipka, Yu Wang, Ryan A. Rossi, Tyler Derr

Micro-Edits: Computational Support for Fine-Scale Edits in Film

Mackenzie Leake, Hijung Valentina Shin, Nhân Trần, Abe Davis

Honorable Mention for Best Paper Award

A Text-Native Interface for Generative Video Authoring

Ding Li, Mira Dontcheva, Bruce Liu

Honorable Mention for Best Paper Award

UXCascade: Scalable Usability Testing with Simulated User Agents

Steffen Holter, Eunyee Koh, Doga Dogan, Gromit Yeuk-Yin Chan

Surprise2Refine: Axis-Centered Exploration-To-Refinement for Agent-Assisted Creative Scaffolding

Yuzhe You, Gromit Yeuk-Yin Chan, Shunan Guo, Anlan Zhang, Eunyee Koh, Jian Zhao, Tongyu Zhou

Sidekick: Designing Communication for Effective Multitasking with Computer Use Agents

Dingzeyu Li, Bryan Wang, Ruei-Che Chang, Wenqian Xu, Anhong Guo

CAVEWOMAN: How Large Language Models Behave Under Linguistic Input and Output Compression

Morayo Danielle Adeyemi, Ryan A. Rossi, Franck Dernoncourt

CRISP: Cliff-aware Residual-free Input-adaptive Sparse Prefilling with Entropy-Motivated Routing

Huy Huu Nguyen, Chien Van Nguyen, Franck Dernoncourt, Ryan A. Rossi, Linh Ngo Van, Jieyang Chen, Thien Huu Nguyen

EventKD: Event-Aware Knowledge Distillation for Generative Event Extraction

Hoang Thanh Dat, Quoc Phong Dao, Nam Le Hai, Franck Dernoncourt, Linh Ngo Van, Trung Le, Thien Huu Nguyen

GRASP: GRanularity-Aware Search Policy for Agentic RAG

Varun Gandhi, Jaewook Lee, Shantanu Todmal, Franck Dernoncourt, Ryan A. Rossi, Jack Wang, Andrew Lan

Not Worth Another Token: Marginal Value Estimation for Efficient Deep Research Agents

Harshitha Kolukuluru, Reshma Ashok, Kirat Arora, Evan William Ciccarelli, Nischal Ashok Kumar, Lunyiu Nie, Franck Dernoncourt, Samyadeep Basu, Ryan A. Rossi, Nedim Lipka

Trust but Verify: Introducing DAVinCI – A Framework for Dual Attribution and Verification in Claim Inference for Language Models

Vipula Rawte, Ryan A. Rossi, Franck Dernoncourt, Nedim Lipka

Code-Switching Reveals Language Anchoring in Multilingual LLMs

Jeonghyun Park, David Seunghyun Yoon, Yonghyun Jun, Hwanhee Lee

CHARM: Character Hallucination for Multicultural Role Play Benchmark

Sunkyung_Han, Nahyeon Park, Gaeun Seo, David Seunghyun Yoon, JinYeong Bak

FlexRouter: Learning Complementary Model Sets for Flexible LLM Routing

Wang Wei, Hongzheng Yang, Tiankai Yang, Samyadeep Basu, Hongjie Chen, Yue Zhao, Franck Dernoncourt, Ryan A. Rossi, Hoda Eldardiry

Personalized Auto-Research: Towards a True AI Co-Scientist

Bo Ni, Franck Dernoncourt, Hongjie Chen, Yu Wang, Nesreen K. Ahmed, Zhengzhong Tu, Tyler Derr, Ryan A. Rossi

Quantitative LLM Judges Using Post-Hoc Score Calibration

Aishwarya Sahoo, Jeevana Kruthi Karnuthala, Tushar Parmanand Budhwani, Pranchal Agarwal, Sankaran Vaidyanathan, Alexa Siu, Franck Dernoncourt, Jennifer Healey, Nedim Lipka, Ryan A. Rossi, Uttaran Bhattacharya, Branislav Kveton

Diagnosing Evidence Utilization in Multimodal Document Question Answering

Debolena Basak, Digbalay Bose, Koustava Goswami, Maunendra Sankar Desarkar

Towards Trustworthy Retrieval Augmented Generation for Large Language Models: A Survey

Bo Ni, Zheyuan Liu, Leyao Wang, Yongjia Lei, Yuying Zhao, Xueqi Cheng, Qingkai Zeng, Luna Dong, Yinglong Xia, Krishnaram Kenthapadi, Ryan A. Rossi, Franck Dernoncourt, Md Mehrab Tanjim, Nesreen Ahmed, Xiaorui Liu, Wenqi Fan, Erik Blasch, Yu Wang, Meng Jiang, Tyler Derr

Benchmarking Knowledge-Extraction Attack and Defense on Retrieval-Augmented Generation

Zhisheng Qi, Utkarsh Sahu, Li Ma, Haoyu Han, Ryan A. Rossi, Franck Dernoncourt, Mahantesh M Halappanavar, Nesreen K. Ahmed, Yushun Dong, Yue Zhao, Yu Zhang, Yu Wang

Lizard: An Efficient Linearization Framework for Large Language Models

Chien Van Nguyen, Huy Huu Nguyen, Ruiyi Zhang, Hanieh Deilamsalehy, Puneet Mathur, Viet Lai, Haoliang Wang, Jayakumar Subramanian, Ryan A. Rossi, Trung Bui, Nikos Vlassis, Franck Dernoncourt, Thien Huu Nguyen

Structured Uncertainty guided Clarification for LLM Agents

Manan Suri, Puneet Mathur, Nedim Lipka, Franck Dernoncourt, Ryan A. Rossi, Dinesh Manocha

Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams

Jiyeon Kim, Hyunji Lee, Dylan Zhou, Sue Hyun Park, David Seunghyun Yoon, Trung Bui, Franck Dernoncourt, Sungmin Cha, Minjoon Seo

FIFA: Unified Faithfulness Evaluation Framework for Text-to-Video and Video-to-Text Generation

Liqiang Jing, Viet Lai, David Seunghyun Yoon, Trung Bui, Xinya Du

Octopus: Gated Selective Attention for Memory-Bounded Long-Context Inference in Large Language Models

Chien Van Nguyen, Ryan A. Rossi, Linh Ngo Van, Franck Dernoncourt, Thien Huu Nguyen

Test-Time Strategies for More Efficient and Accurate Agentic RAG

Brian Zhang, Deepti Guntur, Zhiyang Zuo, Abhinav Sharma, Shreyas Chaudhari, Wenlong Zhao, Franck Dernoncourt, Puneet Mathur, Ryan A. Rossi, Nedim Lipka

Explainable Disentangled Representation Learning for Generalizable Authorship Attribution in the Era of Generative AI

Hieu Man, Van-Cuong Pham, Nghia Trung Ngo, Franck Dernoncourt, Thien Huu Nguyen

An Interactive Paradigm for Deep Research

Lin Ai, Victor S. Bursztyn, Xiang Chen, Julia Hirschberg, Saayan Mitra

TeamFusion: Supporting Open-ended Teamwork with Multi-Agent Systems

Jiale Liu, Victor S. Bursztyn, Lin Ai, Haoliang Wang, Sunav Choudhary, Saayan Mitra, Qingyun Wu

Anticipatory Planning for Multimodal Agents

Yongyuan Liang, Shijie Zhou, Yu Gu, Hao Tan, Gang Wu, Franck Dernoncourt, Jihyung Kil, Ryan A. Rossi, Ruiyi Zhang

SliderEdit: Continuous Image Editing with Fine-Grained Instruction Control

Arman Zarei, Samyadeep Basu, Mobina Pournemat, Sayan Nag, Ryan A. Rossi, Soheil Feizi

CVPR Oral

Through the PRISM: Principle-Aware, Interpretable, and Multi-Scale Evaluation of Visual Designs

Mona Gandhi, Joseph K J, Srinivasan Parthasarathy, Sayan Nag

Findings Track

OWLViz: An Open-World Benchmark for Visual Question Answering

Thuy Nguyen, Dang Nguyen, Hoàng Nguyễn, Thuan Duc Luong, Franck Dernoncourt, Long Hoang Dang, Viet Lai

mSCoRe: A Multilingual and Scalable Benchmark for Skill-based Commonsense Reasoning

Nghia Trung Ngo, Franck Dernoncourt, Thien Huu Nguyen

Reasoning Graph-Structured Question Answering: Datasets and Insights from LLM Benchmarking

Khin Yone, Devasha Trivedi, Anish Pahilajani, Jincen Shuai, Samyak Rajesh Jain, Ryan A. Rossi, Nesreen K. Ahmed, Franck Dernoncourt, Yu Wang and Namyong Park

Steering MoE LLMs via Expert (De)Activation

Mohsen Fayyaz, Ali Modarressi, Hanieh Deilamsalehy, Franck Dernoncourt, Ryan A. Rossi, Trung Bui, Hinrich Schuetze, Nanyun Peng

Charts Are Not Images: On the Challenges of Scientific Chart Editing

Li Li, Ryan A. Rossi, Sungchul Kim, Sunav Choudhary, Franck Dernoncourt, Puneet Mathur, Zhengzhong Tu, Yue Zhao

Spinning Straw into Gold: Relabeling LLM Agent Trajectories in Hindsight for Successful Demonstrations

Zichao Li, Gang Wu, Jack Wang, Ruiyi Zhang, Wanrong Zhu, Ryan A. Rossi, Vlad Morariu, Jihyung Kil

XAgen: An Explainability Tool for Identifying and Correcting Failures in Multi-Agent Workflows

Xinru Wang, Ming Yin, Eunyee Koh, Doga Dogan

Interview-Informed Generative Agents for Product Discovery: A Validation Study

Jack Wang, Alexa Siu

Best Paper Honorable Mention

From Conversation to Human-AI Common Ground: Extracting Cognitive Workflows for Reuse in Sense-making Tasks

Xinyue Chen, Varun Manjunatha, Xu Wang, Alexa Siu

Skill Discovery for Software Scripting Automation via Offline Simulations with LLMs

Paiheng Xu, Gang Wu, Xiang Chen, Tong Yu, Chang Xiao, Franck Dernoncourt, Tianyi Zhou, Wei Ai, Vishy Swaminathan

A Survey on LLM-based Conversational User Simulation

Bo Ni, Yu Wang, Leyao Wang, Branislav Kveton, Franck Dernoncourt, Yu Xia, Hongjie Chen, Reuben Luera, Samyadeep Basu, Subhojyoti Mukherjee, Puneet Mathur, Nesreen K. Ahmed, Junda Wu, Li Li, Huixin Zhang, Ruiyi Zhang, Tong Yu, Sungchul Kim, Jiuxiang Gu, Zhengzhong Tu, Alexa Siu, Zichao Wang, David Seunghyun Yoon, Nedim Lipka, Namyong Park, Zihao Lin, Trung Bui, Yue Zhao, Tyler Derr, Ryan A. Rossi

Instruction Tuning with and without Context: Behavioral Shifts and Downstream Impact

Hyunji Lee, David Seunghyun Yoon, Yunjae Won, Hanseok Oh, Geewook Kim, Trung Bui, Franck Dernoncourt, Elias Stengel-Eskin, Mohit Bansal, Minjoon Seo

UI Remix: Supporting UI Design Through Interactive Example Retrieval and Remixing

Junling Wang, Hongyi Lan, Xiaotian Su, Doga Dogan, Xiaotian Su

Understanding Generative AI Capabilities in Everyday Image Editing Tasks

Brandon Collins, Mohammad Reza Taesiri, Logan Bolton, Viet Lai, Franck Dernoncourt, Trung Bui, Anh Totti Nguyen

Vision Language Models Learn to Assess Images with Specialists

Quyet V. Do, David Seunghyun Yoon, Ruiyi Zhang, Thiloshon Nagarajah, Trung Bui, Viet Lai

RAMPA: Robotic Augmented Reality for Machine Programming by Demonstration

Fatih Dogangun, Serdar Bahar, Yigit Yildirim, Bora Toprak Temir, Emre Ugur, Doga Dogan

VipAct: Visual-Perception Enhancement via Specialized VLM Agent Collaboration and Tool-use

Zhehao Zhang, Ryan A. Rossi, Tong Yu, Franck Dernoncourt, Ruiyi Zhang, Jiuxiang Gu, Sungchul Kim, Xiang Chen, Zichao Wang, Nedim Lipka

MedRGB: Practical Framework for Benchmarking Medical Retrieval-Augmented Generation System

Nghia Trung Ngo, Chien Van Nguyen, Franck Dernoncourt, Thien Huu Nguyen

Agentic Design Review System

Sayan Nag, Joseph K J, Koustava Goswami, Vlad Morariu, Balaji Vasan Srinivasan

ChartEval: LLM-Driven Chart Generation Evaluation Using Scene Graph Parsing

Kanika Goswami, Puneet Mathur, Ryan A. Rossi, Franck Dernoncourt, Vivek Gupta, Dinesh Manocha

Personalized Graph-Based Retrieval for Large Language Models

Steven Au, Cameron Dimacali, Ojasmitha Pedirappagari, Namyong Park, Franck Dernoncourt, Yu Wang, Nikos Kanakaris, Hanieh Deilamsalehy, Ryan A. Rossi, Nesreen K. Ahmed

A Personalized Conversational Benchmark: Towards Simulating Personalized Conversations

Li Li, Peilin Cai, Ryan A. Rossi, Franck Dernoncourt, Branislav Kveton, Junda Wu, Tong Yu, Linxin Song, Tiankai Yang, Yuehan Qin, Nesreen K. Ahmed, Samyadeep Basu, Subhojyoti Mukherjee, Ruiyi Zhang, Zhengmian Hu, Bo Ni, Yuxiao Zhou, Zichao Wang, Yue Huang, Yu Wang, Xiangliang Zhang, Philip S. Yu, Xiyang Hu, Yue Zhao

Spotlight paper (top 5%)

Program Synthesis via Test-Time Transduction

Kang-il_Lee, Jahyun Koo, David Seunghyun Yoon, Minbeom Kim, Hyukhun Koh, Dongryeol Lee, Kyomin Jung

Offline RL by Reward-Weighted Fine-Tuning for Conversation Optimization

Subhojyoti Mukherjee, Viet Lai, Raghavendra Addanki, Ryan A. Rossi, David Seunghyun Yoon, Trung Bui, Anup Rao, Jayakumar Subramanian, Branislav Kveton

Follow the Flow: Fine-grained Flowchart Attribution with Neurosymbolic Agents

Manan Suri, Puneet Mathur, Nedim Lipka, Franck Dernoncourt, Ryan A. Rossi, Vivek Gupta, Dinesh Manocha

LaMP-Cap: Personalized Figure Caption Generation With Multimodal Figure Profiles

Ho Yin 'Sam' Ng, Ting-Yao Hsu, Aashish Anantha Ramakrishnan, Branislav Kveton, Nedim Lipka, Franck Dernoncourt, Dongwon Lee, Tong Yu, Sungchul Kim, Ryan A. Rossi, Ting-Hao 'Kenneth' Huang

FaithUn: Toward Faithful Forgetting in Language Models by Investigating the Interconnectedness of Knowledge

Nakyeong Yang, Minsung Kim, David Seunghyun Yoon, Joongbo Shin, Kyomin Jung

Calibrating MLLM-as-a-judge via Multimodal Bayesian Prompt Ensembles

Eric Slyman, Mehrab Tanjim, Kushal Kafle, Stefan Lee

Improving Large Vision and Language Models by Learning from a Panel of Peers

Jefferson Hernandez, Jing Shi, Simon Jenni, Vicente Ordonez, Kushal Kafle

DynaSaur: Large Language Agents Beyond Predefined Actions

Dang Nguyen, Viet Dac Lai, David Seunghyun Yoon, Ryan A. Rossi, Handong Zhao, Ruiyi Zhang, Puneet Mathur, Nedim Lipka, Yu Wang, Trung Bui, Franck Dernoncourt, Tianyi Zhou

PosterMate: Audience-driven Collaborative Persona Agents for Poster Design

Gromit Yeuk-Yin Chan, Daniel Lee, Gary Hsieh, Donghoon Shin

Survey on User Interface Design and Interactions for Generative AI Applications

Reuben Luera, Ryan A. Rossi, Alexa Siu, Franck Dernoncourt, Tong Yu, Sungchul Kim, Ruiyi Zhang, Xiang Chen, Hanieh Salehy, Nedim Lipka, Samyadeep Basu, Puneet Mathur, Jian Zhao

Programmable Reality

Ryo Suzuki, Parastoo Abtahi, Chen Zhu-Tian, Doga Dogan, Andrea Colaco, Eric J. Gonzalez, Karan Ahuja, Mar Gonzalez-Franco

EditDuet: A Multi-Agent System for Video Non-Linear Editing

Marcelo Sandoval-Castañeda, Bryan Russell, Josef Sivic, Gregory Shakhnarovich, Fabian Caba Heilbron

VISIAR: Empower MLLM for Visual Story Ideation

zhaoyang xia, Somdeb Sarkhel, Mehrab Tanjim, Stefano Petrangeli, Ishita Dasgupta, Saayan Mitra

Click, Type, Repeat: A Comprehensive Survey on GUI Agents

Dang Nguyen, Jian Chen, Yu Wang, Gang Wu, Namyong Park, Zhengmian Hu, Hanjia Lyu, Junda Wu, Ryan Aponte, Yu Xia, Xintong Li, Jing Shi, Hongjie Chen, Viet Lai, Zhouhang Xie, Sungchul Kim, Ruiyi Zhang, Tong Yu, Mehrab Tanjim, Nesreen K. Ahmed, Puneet Mathur, David Seunghyun Yoon, Lina Yao, Branislav Kveton, Jihyung Kil, Thien Huu Nguyen, Trung Bui, Tianyi Zhou, Ryan A. Rossi, Franck Dernoncourt

SlimLM: An Efficient Small Language Model for On-Device Document Assistance

Thang M. Pham, Phat T. Nguyen, David Seunghyun Yoon, Viet Lai, Franck Dernoncourt, Trung Bui

NoLiMa: Long-Context Evaluation Beyond Literal Matching

Ali Modarressi, Hanieh Deilamsalehy, Franck Dernoncourt, Trung Bui, Ryan A. Rossi, David Seunghyun Yoon, Hinrich Schütze

ImprovMate: Multimodal AI Assistant for Improv Actor Training

Riccardo Drago, Yotam Sechayk, Doga Dogan, Andrea Sanna, Takeo Igarashi

SmartEdit: Editing-driven Engagement Prediction and Enhancement of Short-Videos

saumya gupta, Ishita Dasgupta, Stefano Petrangeli, Somdeb Sarkhel

Personalization of Large Language Models: A Survey

Zhehao Zhang, Ryan A. Rossi, Branislav Kveton, Yijia Shao, Diyi Yang, Hamed Zamani, Franck Dernoncourt, Joe Barrow, Tong Yu, Sungchul Kim, Ruiyi Zhang, Jiuxiang Gu, Tyler Derr, Hongjie Chen, Junda Wu, Xiang Chen, Zichao Wang, Subrata Mitra, Nedim Lipka, Nesreen K. Ahmed, Yu Wang

The Photographer’s Eye: Teaching Multimodal Large Language Models to See, and Critique Like Photographers

Daiqing Qi, Handong Zhao, Jing Shi, Simon Jenni, Yifei Fan, Franck Dernoncourt, Scott Cohen, Sheng Li

Disambiguation in Conversational Question Answering in the Era of LLM: A Survey

Mehrab Tanjim, Yeonjun In, Xiang Chen, Victor S. Bursztyn, Ryan A. Rossi, Sungchul Kim, Guang-Jie Ren, Vaishnavi Muppala, Shun Jiang, Yongsung Kim, Chanyoung Park

Personalizing Data Delivery: Investigating User Characteristics and Enhancing LLM Predictions

Reuben Luera, Ryan A. Rossi, Franck Dernoncourt, Alexa Siu, Sungchul Kim, Tong Yu, Ruiyi Zhang, Xiang Chen, Nedim Lipka, Zhehao Zhang, Seon Gyeom Kim, Tak Yeon Lee

MoDS: Moderating a Mixture of Document Speakers to Summarize Debatable Queries in Document Collections

Nishant Balepur, Alexa Siu, Nedim Lipka, Franck Dernoncourt, Tong Sun, Jordan Lee Boyd-Graber, Puneet Mathur

VisDoM: Multi-Document QA with Visually Rich Elements Using Multimodal Retrieval-Augmented Generation

Manan Suri, Puneet Mathur, Franck Dernoncourt, Kanika Goswami, Ryan A. Rossi, Dinesh Manocha

CORG: Generating Answers from Complex, Interrelated Contexts

Hyunji Lee, Franck Dernoncourt, Trung Bui, David Seunghyun Yoon

Generating Diverse Hypotheses for Inductive Reasoning

Kang-il Lee, Hyukhun Koh, Dongryeol Lee, David Seunghyun Yoon, Minsung Kim, Kyomin Jung

VideoDiff: Human-AI Video Co-Creation with Alternatives

Mina Huh, Dingzeyu Li, Kim Pimmel, Hijung Valentina Shin, Amy Pavel, Mira Dontcheva

AI & Machine Learning Computer Vision, Imaging & Video Human Computer Interaction

ChartCitor: Answer Citations for ChartQA via Multi-Agent LLM Retrieval and Ranking

Kanika Goswami, Puneet Mathur, Ryan A. Rossi, Franck Dernoncourt

PlotGen: Multi-Agent LLM-based Scientific Data Visualization via Multimodal Feedback

Kanika Goswami, Puneet Mathur, Ryan A. Rossi, Franck Dernoncourt

DepthScape: Authoring 2.5D Designs with Depth Estimation

Cuong Nguyen, Yu Shen, Stefano Petrangeli, Matheus Gadelha

OCEAN: Offline Chain-of-thought Evaluation and Alignment in Large Language Models

Junda Wu, Xintong Li, Ruoyu Wang, Yu Xia, Yuxin Xiong, Jianing Wang, Tong Yu, Xiang Chen, Branislav Kveton, Lina Yao, Jingbo Shang, Julian McAuley

ECLAIR: Enhanced Clarification for Interactive Responses

John Murzaku, Zifan Liu, Mehrab Tanjim, Vaishnavi Muppala, Xiang Chen, Yunyao Li

PlotEdit: Natural Language-Driven Accessible Chart Editing in PDFs via Multimodal LLM Agents

Kanika Goswami, Puneet Mathur, Ryan A. Rossi, Franck Dernoncourt

Status quo bias and poaching avoidance in selecting strategic alliance partners

Mark Ratchford, Dipankar Chakravarti, Atanu R Sinha

VideoMix: Aggregating How-To Videos for Task-Oriented Learning

Saelyne Yang, Anh Truong, Juho Kim, Dingzeyu Li

AI & Machine Learning Content Intelligence Human Computer Interaction

Guidance Source Matters: How Guidance from AI, Expert, or a Group of Analysts Impacts Visual Data Preparation and Analysis

Arpit Narechania, Alex Endert, Atanu R Sinha

Token-level adversarial prompt detection based on perplexity measures and contextual information

Zhengmian Hu, Gang Wu, Saayan Mitra, Ruiyi Zhang, Tong Sun, Heng Huang, Vishy Swaminathan

Domain-specific Question Answering with Hybrid Search

Dewang Sultania, Zhaoyu Lu, Twisha Naik, Franck Dernoncourt, David Seunghyun Yoon, Sanat Sharma, Trung Bui, Ashok Gupta, Tushar Vatsa, Suhas Suresha, Ishita Verma, Vibha Belavadi, Cheng Chen, Michael Friedrich

Exploring Rewriting Approaches for Different Conversational Tasks

Md Mehrab Tanjim, Ryan A. Rossi, Mike Rimer, Xiang Chen, Sungchul Kim, Vaishnavi Muppala, Tong Yu, Zhengmian Hu, Ritwik Sinha, Wei Zhang, Iftikhar Ahamath Burhanuddin, Franck Dernoncourt

Detecting Ambiguities to Guide Query Rewrite for Robust Conversations in Enterprise AI Assistants

Mehrab Tanjim, Xiang Chen, Victor S. Bursztyn, Uttaran Bhattacharya, Tung Mai, Vaishnavi Muppala, Akash Maharaj, Saayan Mitra, Eunyee Koh, Yunyao Li, Ken Russell

Augment before You Try: Knowledge-Enhanced Table Question Answering via Table Expansion

Yujian Liu, Jiabao Ji, Tong Yu, Ryan A. Rossi, Sungchul Kim, Handong Zhao, Ritwik Sinha, Yang Zhang, Shiyu Chang

GUI-Bee: Align GUI Action Grounding to Novel Environments via Autonomous Exploration

Yue Fan, Handong Zhao, Ruiyi Zhang, Yu Shen, Xin Eric Wang, Gang Wu

AI & Machine Learning Intelligent Agents & Assistants Natural Language Processing

Federated Retrieval Augmented Generation for Multi-Product Question Answering

Parshin Shojaee, Sai Sree Harsha, Dan Luo, Akash Maharaj, Tong Yu, Yunyao Li

Copiloting Creative 3D Scene Modeling and Visualization with Generative Agents

Stefano Petrangeli, Yu Shen, Gang Wu, Matheus Gadelha, Cuong Nguyen, Petrangeli

Calibrating Reasoning in Language Models with Internal Consistency

Zhihui Xie, Jizhou Guo, Tong Yu, Shuai Li

PDFTriage: Question Answering over Long, Structured Documents

Jon Saad-Falcon, Joe Barrow, Alexa Siu, Ani Nenkova, David Seunghyun Yoon, Ryan A. Rossi, Franck Dernoncourt

ULLME: A Unified Framework for Large Language Model Embeddings with Generation-Augmented Learning

Hieu Man, Nghia Trung Ngo, Franck Dernoncourt, Thien Huu Nguyen

CodeLutra: Boosting LLM Code Generation via Preference-Guided Refinement

Leitian Tao, Xiang Chen, Tong Yu, Tung Mai, Ryan A. Rossi, Yixuan Li, Saayan Mitra

Matsa: Multi-agent table structure attribution

Puneet Mathur, Alexa Siu, Nedim Lipka, Tong Sun

Fake or Compromised? Making Sense of Malicious Clients in Federated Learning

Hamid Mozaffari, Sunav Choudhary, Amir Houmansadr

AutoDAN: interpretable gradient-based adversarial attacks on large language models

Sicheng Zhu, Ruiyi Zhang, Bang An, Gang Wu, Joe Barrow, Zichao Wang, Furong Huang, Ani Nenkova, Tong Sun

DocPilot: Copilot for automating PDF edit workflows in documents

Puneet Mathur, Alexa Siu, Varun Manjunatha, Tong Sun

ScaleViz: Scaling Visualization Recommendation Models on Large Data

Ghazi Shazan Ahmad, Shubham Agarwal, Subrata Mitra, Ryan A. Rossi, Manav Doshi, Syam Manoj Kumar Paila

Large Content And Behavior Models To Understand, Simulate, And Optimize Content And Behavior

Ashmit Khandelwal, Aditya Agrawal, Aanisha Bhattacharyya, Yaman K Singla, Somesh Singh, Uttaran Bhattacharya, Ishita Dasgupta, Stefano Petrangeli, Rajiv Ratn Shah, Changyou Chen, Balaji Krishnamurthy

ToolChain*: Efficient Action Space Navigation in Large Language Models with A* Search

Yuchen Zhuang, Xiang Chen, Tong Yu, Saayan Mitra, Victor S. Bursztyn, Ryan A. Rossi, Somdeb Sarkhel, Chao Zhang

PersonaSAGE: A Multi-Persona Graph Neural Network

Gautam Choudhary, Iftikhar Ahamath Burhanuddin, Eunyee Koh, Fan Du, Ryan A. Rossi

InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding

Junda Wu, Tong Yu, Rui Wang, Zhao Song, Ruiyi Zhang, Handong Zhao, Chaochao Lu, Shuai Li, Ricardo Henao

VaQuitA: Enhancing alignment in llm-assisted video understanding

Yizhou Wang, Ruiyi Zhang, Haoliang Wang, Uttaran Bhattacharya, Yun Fu, Gang Wu

TaleStream: Supporting Story Ideation with Trope Knowledge

Jean-Peïc Chou, Maneesh Agrawala, Alexa Siu, Nedim Lipka, Ryan A. Rossi, Franck Dernoncourt

Augmenting Visualizations with Predictive and Investigative Insights to Facilitate Decision Making

Md Main Uddin Rony, Fan Du, Ryan A. Rossi, Jane Hoffswell, Niyati Chhaya, Iftikhar Ahamath Burhanuddin, Eunyee Koh

Personalized Detection of Cognitive Biases in Actions of Users from Their Logs: Anchoring and Recency Biases

Atanu R Sinha, Navita Goyal, Sunny Dhamnani, Tanay Asija, Raja K Dubey, M V Kaarthik Raja, Georgios Theocharous

Paint2Pix: Interactive Painting based Progressive Image Synthesis and Editing

Jaskirat Singh, Liang Zheng, Cameron Smith, Jose Echevarria

AI & Machine Learning Computer Vision, Imaging & Video Graphics (2D & 3D)

Intelli-Paint: Towards Developing More Human-Intelligible Painting Agents

Jaskirat Singh, Cameron Smith, Jose Echevarria, Liang Zheng

Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-Supervision

Khalil Mrini, Harpreet Singh, Franck Dernoncourt, David Seunghyun Yoon, Trung Bui, Walter W. Chang, Emilia Farcas, Ndapa Nakashole

CAISE: Conversational Agent for Image Search and Editing

Hyounghun Kim, Doo Soon Kim, David Seunghyun Yoon, Franck Dernoncourt, Trung Bui, Mohit Bansal

A Framework for Knowledge-Derived Query Suggestions

Saed Rezayi, Nedim Lipka, Vishwa Vinay, Ryan A. Rossi, Franck Dernoncourt, Tracy King, Sheng Li

Gaudí: Conversational Interactions with Deep Representations to Generate Image Collections

Victor S. Bursztyn, Jennifer Healey, Vishwa Vinay

Firm dynamics and employee performance management in duopoly markets

Prateksha Udhayanan, Swasti Shreya Mishra

IGA: An Intent-Guided Authoring Assistant

Simeng Sun, Wenlong Zhao, Varun Manjunatha, Rajiv Jain, Vlad Morariu, Franck Dernoncourt, Balaji Vasan Srinivasan, Mohit Iyyer

A Gradually Soft Multi-Task and Data-Augmented Approach to Medical Question Understanding

Khalil Mrini, Franck Dernoncourt, David Seunghyun Yoon, Trung Bui, Walter Chang, Emilia Farcas, Ndapa Nakashole

PSED: A Dataset for Selecting Emphasis in Presentation Slides

Amirreza Shirani, Giai Tran, Hieu Trinh, Franck Dernoncourt, Nedim Lipka, Jose Echevarria, Thamar Solorio, Paul Asente

X-METRA-ADA: Cross-lingual Meta-Transfer learning Adaptation to Natural Language Understanding and Question Answering

Meryem M'hamdi, Doo Soon Kim, Franck Dernoncourt, Trung Bui, Xiang Ren, Jonathan May

KPQA: A Metric for Generative Question Answering Using Keyphrase Weights

Hwanhee Lee, David Seunghyun Yoon, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Joongbo Shin, Kyomin Jung

Joint Summarization-Entailment Optimization for Consumer Health Question Understanding

Khalil Mrini, Franck Dernoncourt, Walter Chang, Emilia Farcas, Ndapa Nakashole

Best Student Paper Award

Mitigating the Effects of Reading Interruptions by Providing Reviews and Previews

Namrata Srivastava, Rajiv Jain, Jennifer Healey, Zoya Bylinskii, Tilman Dingler

Explain by Evidence: An Explainable Memory-based Neural Network for Question Answering

Quan Hung Tran, Nhan Dam, Tuan Lai, Franck Dernoncourt, Trung Le, Nham Le, Dinh Phung

Variational Hierarchical Dialog Autoencoder for Dialog State Tracking Data Augmentation

Kang Min Yoo, Hanbit Lee, Franck Dernoncourt, Trung Bui, Walter Chang, Sang-goo Lee

Scene Graph Modification Based on Natural Language Commands

Xuanli He, Quan Hung Tran, Gholamreza Haffari, Walter Chang, Zhe Lin, Trung Bui, Franck Dernoncourt, Nhan Dam

Conversational Error Analysis in Human-Agent Interaction

Deepali Aneja, Daniel McDuff, Mary Czerwinski

Goal-driven Command Recommendations for Analysts

Samarth Aggarwal, Rohin Garg, Abhilasha Sancheti, Bhanu Prakash Reddy Guda, Iftikhar Ahamath Burhanuddin

Efficient Deployment of Conversational Natural Language Interfaces over Databases

Anthony Colas, Trung Bui, Franck Dernoncourt, Moumita Sinha, Doo Soon Kim

Improving Slot Filling by Utilizing Contextual Information

Amir Pouran Ben Veyseh, Franck Dernoncourt, Thien Huu Nguyen

Visual Dialog: Do we really need it?

Shubham Agarwal, Trung Bui, Joon-Young Lee, Ioannis Konstas, Verena Rieser

Adaptive Photographic Composition Guidance

Jane L. E, Ohad Fried, Jingwan (Cynthia) Lu, Jianming Zhang, Radomír Měch, Jose Echevarria, Pat Hanrahan, James A. Landay

A High Fidelity Open Embodied Avatar with LipSyncing and Expression Capabilities

Deepali Aneja, Daniel McDuff, Shital Shah

Cascading Linear Submodular Bandits: Accounting for Position Bias and Diversity in Online Learning to Rank

Gaurush Hiranandani, Harvineet Singh, Prakhar Gupta, Iftikhar Ahamath Burhanuddin, Zheng Wen, Branislav Kveton

An End-to-End Conversational Style Matching Agent

Rens Hoegen, Deepali Aneja, Daniel McDuff, Mary Czerwinski

Best Paper Nominee

Fast User-Guided Video Object Segmentation by Interaction-and-Propagation Networks

Seoung Wug Oh, Joon-Young Lee, Ning Xu, Seon Joo Kim

Stuck? No worries!: Task-aware Command Recommendation and Proactive Help for Analysts

Aadhavan M. Nambhi, Bhanu Prakash Reddy Guda, Aarsh Prakash Agarwal, Gaurav Verma, Harvineet Singh, Iftikhar Ahamath Burhanuddin

Mentor Pattern Identification from Product Usage Logs

Ankur Garg, Aman Kharb, Yash H. Malviya, J. P. Sagar, Atanu R Sinha, Iftikhar Ahamath Burhanuddin, Sunav Choudhary

Supervised Transfer Learning for Product Information Question Answering

Tuan Manh Lai, Trung Bui, Nedim Lipka, Sheng Li

A Multimodal Dialogue System for Conversational Image Editing

Tzu-Hsiang Lin, Trung Bui, Doo Soon Kim, Jean Oh

A Review on Deep Learning Techniques Applied to Answer Selection

Tuan Manh Lai, Trung Bui, Sheng Li

Conversational Image Editing: Incremental Intent Identification in a New Dialogue Task

Ramesh Manuvinakurike, Trung Bui, Walter Chang, Kallirroi Georgila

Best Paper Award

The Context-dependent Additive Recurrent Neural Net

Quan Hung Tran, Tuan Manh Lai, Gholamreza Haffari, Ingrid Zukerman, Trung Bui, Hung Bui

Spoken Language Understanding for DSTC 4

Franck Dernoncourt, J. Lee, Trung Bui, H. Bui

Robust Dialog State Tracking for Large Ontologies

Franck Dernoncourt, J. Lee, Trung Bui, H. Bui

Designing an intelligent dialogue system for serious games

Franck Dernoncourt

Affective Dialogue Management Using Factored POMDPs

Trung Bui, J. Zwiers, M. Poel, A. Nijholt

Extracting Decisions from multi-party Dialog using Directed Graphical Models and Semantic Similarity

Trung Bui, M. Frampton, J. Dowding, S. Peters

Real-time Decision Detection in Multi-party Dialogue

M. Frampton, J. Huang, Trung Bui, S. Peters

A Tractable Hybrid DDN-POMDP Approach to Affective Dialogue Modeling for Probabilistic Frame-based Dialogue Systems

Trung Bui, M. Poel, A. Nijholt, J. Zwiers

Practical Dialogue Manager Development using POMDPs

Trung Bui, B. van Schooten, D. Hofs

Generic Dialogue Modeling for Multi-application Dialogue Systems

Trung Bui, J. Zwiers, A. Nijholt, M. Poel

Rapid Dialogue Prototyping Methodology

Trung Bui, M. Rajman, M. Melichar