Publications

* denotes equal contribution (co-first author). Also on Google Scholar.

Preprints & Under Review

RELATE pipeline: source situations, interactive dialogue environment, and sentence-level evaluation
RELATE: An Evaluation Framework for Measuring Relational Orientation of Large Language Models Shivam Shukla*, Jihye Kim*, Shubham Gaur*, Mahnaz Roshanaei, Magy Seif El-Nasr
Under review at ICLR 2027 · 2026
Human-Centered AI Alignment & Safety Evaluation

Across 1,596 dialogues and seven LLMs, supportive models drift inward: the share of sentences positioning the AI as the user's ongoing source of support is higher at the sixth assistant turn than the first, while language encouraging real-world human connection is substantially lower for hesitant, indirect users than for explicit, reassurance-seeking ones.

BenchShield: two reward-hacking case studies with agent authority and trusted reward paths
BenchShield: Formal Model-Backed Instrumentation for Reward Integrity in LLM-Agent Evaluation Infrastructure S. Zheng, Z. Di, Y. Liu, …, Shubham Gaur, Z. Ye, H. Wang, X. Li, D. Song, C. Hauser
Preprint · 2026
Agent Evaluation Alignment & Safety

Grounding reward-hack detection in a formal lifecycle model of an evaluation lifts full-chain recall from 23–94% to 77–100% and cuts per-task cost by up to 65%; runtime analysis reaches 96% accuracy from infrastructure-side evidence alone. Built on a corpus of 456 human-adjudicated trajectories drawn from 31,000+ public agent runs.

MAAT: three-phase unlearning framework over LoRA adapter weights
MAAT: Multi-phase Adapter-Aware Targeted Unlearning Suryash Yagnik, Shubham Gaur, Saksham Thakur, Vinija Jain, Aman Chadha, Amitava Das
Preprint · 2026
Post-Training Unlearning

Why-type causal questions make up under 1.3% of standard unlearning benchmarks, so a method that fails on causal knowledge can still score well in aggregate. 5WBench (5,000 samples, balanced across Who/What/When/Where/Why) makes that failure measurable, and MAAT is the first method to reach high forgetting and high retention on Why-type knowledge simultaneously.

Peer-Reviewed

Signal-Driven Observation architecture: root LM, browser, signal detector and sub-RLM
Signal-Driven Observation for Long-Horizon Web Agents Shubham Gaur, Ian Lane
ICML 2026 Workshop on Failure Modes in Agentic AI (FAGEN), position paper · First author
LLM Agents

Long-horizon web agents re-ingest tens of thousands of DOM tokens at every action step, eroding reasoning before the task completes. Decoupling observation from action — a sub-call that returns only task-relevant elements, re-invoked only when a URL change, a newly visible element, or an action failure fires — makes observation compression an architectural decision rather than a prompting one.

FAULTLOC: Evaluating AI Coding Agents for Fault Localization from Crash to Cause J. Tu, Shubham Gaur, R. Murtinty, Z. Wang, T. Shi, D. Song, C. Wang
ICML 2026 AIWILD Workshop: Safety, Security, and Beyond
Agent Evaluation

A 900-CVE benchmark tracing a crash back to its root cause, with ablations across frontier models: coding agents recover the true root cause in only 40% of cases.

SkillOptimizer: Agent Skill Optimization Through Subskills Without Task Supervision N. Crispino, Shubham Gaur, X. Yang, A. Yu, B. Ercevik, C. Sapugay, Y. Potter, D. Song, C. Wang
ICML 2026 AIWILD Workshop: Safety, Security, and Beyond
LLM Agents Post-Training

Improves an agent's skills with no task supervision by decomposing each skill into a subskill DAG and optimizing for coverage, raising task pass rates across 192 skills and three agent families.

Image ranking for an idiomatic phrase: literal, idiomatic and distractor candidates
UCSC NLP T6 at SemEval-2025 Task 1: Leveraging LLMs and VLMs for Idiomatic Understanding Judith Clymo, Adam Zernik, Shubham Gaur
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pp. 2103–2115, ACL
Vision-Language

Pretrained vision-language models carry a strong literal bias on idiomatic phrases. Prompting GPT-4 to state the idiom's meaning before ranking candidate images lifts Top-1 accuracy from 43% to 87%.

Advancing Web-Based Visual Question Answering with Efficient Image-Text Alignment Saketh Kilaru, Shubham Gaur, Spandan Rout
Recent Advancements in Artificial Intelligence: Proceedings of ICRAAI 2023, pp. 343–359, Springer
Vision-Language

A lighter, detector-free distilled pipeline beats the WebQA vision-language pre-training baseline on both single-source (54.91% vs 51.49%) and multi-source (30.11% vs 28.73%) questions.

Earlier Work

Pipeline: a retroreflective wand tip seen by a night-vision camera, accumulated frame by frame with OpenCV, classified by an SVM, driving a GPIO action
Extraction of Cumulative Blobs from Dynamic Gestures Rishabh Naulakha, Shubham Gaur, Dhairya Lodha, Mehek Tulsyan, Utsav Kotecha
International Journal of Scientific Research (IJSR), 10(9), 2021
Computer Vision

Gesture recognition breaks down in low light because it depends on an ordinary camera. Pairing a night-vision camera with a Raspberry Pi and OpenCV recovers dynamic gesture tracking in the dark at 99.62% accuracy.

Posters

What Web Agents Need Isn't Data — It's High Quality Data
Capstone Presentation, UC Santa Cruz, 2025
Advancing Web-Based Visual Question Answering with Efficient Image-Text Alignment
SciML Symposium, Georgia Tech, 2024