I run empirical experiments on how LLM agents behave when they're being monitored. Right now that means collusion, covert coordination and cover-up in multi-agent systems. By day I'm a Senior ML Engineer at Leena AI, building LLM and RAG pipelines in production. Before that I spent 4+ years on large distributed systems. I bring that engineering habit to evals: pre-register first, run positive controls, put a confidence interval on every number.
Interests: multi-agent safety · AI control & monitoring · dangerous-capability and propensity evals · RL environments for agents
Whisper, Don't Erase: How Colluding Agents Choose Channels and React to Being Watched Apart Research AI Collusion Sprint, Oct 2026 · built on Colosseum
Tool-using LLM agents on a shared task, some secretly in coalitions, with public and private message boards and a monitor that reviews them. ~18 pre-registered arms across gpt-oss, DeepSeek, Qwen3 and GLM.
- Agents cover their tracks when it pays. When a monitor is revealed late, gpt-oss agents delete their own incriminating posts: +2.0 erasures per episode [1.17, 2.83]. The effect replicates on GLM (+2.8 [2.0, 3.6]).
- The trigger is the consequence, not the observer. Erasure follows the stated penalty rule. Telling agents only that "a monitor will read the board" changes nothing.
- A transparent monitor goes blind. When agents are told exactly what gets flagged, public coalition talk drops from 3.7 to 0.04 per episode. The coordination moves to private channels instead of stopping.
- Method. Every arm has a pre-registration and a positive control, uses episode-level bootstrap CIs, and has its automated labels checked against hand labels (κ = 0.88). The negative results are reported too.
| Project | What it is |
|---|---|
| open-recruiter (code release pending) | An OpenEnv RL environment where an LLM screens candidates while adversarial fake profiles try to get shortlisted. Trained with GRPO. I later audited and patched reward-hacking exploits in it, e.g. a one-ID ranking that scored a perfect 5.0. |
| reddit-mod-env | An OpenEnv RL environment for content moderation on r/science, with three tiers of increasing difficulty (spam → rule violations → context-aware escalation). |
- Senior ML Engineer, Leena AI (Dec 2025–present): scaling LLM / RAG-based NLP pipelines to the next million users
- Senior Software Engineer, Barco (Jul 2021–Dec 2025): built agentic workflows for control-room operators, and event-streaming backends handling 2B+ events/hour with real-time alerting for 200K+ IoT devices
- Summer Intern, Samsung Electronics (summer 2020): deep learning for image resolution scaling
- B.Tech, Electrical Engineering, IIT Delhi (2017–2021)
- Safety research: independent, alongside my day job (Apart Research sprints)
