Skip to content
View sdipanshu's full-sized avatar

Highlights

  • Pro

Block or report sdipanshu

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
sdipanshu/README.md

Hi, I'm Dipanshu 👋

I run empirical experiments on how LLM agents behave when they're being monitored. Right now that means collusion, covert coordination and cover-up in multi-agent systems. By day I'm a Senior ML Engineer at Leena AI, building LLM and RAG pipelines in production. Before that I spent 4+ years on large distributed systems. I bring that engineering habit to evals: pre-register first, run positive controls, put a confidence interval on every number.

Interests: multi-agent safety · AI control & monitoring · dangerous-capability and propensity evals · RL environments for agents


🔬 Research

Whisper, Don't Erase: How Colluding Agents Choose Channels and React to Being Watched Apart Research AI Collusion Sprint, Oct 2026 · built on Colosseum

Tool-using LLM agents on a shared task, some secretly in coalitions, with public and private message boards and a monitor that reviews them. ~18 pre-registered arms across gpt-oss, DeepSeek, Qwen3 and GLM.

  • Agents cover their tracks when it pays. When a monitor is revealed late, gpt-oss agents delete their own incriminating posts: +2.0 erasures per episode [1.17, 2.83]. The effect replicates on GLM (+2.8 [2.0, 3.6]).
  • The trigger is the consequence, not the observer. Erasure follows the stated penalty rule. Telling agents only that "a monitor will read the board" changes nothing.
  • A transparent monitor goes blind. When agents are told exactly what gets flagged, public coalition talk drops from 3.7 to 0.04 per episode. The coordination moves to private channels instead of stopping.
  • Method. Every arm has a pre-registration and a positive control, uses episode-level bootstrap CIs, and has its automated labels checked against hand labels (κ = 0.88). The negative results are reported too.

🛠️ Agent environments

Project What it is
open-recruiter (code release pending) An OpenEnv RL environment where an LLM screens candidates while adversarial fake profiles try to get shortlisted. Trained with GRPO. I later audited and patched reward-hacking exploits in it, e.g. a one-ID ranking that scored a perfect 5.0.
reddit-mod-env An OpenEnv RL environment for content moderation on r/science, with three tiers of increasing difficulty (spam → rule violations → context-aware escalation).

📚 Experience

  • Senior ML Engineer, Leena AI (Dec 2025–present): scaling LLM / RAG-based NLP pipelines to the next million users
  • Senior Software Engineer, Barco (Jul 2021–Dec 2025): built agentic workflows for control-room operators, and event-streaming backends handling 2B+ events/hour with real-time alerting for 200K+ IoT devices
  • Summer Intern, Samsung Electronics (summer 2020): deep learning for image resolution scaling
  • B.Tech, Electrical Engineering, IIT Delhi (2017–2021)
  • Safety research: independent, alongside my day job (Apart Research sprints)

📫 LinkedIn · X / Twitter · dipanshu.iitd@gmail.com

Popular repositories Loading

  1. Smart-System-Monitoring Smart-System-Monitoring Public

    Monitoring System for Dustbins

  2. sdipanshu.github.io sdipanshu.github.io Public

    COL362-Project 1

    HTML

  3. Keras-SRGAN Keras-SRGAN Public

    Forked from deepak112/Keras-SRGAN

    Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network implemented in Keras

    Python

  4. SRGAN-tensorflow SRGAN-tensorflow Public

    Forked from brade31919/SRGAN-tensorflow

    Tensorflow implementation of the SRGAN algorithm for single image super-resolution

    Python

  5. rustlings rustlings Public

    Forked from rust-lang/rustlings

    🦀 Small exercises to get you used to reading and writing Rust code!

    Rust

  6. coding-interview-prep coding-interview-prep Public

    Forked from jwasham/coding-interview-university

    A complete computer science study plan to become a software engineer.