Soumy Sawant Β· Undergraduate AI Researcher Β· Manipal University Jaipur
I research AI evaluation, Information Retrieval, RAG, and reinforcement learning, with a focus on understanding when retrieval and LLM systems are actually reliable.
My recent research:
- π Metric-as-Feature Leakage: A Feature-Side Failure Mode in Retriever Routing
Accepted Poster β NewInML Workshop @ NeurIPS 2026 - π RouteLeak-Eval β a reproducible toolkit for auditing metric-derived leakage in retriever routing
- π§ͺ Researching retrieval evaluation, adaptive retrieval, and LLM/agent reliability
Currently building:
- π¬ RAG and retrieval evaluation systems
- π€ Agent architectures and evaluation harnesses
- π§ RL-based decision-making systems
- π¦Ύ AI architectures for humanoid robotics
Information Retrieval Β· RAG Β· AI/Agent Evaluation Β· LLM Reliability Β· Adaptive Retrieval Β· Retriever Routing Β· Reinforcement Learning Β· Agent Planning
- Retriever Routing & Evaluation β BM25 / Dense / Hybrid retrieval, routing, leakage auditing, benchmark design
- Efficient RAG β BM25, FAISS, RRF, local LLM inference, reproducible QA benchmarks
- Agent Evaluation β 80-case evaluation suite across multiple reasoning and planning tasks
- RL Systems β REINFORCE, PPO, A2C, DQN and related decision-making algorithms
Philosophy: If I can't implement it, I don't understand it.
I learn in public β documenting experiments, failures, and research insights.
