Skip to content
View TanishGudise's full-sized avatar

Block or report TanishGudise

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
TanishGudise/README.md

Tanish Gudise

CS + Business @ Carnegie Mellon '27 · RL environments, agent evals, and agent infrastructure

  • pipeline-reliability: a generator of 282 validated Harbor tasks in 56 problem families where agents fix reliability bugs in LLM data-pipeline code. Every task passes an automated QA gate (reference 1, unfixed 0, wrong/decoy/tamper fixes 0); the grader runs unprivileged in a separate container and writes the reward last.
  • claims-vs-reality: a pre-registered study comparing coding agents' final reports with an exact system-call record of what they ran. Rubric judges caught at most 1 of 3 misreport mechanisms; the exact record caught all of them.
  • fin-model-edits · filing-update-evals: exact-graded agent evals on real SEC filings and credit agreements, recalculated in LibreOffice with perturbed inputs; no LLM judge.
  • Merged reliability fixes in agent infrastructure: Cua, Daytona, Osmosis, Composio (co-author).
  • Airbnb, AI Infrastructure intern: built a conversational agent for an internal prompt-engineering platform, with RAG, a confirm-before-apply step, OpenTelemetry tracing across the inference pipeline and an eval harness. Full-time return offer.
  • Parameter Golf: 16MB language model trained on 8×H100s with 60+ tracked ablations; briefly topped the leaderboard. The score was flagged in a shared upstream train/val overlap issue, so I treat it as optimistic.
  • Also: Relay, a long-horizon agent with crash-safe MongoDB checkpoints (MongoDB NYC hackathon).

Go · Python · TypeScript · C/C++ · Docker · Harbor · PyTorch/CUDA · vLLM · gRPC · PostgreSQL

Open to full-time roles starting January 2027 · Website · LinkedIn · tgudise@andrew.cmu.edu

Pinned Loading

  1. parameter-golf-16mb parameter-golf-16mb Public

    16MB LM for OpenAI Parameter Golf — 1.05670 BPB, 8×H100

    Python

  2. filing-update-evals filing-update-evals Public

    Can an agent update a company's financial model from its latest 10-Q, exactly? 39 tasks graded by LibreOffice recalculation with perturbed inputs, from public SEC filings.

    Python

  3. claims-vs-reality claims-vs-reality Public

    Pre-registered eval: do AI agents misreport what they did? Exact ledger-based detectors vs LLM transcript judges.

    Python

  4. concurrency-bugs concurrency-bugs Public

    RL environment of real-world-style Python concurrency bugs with deterministic hidden-test graders (verifiers / Prime Environments Hub)

    Python

  5. fin-model-edits fin-model-edits Public

    RL environment: edit a three-statement + DCF spreadsheet model; graded exactly by recalculating in LibreOffice (no LLM judge). verifiers v1.

    Python

  6. pipeline-reliability pipeline-reliability Public

    A generator of 282 validated Harbor tasks for fixing reliability bugs in LLM data-pipeline code, with an automated QA gate

    Python