Skip to content
View vinayvobbili's full-sized avatar

Block or report vinayvobbili

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
vinayvobbili/README.md

Vinay Vobbilichetty

Principal AI Automation Engineer | MS CS, Cybersecurity (NC State '25) | B.Tech CE, IIT Kharagpur

I build LLM agents for security work that can only report what they can prove. The model proposes, and plain code checks each claim against the tool output it cites before anyone sees it. The rest of my work sits around that idea: investigation agents, RAG, MCP servers, evals, and self-hosted inference with failover across hosts.


Start here

  • witness: a DFIR agent that can only report what it can prove a tool said. A finding is admitted only when a deterministic check re-reads the cited tool output and confirms the field, with no second language model in the gate. Scored on 1,083 claims and 119 crafted attacks. Clone it and run python demo.py: no install, no API key, standard library only.
  • hubtriage: the same gate on AWS Security Hub findings. A benign verdict has to rest entirely on evidence, and the IAM policy denies the agent the power to close a finding. Validated offline and in CI; not deployed yet.
  • shortlist-ai: blind, evidence-cited resume shortlisting, where every quote is checked by code and the score is computed in code, with ranking evals and counterfactual bias tests.

Merged upstream

vllm-mlx is the Apple Silicon LLM server (OpenAI-compatible) that many self-hosted Claude Code and OpenCode setups run behind.

  • The bottleneck: every follow-up turn re-prefilled the same ~23K-token system and tools prefix. A KV cache existed, but only on the multimodal path.
  • The fix: extend the same hash-keyed snapshot logic to the pure-LLM path, falling back to the uncached path for anything unexpected.
  • Impact: ~100s to ~7s on follow-up turns. Same model, same prompts, identical outputs.

More tools

  • refutescan: a code vulnerability scanner where one LLM hunts, a second tries to refute each finding, and every scan runs in a no-network Docker sandbox.
  • jobwatch: watches company job boards and ranks new roles by fit, with a local UI and an MCP server. 1,650 tests.
  • langchain-failover: failover and cheap-then-frontier tier-splitting for LangChain chat models, with tool-calling preserved.

Writing

More at vinayvobbili.github.io.


Tech Stack

AI/ML: LangChain · LangGraph · Model Context Protocol (MCP) · RAG · ChromaDB · cross-encoder rerankers · mlx-lm on Apple Silicon

Backend & Infra: Python · Flask · FastAPI · Docker · systemd · Nginx · GitHub Actions · GitLab CI/CD

Security: CrowdStrike Falcon · Cortex XSOAR/XSIAM · Tanium · IBM QRadar · ServiceNow · Recorded Future · AttackIQ · Veracode

Standards: MITRE ATT&CK · Sigma · STIX/TAXII · MISP · EPSS · CISA KEV


Connect

LinkedIn Blog

Pinned Loading

  1. langchain-failover langchain-failover Public

    Primary/secondary failover wrapper for LangChain chat models, with tool-calling preserved across failover.

    Python

  2. witness witness Public

    A DFIR agent that can only report what it can prove a tool said.

    Python

  3. hubtriage hubtriage Public

    Triage AWS Security Hub findings with an LLM that can only say what the AWS APIs said.

    Python

  4. jobwatch jobwatch Public

    Watch company job boards (Greenhouse, Lever, Ashby, Workable, Workday, Eightfold, Rippling), get a ranked digest of new matches, track every application, and use it from Claude via MCP. Never auto-…

    Python

  5. refutescan refutescan Public

    A two-LLM, refute-first agentic source-code vulnerability scanner — wide-net navigate, skeptical refute, jailed in docker. Bring your own LLM.

    Python

  6. shortlist-ai shortlist-ai Public

    Evidence-backed, blind resume shortlisting with LLMs, plus the evals and bias tests to check it.

    Python