Skip to content

Benchmark AI-written AI development code: evaluate quality and safety of the RSI execution layer #20

Description

@nv78

Connection to Recursive Self-Improvement

Anthropic's June 2026 article reports that Claude now writes 80%+ of Anthropic's own production code. This is RSI in its most concrete, deployed form: an AI writing the code that trains and deploys future versions of itself.

CodeBench is the right tool to evaluate whether AI-written AI code is actually safe and correct — not just functional. Specifically: as AI writes more of its own training infrastructure, evaluation harnesses, and data pipelines, are there systematic quality and security degradation patterns that CodeBench can detect?

Research Question

Do AI-written code artifacts in the AI development pipeline (training scripts, evaluation harnesses, data pipelines) exhibit different security and specification compliance patterns than AI-written application code?

This is a novel framing: CodeBench has evaluated AI-written application code, but not AI-written AI development code — the specific artifacts that close the RSI loop.

Proposed Experiments

Experiment 1: RSI Code Category Benchmark

Create a new CodeBench category: "AI infrastructure code." Tasks include:

  • Writing a training loop with correct gradient accumulation and DP noise injection
  • Writing an evaluation harness that correctly measures model performance without data leakage
  • Writing a data pipeline that preserves train/test splits
  • Writing a reward model training script that doesn't introduce specification gaming vulnerabilities

Evaluate: do current models write this code correctly? What are the failure modes?

Baseline: existing CodeBench functional correctness and security metrics on application code
Test: same metrics on AI infrastructure code tasks

Hypothesis: AI models systematically underperform on AI infrastructure code relative to application code, because AI infrastructure code requires understanding subtle invariants (e.g., no test-set contamination, correct DP accounting) that are underrepresented in training data.

Experiment 2: Self-Referential Code Generation

Ask models to write code that would evaluate themselves: "write an evaluation harness to measure your own instruction-following accuracy." Do models introduce subtle biases that favor their own outputs when generating self-evaluation code?

This is a direct RSI safety experiment: it tests whether AI systems are reliable self-evaluators, or whether they unconsciously game self-evaluation tasks.

Experiment 3: Cumulative Error Analysis

Simulate an RSI code generation loop: model writes code → code runs experiments → results used to generate the next version → next version writes code. Track whether code quality degrades, improves, or stays stable over 5 simulated RSI iterations.

Why This Matters

If AI-written AI development code has systematic flaws — especially in evaluation harnesses and training pipelines — those flaws compound across RSI iterations. A corrupted evaluation harness doesn't just affect one model; it affects every future model trained using that harness.

Link to ResearchLoop Integration

See research-orchestratebench#22 for the full architecture this fits into.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions