Skip to content

Add spec-guided RepairAgent extension with full analysis#22

Open
DinoZ-p wants to merge 1 commit into
sola-st:mainfrom
DinoZ-p:spec-guided
Open

Add spec-guided RepairAgent extension with full analysis#22
DinoZ-p wants to merge 1 commit into
sola-st:mainfrom
DinoZ-p:spec-guided

Conversation

@DinoZ-p

@DinoZ-p DinoZ-p commented May 21, 2026

Copy link
Copy Markdown

Pipeline additions:

  • spec_generator.py: Javadoc-driven spec generation via GPT-4o
  • spec_verifier.py: Second-pass spec quality verification
  • defects4j.py: Auto DELETE+INSERT for low-similarity modifications
  • base.py: Spec injection into agent prompt at init
  • prompt_settings.yaml: Anti-overfitting guideline

Research artifacts (researchAnalysis/):

  • 24 per-bug analyses of E34 plausible patches
  • Root cause taxonomy of 66 unfixed bugs with evidence
  • E39 detailed evaluation of 5 design improvements
  • Charts and presentation slides
  • Master report and mentor status report

Results on 98 bugs the original RepairAgent could not fix:

  • E17 (first spec design): 16 plausible, 7 correct
  • E34 (refined spec): 24 plausible, 13 correct
  • Union: 15 unique correct fixes

See HANDOFF.md for setup, current state, and experiment plan.

Pipeline additions:
- spec_generator.py: Javadoc-driven spec generation via GPT-4o
- spec_verifier.py: Second-pass spec quality verification
- defects4j.py: Auto DELETE+INSERT for low-similarity modifications
- base.py: Spec injection into agent prompt at init
- prompt_settings.yaml: Anti-overfitting guideline

Research artifacts (researchAnalysis/):
- 24 per-bug analyses of E34 plausible patches
- Root cause taxonomy of 66 unfixed bugs with evidence
- E39 detailed evaluation of 5 design improvements
- Charts and presentation slides
- Master report and mentor status report

Results on 98 bugs the original RepairAgent could not fix:
- E17 (first spec design): 16 plausible, 7 correct
- E34 (refined spec): 24 plausible, 13 correct
- Union: 15 unique correct fixes

See HANDOFF.md for setup, current state, and experiment plan.
@DinoZ-p

DinoZ-p commented May 21, 2026

Copy link
Copy Markdown
Author

1

4 similar comments
@DinoZ-p

DinoZ-p commented May 21, 2026

Copy link
Copy Markdown
Author

1

@DinoZ-p

DinoZ-p commented May 21, 2026

Copy link
Copy Markdown
Author

1

@DinoZ-p

DinoZ-p commented May 21, 2026

Copy link
Copy Markdown
Author

1

@DinoZ-p

DinoZ-p commented May 21, 2026

Copy link
Copy Markdown
Author

1

@islem-esi islem-esi self-assigned this May 21, 2026
@islem-esi islem-esi added the enhancement New feature or request label May 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants