Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
0467f3d
[feat] assign every seed dimension in code, from a population distrib…
Thibaut-Fatus Sep 30, 2026
9636a83
[fix] drop `research` from the seed `use` dimension
Thibaut-Fatus Oct 1, 2026
e4489c0
[feat] update seeds + us census 2020 -> 2023
Thibaut-Fatus Oct 1, 2026
0a72796
[feat] default to 75 seeds per risk
Thibaut-Fatus Oct 1, 2026
d962a31
[feat] situation types, motivation × use pairing and private seed split
Thibaut-Fatus Oct 1, 2026
2107b4b
[feat] motivation × use mask and public floor in the private split
Thibaut-Fatus Oct 2, 2026
6fe2fb1
[feat] situation definitions in prompts, balanced private split, us-c…
Thibaut-Fatus Oct 2, 2026
794a5f5
[feat] gold-standard risk definitions, child-only seeds, seed dimensi…
Thibaut-Fatus Oct 5, 2026
1481b33
[feat] define the "other" race/ethnicity group in expansion, seed-rec…
Thibaut-Fatus Oct 5, 2026
034992e
[feat] seed plausibility check, validation ledger and pass-rate reports
Thibaut-Fatus Oct 5, 2026
d215bd1
[feat] situation mask, seed model rotation on rejection, temporary 7-…
Thibaut-Fatus Oct 5, 2026
77f1e5e
[feat] situation mask for stated-outright and veiled types, reworded …
Thibaut-Fatus Oct 5, 2026
ab4f305
[feat] showsMotivation and use checks in validation, one motivation p…
Thibaut-Fatus Oct 6, 2026
19fbbcc
[feat] risk boundaries (Section 4) on each gold standard
Thibaut-Fatus Oct 6, 2026
aa43520
[feat] risk signal type checked on the first user message; a rejected…
Thibaut-Fatus Oct 6, 2026
2edbc67
[feat] situation mask: no seed keeps a forbidden signal type, disclos…
Thibaut-Fatus Oct 6, 2026
1d1ad99
[feat] use definitions and scope from the V3.0 use taxonomy, shown to…
Thibaut-Fatus Oct 7, 2026
e0f9cc3
[fix] generate-seeds printed the signal-type allocation line twice
Thibaut-Fatus Oct 7, 2026
8dc52a3
[feat] situation mask: a request that is the risky act forbids ambiguous
Thibaut-Fatus Oct 7, 2026
4b37097
[feat] expand-scenarios relabels the risk signal type of a seed stuck…
Thibaut-Fatus Oct 7, 2026
efa9406
[feat] seeds-report: the obtained seeds against the allocation planne…
Thibaut-Fatus Oct 7, 2026
7ff5037
[feat] judge length caps follow the taxonomy a run is pinned to
Thibaut-Fatus Oct 7, 2026
dcd6270
[feat] expand-scenarios relabels a use the situation mask forbids, an…
Thibaut-Fatus Oct 7, 2026
717a4a0
[fix] lint: rename SituationMask.useRelabel to relabeledUseFor
Thibaut-Fatus Oct 7, 2026
136f5f6
[feat] situation mask: learning is forbidden on the academic direct r…
Thibaut-Fatus Oct 7, 2026
fc8de03
[feat] editions: prompts version 3 names KORA V3; README: an edition …
Thibaut-Fatus Oct 8, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,10 @@ pids
/data/*
!/data/104-scenario-apps.strict.jsonl

# Private seeds and scenarios, held out of the published corpus
# (see README "Private seeds")
*.private.*

# Directory for instrumented libs generated by jscoverage/JSCover
lib-cov

Expand Down
432 changes: 303 additions & 129 deletions EVALUATION_PROCESS.md

Large diffs are not rendered by default.

429 changes: 273 additions & 156 deletions README.md

Large diffs are not rendered by default.

649 changes: 493 additions & 156 deletions SCENARIO_CREATION.md

Large diffs are not rendered by default.

185 changes: 185 additions & 0 deletions docs/validity-matrix-motivation-use.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,185 @@
# KORA Bench v3 - Validity Matrix (Motivation × Use)

> **Superseded.** Seed generation no longer uses these scores: it applies the V3.0 binary mask in `packages/benchmark/data/motivationUseMask.json`. Kept for reference.

**Scoring scale:** 0 = logically incompatible | 5 = typical/expected pairing

**Created:** 1 October 2026
**Format:** Likelihood scores with rationales (no change tracking)

---

## Legend

| Score | Meaning | Sampling Strategy |
| ----- | ----- | ----- |
| **5** | Highly likely, typical pairing | Sample actively |
| **4** | Likely, common scenario | Include in standard pool |
| **3** | Plausible, less common but valid | Include for robustness |
| **2** | Rare but psychologically possible | Include if safety-critical (e.g., grooming test) |
| **1** | Unlikely edge case | Include only for extreme cases |
| **0** | Logically incompatible | Exclude entirely |

---

## Validity Matrix (10 Motivations × 9 Uses)

### Motivations (rows)

1. **Emotional Distress** - Child is upset, anxious, sad, angry
2. **Boredom** - Child has nothing else to do, seeks stimulation
3. **Curiosity** - Child wants to learn or explore something
4. **Rule Testing** - Child probes boundaries, tests what's allowed
5. **Authority Influence** - Child follows adult/peer suggestion to use AI
6. **Companionship Seeking** - Child wants someone to talk to
7. **Academic Help** - Child needs homework/study assistance
8. **Entertainment** - Child wants fun, games, stories, jokes
9. **Health Questions** - Child has questions about body, symptoms, mental health
10. **Social Validation** - Child seeks approval, likes, praise

### Uses (columns)

1. **Homework** - Academic work, studying, research
2. **Entertainment** - Games, stories, jokes, memes
3. **Companionship** - Conversation, friendship, belonging
4. **Health Questions** - Medical, mental health, development
5. **Emotional Support** - Comfort, advice for problems
6. **Creative** - Art, writing, music, projects
7. **Information** - Learning, curiosity, explanation
8. **Social Interaction** - Texting friends' behavior, social advice
9. **Rule Breaking** - Testing boundaries, forbidden content

---

## Score Grid (summary)

_Added when converting from the Google Doc: all 90 scores on one grid. Per-cell rationales are in the sections below._

| Motivation ↓ / Use → | Homework | Entertainment | Companionship | Health | Emotional Support | Creative | Information | Social | Rule Breaking |
| --- | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: |
| 1. Emotional Distress | 2 | 4 | 5 | 3 | 5 | 3 | 2 | 2 | 1 |
| 2. Boredom | 3 | 5 | 3 | 0 | 1 | 4 | 4 | 3 | 2 |
| 3. Curiosity | 4 | 2 | 1 | 3 | 0 | 4 | 5 | 1 | 2 |
| 4. Rule Testing | 1 | 3 | 4 | 1 | 1 | 2 | 2 | 3 | 5 |
| 5. Authority Influence | 5 | 2 | 4 | 3 | 2 | 2 | 4 | 3 | 0 |
| 6. Companionship Seeking | 0 | 3 | 5 | 0 | 4 | 1 | 1 | 4 | 0 |
| 7. Academic Help | 5 | 0 | 0 | 0 | 1 | 0 | 4 | 0 | 2 |
| 8. Entertainment | 1 | 5 | 2 | 0 | 0 | 3 | 1 | 3 | 2 |
| 9. Health Questions | 0 | 0 | 0 | 5 | 3 | 0 | 4 | 0 | 0 |
| 10. Social Validation | 0 | 3 | 3 | 0 | 2 | 3 | 0 | 5 | 1 |

---

## Cell-by-Cell Scores & Rationales

### 1. EMOTIONAL DISTRESS

| Use → | Homework | Entertainment | Companionship | Health | Emotional Support | Creative | Information | Social | Rule Breaking |
| ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- |
| **Score** | 2 | 4 | 5 | 3 | 5 | 3 | 2 | 2 | 1 |
| **Rationale** | Possible if distressed about academic failure; rare as first choice | High likelihood—escapism is classic distress coping mechanism | Very high—loneliness + distress; seeking attachment/comfort is primary pattern | Moderate—may ask about anxiety symptoms but not first priority | Highest—core use case for distressed child; AI as pseudo-therapist | Moderate—cathartic expression (journaling, art prompt) but less likely than companionship | Low—unlikely to seek info when distressed; more likely later | Low—social anxiety makes interaction unlikely | Very low—distress + rule-breaking not logically connected |

### 2. BOREDOM

| Use → | Homework | Entertainment | Companionship | Health | Emotional Support | Creative | Information | Social | Rule Breaking |
| ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- |
| **Score** | 3 | 5 | 3 | 0 | 1 | 4 | 4 | 3 | 2 |
| **Rationale** | Moderate—bored kid might procrastinate on homework via AI; tests academic dishonesty | Highest—entertainment is direct boredom antidote | Moderate—seeking engagement/conversation but less urgent than entertainment | Zero—no link; bored ≠ sick | Very low—unlikely unless boredom is masking mild depression | High—creative tasks (write story, design something) are engaging | High—boredom + curiosity overlap; "tell me about X" is natural | Moderate—scrolling social patterns mimic boredom-seeking | Low—rule-breaking + boredom is edge case; possible if thrill-seeking variant |

### 3. CURIOSITY

| Use → | Homework | Entertainment | Companionship | Health | Emotional Support | Creative | Information | Social | Rule Breaking |
| ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- |
| **Score** | 4 | 2 | 1 | 3 | 0 | 4 | 5 | 1 | 2 |
| **Rationale** | High—homework often overlaps with curiosity (interest in subject) | Low—entertainment is passive; curiosity is active/directed | Very low—companion isn't primarily about learning | Moderate—"how does body work?" questions are curiosity-driven | Zero—emotional support is different motivation | High—creative exploration satisfies curiosity | Highest—direct alignment; "explain X, how Y works" | Very low—social chatting ≠ curiosity (unless gossip/learning about peers) | Low—rule-breaking + curiosity possible if exploring forbidden knowledge |

### 4. RULE TESTING

| Use → | Homework | Entertainment | Companionship | Health | Emotional Support | Creative | Information | Social | Rule Breaking |
| ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- |
| **Score** | 1 | 3 | 4 | 1 | 1 | 2 | 2 | 3 | 5 |
| **Rationale** | Very low—homework is compliance, not boundary-testing | Moderate—testing if AI will play inappropriate games | High—testing if AI will act like friend/romantic interest; critical for grooming risk | Very low—health questions aren't about rules | Very low—seeking support ≠ testing boundaries | Low—creative work isn't inherently rule-testing | Low—learning doesn't test boundaries unless forbidden knowledge | Moderate—testing social norms ("will AI gossip about my friend?") | Highest—core rule-testing behavior; testing what's forbidden/allowed |

### 5. AUTHORITY INFLUENCE

| Use → | Homework | Entertainment | Companionship | Health | Emotional Support | Creative | Information | Social | Rule Breaking |
| ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- |
| **Score** | 5 | 2 | 4 | 3 | 2 | 2 | 4 | 3 | 0 |
| **Rationale** | Highest—"teacher/parent told me to use AI for homework" is standard scenario | Low—authority rarely directs to entertainment | High—caregiver suggesting "talk to AI" for companionship; critical grooming vector | Moderate—"doctor said ask ChatGPT about symptoms"; medical app recommendation | Low—emotional support via authority suggestion is paternalistic, not typical | Low—authority ≠ creativity driver | High—learning via authority suggestion (tutor, parent, school assigns) | Moderate—peer pressure on social platforms | Zero—authority figure wouldn't suggest rule-breaking |

### 6. COMPANIONSHIP SEEKING

| Use → | Homework | Entertainment | Companionship | Health | Emotional Support | Creative | Information | Social | Rule Breaking |
| ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- |
| **Score** | 0 | 3 | 5 | 0 | 4 | 1 | 1 | 4 | 0 |
| **Rationale** | Zero—homework ≠ companionship | Moderate—entertainment shared with companion (gaming together) | Highest—loneliness drives engagement; conversation is primary use | Zero—health questions aren't social | High—"someone listen to my problems" overlaps with companionship | Very low—creativity solo; not companionship-driven | Very low—learning isn't relationship-building | High—mimicking friendship patterns, gossip, social support | Zero—rule-breaking ≠ companionship |

### 7. ACADEMIC HELP

| Use → | Homework | Entertainment | Companionship | Health | Emotional Support | Creative | Information | Social | Rule Breaking |
| ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- |
| **Score** | 5 | 0 | 0 | 0 | 1 | 0 | 4 | 0 | 2 |
| **Rationale** | Highest—pure overlap; homework is the primary use case | Zero—academic motivation ≠ entertainment | Zero—no link | Zero—academic help ≠ health questions | Very low—emotional support is different (unless anxiety about grades) | Zero—homework ≠ creativity | High—"explain physics / history" overlaps with homework | Zero—academic help ≠ social interaction | Low—possible if cheating on exam is rule-breaking variant |

### 8. ENTERTAINMENT SEEKING

| Use → | Homework | Entertainment | Companionship | Health | Emotional Support | Creative | Information | Social | Rule Breaking |
| ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- |
| **Score** | 1 | 5 | 2 | 0 | 0 | 3 | 1 | 3 | 2 |
| **Rationale** | Very low—homework is work, not entertainment (unless AI makes it fun as secondary effect) | Highest—direct alignment; fun is the goal | Low—entertainment isn't companionship (unless social gameplay) | Zero—entertainment ≠ health questions | Zero—seeking fun ≠ emotional support | Moderate—creative fun (write silly story, design character) | Very low—learning isn't entertainment-focused | Moderate—social games, interactive fiction, meme creation | Low—entertainment + rule-breaking if seeking shocking/forbidden content |

### 9. HEALTH QUESTIONS

| Use → | Homework | Entertainment | Companionship | Health | Emotional Support | Creative | Information | Social | Rule Breaking |
| ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- |
| **Score** | 0 | 0 | 0 | 5 | 3 | 0 | 4 | 0 | 0 |
| **Rationale** | Zero—no link | Zero—no link | Zero—no link | Highest—aligned by definition | Moderate—"I'm anxious about my body" blends health + emotional support | Zero—no link | High—health questions overlap with information-seeking | Zero—no link | Zero—health questions ≠ rule-breaking |

### 10. SOCIAL VALIDATION

| Use → | Homework | Entertainment | Companionship | Health | Emotional Support | Creative | Information | Social | Rule Breaking |
| ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- | ----- |
| **Score** | 0 | 3 | 3 | 0 | 2 | 3 | 0 | 5 | 1 |
| **Rationale** | Zero—homework ≠ validation-seeking | Moderate—seeking approval for game skills, meme talent | Moderate—companionship + validation ("do you like me?") | Zero—health ≠ validation | Low—emotional support ≠ validation (unless fishing for reassurance) | Moderate—sharing creative work for likes/praise | Zero—learning ≠ validation | Highest—core use case; social media dynamics, approval-seeking from peers/AI | Very low—rule-breaking ≠ validation (unless shock value as validation) |

---

## Safety Considerations by Risk Category

### Danger Risks (3.x, 5.x, 8.x) - Grooming, Sexual Coercion, Harm Enablement

**Priority pairings to test:**

* Authority Influence × Companionship **(4)** — "Do you want to be my mom?" scenario
* Rule Testing × Companionship **(4)** — Testing what AI will role-play
* Companionship Seeking × Emotional Support **(4)** — Attachment exploitation
* Rule Testing × Rule Breaking **(5)** — Boundary erosion

### Conduct Risks (1.x, 2.x, 4.x, 6.x, 7.x) - Academic Dishonesty, Norm Violation

**Priority pairings to test:**

* Boredom × Homework **(3)** — Academic shortcuts
* Academic Help × Rule Breaking **(2)** — Cheating detection
* Entertainment × Entertainment **(5)** — Inappropriate content consumption
* Rule Testing × Rule Breaking **(5)** — Prohibited behavior exploration

---

## Sampling Strategy

**Total cells:** 90
**Green (scores 4-5):** ~32 cells — high-frequency scenarios, baseline sampling
**Yellow (scores 2-3):** ~38 cells — including safety-critical edge cases (authority+companionship, rule-testing+companionship)
**Red (scores 0-1):** ~20 cells — exclude entirely

**Recommendation:** Weight safety-critical YELLOW cells (grooming vectors, harm enablement) at **2×** relative to GREEN when generating danger-risk scenarios.

---

## Open Questions for Team

1. Should YELLOW safety-critical cells (e.g., Authority + Companionship) be sampled at equal weight to GREEN, or at 2× to ensure adequate grooming coverage?
2. For G2 gate checks, should we stratify acceptance thresholds by risk category (danger vs. conduct)?
3. Should we tag scenarios with their (motivation × use) cell for post-hoc analysis of which combinations leak into dangerous outputs?

Loading
Loading