Skip to content

Pre-1.0 polish: Delphi caveats apart from the key, anova in 80 columns, the site menu, and Scheibe's 2002 edition - #78

Merged
JUhalt merged 2 commits into
masterfrom
fix/pre-1.0-polish
Sep 27, 2026
Merged

JUhalt merged 2 commits into
masterfrom
fix/pre-1.0-polish

Conversation

@JUhalt

@JUhalt JUhalt commented Sep 27, 2026

Copy link
Copy Markdown
Owner

The four small items left for 1.0 after 0.9.0. The development version bump to 0.9.0.9000 rides along. No computed value changes. This is not a release, and 1.0 is not planned here.

The maintainer's guiding point for this work: contentvalidR is a teaching tool for instructors to use with students, and a tool for researchers in their own serious work. The output should teach without burying the result.

1. The Delphi printout, in two layers

The Delphi printout ran about 100 lines for five statements, and two method paragraphs printed every time.

  • Always printed: two short caveats that change how a result should be read.

    • Read kappa as a trend beside the share of experts who kept their rating, not against a cut-off, because kappa falls as a panel converges (Holey et al., 2007).
    • With fewer than about 40 experts, the kappa intervals cover less than their stated 95% (Klar et al., 2002).
  • The teaching layer, printed with the key under "How the stability statistic works":

    • what the weights do, and the intraclass-correlation equivalence (Fleiss & Cohen, 1973);
    • why no verbal labels are shown;
    • Klar et al.'s coverage figures.

    Students see it by default; a researcher can hide it with options(contentvalidR.show_key = FALSE) and keep every caveat.

  • Unchanged: the critique printed for an alternative stability method (lambda, the chi-square tests, the 15% rule) still always prints, as the method-options policy requires.

The example goes from 100 lines to 92, or 58 with the key hidden. A new test checks that the caveats survive hiding the key, that the teaching layer doesn't, and that an alternative's critique is never hidden. The Delphi vignette's sentence about the key now describes what it holds.

2. anova_content() fits in 80 columns

It was about 96 columns wide and wrapped into two blocks. The competitor column is dropped: htd() and the rating workflow already show it, and it stays in strongest_competitor, which the note now names. The headings are shorter ("F test", "met"), and the note explains "met". The example is 79 columns, and a test checks the width.

3. The website

I checked the rebuilt site in a browser:

  • the home page and its 11 guide links;
  • the figure's alt text;
  • a help page's formatted example output;
  • the reference index, including its Deprecated section.

All pages resolve (HTTP 200). Two fixes:

  • Articles menu: the menu listed the Start-here pages and hid the four workflow guides under "More articles…". Every guide now sits under a heading, in the order a course would use them: Start here, Workflow guides, Planning and reporting, After content review.
  • Stale label: the auxiliary helpers' reference section no longer calls itself "not flagship v0.1.0 workflows".

4. Scheibe et al., cited from the edition we read

APA needs a page range for a book chapter. Citing sources give pp. 262–287 for the 1975 printing, but I couldn't check that against a copy. The package's percent-change rule was verified against the editors' 2002 web edition, so, at the maintainer's choice, the reference now names that edition:

Scheibe, M., Skutsch, M., & Schofer, J. (2002). Experiments in Delphi methodology. In H. A. Linstone & M. Turoff (Eds.), The Delphi method: Techniques and applications (pp. 257–281). https://www.foresight.pl/assets/downloads/publications/Turoff_Linstone.pdf (Original work published 1975)

In-text citations read "Scheibe et al. (1975/2002)", as APA 7 asks for a republished work. This covers the help page, the Delphi vignette, the README's References, inst/REFERENCES.bib, the printed method label, and the citation a handoff carries for stability = "percent_change". That is a prose field; schema v1 lets prose change, and nomologR's reader never matches on citation text.

Also: the partnership, stated

The ROADMAP's v1.0.0 section now states the maintainer's intent. contentvalidR and nomologR are partners, kept on the same page about handoffs before and after 1.0. solomonR is a separate project: it reads no handoffs and takes no part in the joint 1.0. The v0.7.0 schema item records the solomonR check as withdrawn (solomonR#32 was deleted on 2026-09-25); the released NEWS is left as history.

Verification

  • All 2,950 tests pass.
  • tools/release-gate.R on this PR's head (05c5c11), run in a detached worktree: build, smoke, and check all pass. R CMD check: 0 errors, 0 warnings, and only the two expected notes (New submission; math rendering skipped without V8).

🤖 Generated with Claude Code

JUhalt and others added 2 commits September 27, 2026 10:52
… 80 columns, and show every guide in the site menu

Three of the four items left for 1.0 after 0.9.0. No computed value
changes. The package is a teaching tool for instructors and students and
a tool for researchers' own work, so the output teaches without burying
the result.

- Delphi print, in two layers. Two short caveats always print: read kappa
  as a trend beside the share who kept their rating, not against a
  cut-off; and with fewer than about 40 experts the kappa intervals cover
  less than their stated 95%. The fuller explanation (the weights, the
  intraclass-correlation equivalence, why kappa falls as a panel
  converges, Klar et al.'s coverage figures) moves into the key under "How
  the stability statistic works", where students see it and a researcher
  can hide it. The alternative methods' critiques still always print, as
  the method-options policy requires. The example goes from 100 lines to
  92, or 58 with the key hidden. A test checks both layers.
- anova_content() prints within 80 columns (79 on the example), dropping
  the competitor column that htd() and the rating workflow show and that
  stays in strongest_competitor; the note says so. A test checks the width.
- The website's Articles menu lists every guide under a heading, in
  course order (Start here, Workflow guides, Planning and reporting, After
  content review); the workflow guides had been hidden under "More
  articles". The auxiliary helpers' reference label no longer calls
  itself "not flagship v0.1.0 workflows".
- ROADMAP: the schema-v1 check against solomonR is recorded as withdrawn;
  its maintainer made solomonR a separate project that reads no handoffs
  (2026-09-25).

Version 0.9.0.9000.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…rtnership

The package's percent-change rule was checked against the editors' 2002
web edition of Linstone and Turoff, so the reference now names that
edition, with the chapter's pages (257-281), its link, and "(Original
work published 1975)". In-text citations read "Scheibe et al.
(1975/2002)", as APA 7 asks for a republished work, including the
citation a handoff carries for stability = "percent_change".

ROADMAP.md now states the maintainer's intent: contentvalidR and
nomologR are partners, kept on the same page about handoffs before and
after 1.0, and solomonR is a separate project that reads no handoffs
and takes no part in the joint 1.0.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@JUhalt
JUhalt merged commit 20f3f86 into master Sep 27, 2026
8 checks passed
JUhalt added a commit that referenced this pull request Sep 28, 2026
Release contentvalidR 0.10.0

Stamps the version, release notes, citation metadata, README, and roadmap
for the tenth public release, the last planned before the joint 1.0
release candidate on 2026-10-17. It adds figures for papers, posters, and
teaching: content_evidence() with its item flow diagram and item evidence
profile, the rating-distribution view, and the apa switch (#82). It also
states the handoff contract nomologR reads (#79), makes this package's
walkthrough the joint one (#80, #81), separates the Delphi printout's
caveats from its teaching (#78), and records the release-candidate
timeline (#83).

No computed value changes: 25 analyses across every workflow return the
same values as v0.9.0. No breaking changes: the plot methods gain
arguments after their existing ones. agreement_summary() remains
deprecated and is removed in 1.0.0.

contentvalidR 0.4.0 has been on CRAN since 2026-09-28. CRAN asks for
updates no more often than every one to two months, so 0.10.0 is released
on GitHub and R-universe only.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant