Skip to content

CI: tiny 10x H5 fixture through rustpipe-sc pipeline - #10

Open
jwg054000 wants to merge 1 commit into
mainfrom
cursor/feat-h5-ci-fixture-1f9a
Open

jwg054000 wants to merge 1 commit into
mainfrom
cursor/feat-h5-ci-fixture-1f9a

Conversation

@jwg054000

Copy link
Copy Markdown
Owner

Closes the “no H5 in Actions” gap on #3. GitHub Actions previously ran cargo test without --features hdf5 and without a Cell Ranger matrix, so load_input never hit read_10x_h5.

What

  • Synthetic testdata/filtered_feature_bc_matrix.h5 (80 cells × 2120 genes, ~275 KB). Real HDF5 /matrix layout (data/indices/indptr/shape/barcodes/features/name). Not a public PBMC file.
  • Generator: scripts/gen_10x_ci_fixture.py
  • Fixture is sized for default pipeline flags: --min-genes 200, --max-pct-mt 5 (MT-* genes, low mito %), --n-hvg 2000, --n-pcs 50 (rank clamp already on main from Clamp n_pcs so default H5 pipeline does not panic #7), --knn-k 15
  • CI installs libhdf5-dev, runs cargo test (unchanged, no HDF5), then cargo test --features hdf5, then rustpipe-sc pipeline --input testdata/filtered_feature_bc_matrix.h5 and requires PACKET.md files:
    • qc_metrics.csv
    • pca_scores.csv
    • clusters.csv
    • markers.csv
    • pipeline_timings.json

Not in this PR

  • No RustQC vendor, no Nextflow/Cell Ranger wrapper, no --qc-bam smoke
  • --input remains H5 / H5AD / CSV only (never rustqc featureCounts)
  • Does not touch prairie-rna-stream, RustPipe, or Seqera RustQC
  • Does not merge main

Related: #3

Open in Web Open in Cursor 

Actions had no HDF5 input, so load_input's Cell Ranger /matrix reader
never ran. Commit a synthetic 80x2120 filtered_feature_bc_matrix.h5
(plus generator) that survives default QC/HVG, enable --features hdf5
with libhdf5-dev, and require PACKET.md artifacts.

Co-authored-by: Josh Garton <jwg054000@users.noreply.github.com>
@jwg054000
jwg054000 marked this pull request as ready for review September 2, 2026 19:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants