Skip to content

Wire contract tests into CI and releases - #2557

Merged
timsehn merged 1 commit into
masterfrom
fix/2541-wire-contract-tests
Sep 2, 2026
Merged

Wire contract tests into CI and releases#2557
timsehn merged 1 commit into
masterfrom
fix/2541-wire-contract-tests

Conversation

@timsehn

@timsehn timsehn commented Sep 2, 2026

Copy link
Copy Markdown
Collaborator

Closes #2541

Explicitly run the SQLite compatibility, concurrency, and storage-format contract suites in PR CI. Gate releases on the frozen v12 storage-format corpus alongside cross-version compatibility checks.

Tests:

  • sqlite_compatibility_contract_test.sh (13/13)
  • concurrency_contract_test.sh (6/6)
  • storage_format_contract_test.sh (32/32)
  • actionlint

Co-Authored-By: OpenAI Codex noreply@openai.com

Tim @codex
Wire contract tests into CI and releases
bc5a371 
Co-Authored-By: OpenAI Codex <noreply@openai.com>
@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

DoltLite source coverage

Metric Covered Total Coverage
Lines 53684 63085 85.10%
Branches 24834 36632 67.79%
Functions 2511 2723 92.21%

Merged 201 pooled raw profiles from the distributed Linux correctness jobs.

Per-file coverage (98 files)
File Lines Branches Functions
src/btree_orig_api.c 87.91% 77.27% 89.53%
src/chunk_file.c 100.00% 100.00% 100.00%
src/chunk_index.c 84.27% 66.78% 100.00%
src/chunk_refs.c 84.99% 69.17% 79.37%
src/chunk_staging.c 93.75% 81.15% 100.00%
src/chunk_store.c 91.11% 75.34% 100.00%
src/chunk_store_commit.c 86.75% 67.23% 100.00%
src/chunk_store_lock.c 88.69% 71.00% 100.00%
src/chunk_store_refs_api.c 91.17% 76.75% 100.00%
src/chunk_wal.c 82.48% 58.70% 87.50%
src/doltlite.c 100.00% 100.00% 100.00%
src/doltlite_add.c 86.85% 69.76% 100.00%
src/doltlite_ancestor.c 89.19% 68.92% 100.00%
src/doltlite_at.c 83.39% 64.20% 100.00%
src/doltlite_blame.c 80.86% 61.14% 96.43%
src/doltlite_branch.c 88.30% 80.66% 100.00%
src/doltlite_branches.c 93.75% 75.93% 93.75%
src/doltlite_checkout.c 77.57% 63.06% 96.43%
src/doltlite_cherry_pick.c 79.29% 60.00% 71.43%
src/doltlite_chunk_walk.c 92.23% 66.22% 100.00%
src/doltlite_clean.c 93.33% 67.19% 100.00%
src/doltlite_cmd.c 81.09% 75.19% 100.00%
src/doltlite_commit.c 94.41% 76.87% 100.00%
src/doltlite_commit_ancestors.c 92.09% 72.83% 92.31%
src/doltlite_commit_cmd.c 78.08% 67.50% 100.00%
src/doltlite_config.c 80.47% 71.74% 100.00%
src/doltlite_conflicts.c 84.27% 62.50% 93.75%
src/doltlite_constraint_violations.c 82.46% 57.54% 91.11%
src/doltlite_core.c 91.34% 70.81% 100.00%
src/doltlite_creds.c 84.09% 53.78% 92.00%
src/doltlite_dbpage.c 93.45% 78.33% 91.67%
src/doltlite_diff.c 88.56% 68.99% 96.55%
src/doltlite_diff_stat.c 94.17% 76.01% 95.65%
src/doltlite_diff_table.c 94.09% 70.60% 97.06%
src/doltlite_docs.c 83.94% 71.43% 94.74%
src/doltlite_gc.c 78.48% 58.10% 96.55%
src/doltlite_hashof.c 79.79% 70.05% 100.00%
src/doltlite_history.c 86.93% 76.40% 100.00%
src/doltlite_http_remote.c 82.22% 57.34% 92.31%
src/doltlite_ignore.c 77.57% 62.25% 82.14%
src/doltlite_log.c 96.81% 73.24% 92.86%
src/doltlite_merge.c 95.93% 70.46% 100.00%
src/doltlite_merge_cmd.c 87.39% 72.36% 100.00%
src/doltlite_merge_constraints.c 86.15% 63.64% 95.00%
src/doltlite_merge_constraints_check.c 86.81% 67.79% 100.00%
src/doltlite_merge_constraints_fk.c 78.00% 56.64% 100.00%
src/doltlite_merge_constraints_notnull.c 80.45% 67.92% 100.00%
src/doltlite_merge_constraints_strict.c 77.35% 63.04% 100.00%
src/doltlite_merge_constraints_unique.c 85.99% 62.82% 100.00%
src/doltlite_merge_pass1.c 92.94% 74.16% 100.00%
src/doltlite_merge_pass2.c 83.59% 67.46% 100.00%
src/doltlite_merge_predetect.c 86.38% 71.15% 95.45%
src/doltlite_merge_rebuild.c 99.15% 78.91% 100.00%
src/doltlite_merge_rows.c 82.93% 64.74% 100.00%
src/doltlite_merge_schema.c 90.95% 71.94% 97.06%
src/doltlite_merge_status.c 91.98% 73.53% 92.31%
src/doltlite_patch.c 94.36% 70.71% 98.15%
src/doltlite_rebase.c 85.42% 59.55% 100.00%
src/doltlite_record.c 78.67% 59.36% 95.24%
src/doltlite_ref.c 95.52% 75.36% 100.00%
src/doltlite_remote.c 85.61% 66.89% 96.00%
src/doltlite_remote_sql.c 66.60% 60.73% 93.55%
src/doltlite_remotesrv.c 75.76% 63.77% 90.77%
src/doltlite_reset.c 87.48% 72.76% 100.00%
src/doltlite_revert.c 80.51% 69.44% 100.00%
src/doltlite_schema_diff.c 94.42% 71.13% 96.97%
src/doltlite_schemas.c 70.86% 48.75% 90.91%
src/doltlite_status.c 91.49% 72.78% 97.56%
src/doltlite_tag.c 86.84% 70.31% 94.12%
src/doltlite_tests.c 84.22% 69.61% 91.11%
src/doltlite_tls.c 85.04% 61.82% 92.31%
src/doltlite_verify_constraints.c 79.15% 66.44% 100.00%
src/doltlite_workspace.c 91.84% 70.27% 100.00%
src/pager_shim.c 58.87% 67.46% 34.29%
src/prolly_btree.c 86.00% 66.45% 90.70%
src/prolly_btree_catalog.c 83.10% 69.04% 97.22%
src/prolly_btree_cursor.c 84.15% 62.09% 96.00%
src/prolly_btree_cursor_count.c 80.05% 56.74% 100.00%
src/prolly_btree_cursor_payload.c 75.69% 54.48% 95.65%
src/prolly_btree_cursor_seek.c 76.68% 66.20% 82.35%
src/prolly_btree_mutation.c 87.89% 68.20% 97.83%
src/prolly_btree_orig.c 93.75% 71.43% 93.15%
src/prolly_btree_state.c 93.51% 66.38% 100.00%
src/prolly_btree_txn.c 81.84% 69.30% 98.08%
src/prolly_cache.c 93.27% 69.12% 100.00%
src/prolly_check.c 60.36% 62.96% 100.00%
src/prolly_chunker.c 94.04% 79.73% 100.00%
src/prolly_cursor.c 89.67% 80.47% 100.00%
src/prolly_diff.c 59.59% 46.05% 71.43%
src/prolly_hash.c 93.33% 80.00% 100.00%
src/prolly_hashset.c 90.48% 80.56% 100.00%
src/prolly_mutate.c 80.78% 69.11% 100.00%
src/prolly_mutmap.c 93.87% 80.34% 100.00%
src/prolly_node.c 88.91% 73.81% 100.00%
src/prolly_three_way_diff.c 95.79% 85.37% 100.00%
src/prolly_three_way_merge.c 81.92% 67.41% 91.67%
src/prolly_xxhash.c 100.00% 100.00% 100.00%
src/sortkey.c 93.16% 81.51% 100.00%

Download HTML and LCOV artifacts from this workflow run.

@github-actions

github-actions Bot commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

DoltLite performance vs PR base

  • Baseline: 1622b18ae609656c2af5a5912b8e0a638b31ee25
  • Candidate: 40c818db85f572681eaef968c7893db62835181d
  • Overall ratio: 0.991x
  • Gate result: PASS
  • Gates: individual > 1.50x with more than 10.00ms regression; section, suite, or overall > 1.25x with the same minimum delta
  • vc individual gate: > 2.00x with more than 50.00ms regression
  • Confirmed failed gates: none
  • Automatic retries: int cleared after 2 attempts; no gate failed every time
Suite Workloads Baseline total Candidate total Ratio Result
blobpk 69 11.39s 11.39s 1.000x PASS
compositepk 69 10.24s 10.24s 1.000x PASS
int 69 11.40s 10.98s 0.963x PASS
textpk 69 11.53s 11.53s 1.000x PASS
vc 13 803.91ms 806.10ms 1.003x PASS
blobpk details
Section Test Baseline Candidate Delta Ratio Result
mem_reads oltp_point_select 34.85ms 34.63ms -228us 0.993x PASS
mem_reads oltp_range_select 13.49ms 13.41ms -78us 0.994x PASS
mem_reads oltp_sum_range 12.99ms 12.86ms -135us 0.990x PASS
mem_reads oltp_order_range 3.12ms 3.15ms +25us 1.008x PASS
mem_reads oltp_distinct_range 4.24ms 4.22ms -13us 0.997x PASS
mem_reads oltp_index_scan 5.48ms 5.48ms +4us 1.001x PASS
mem_reads select_random_points 19.70ms 19.57ms -127us 0.994x PASS
mem_reads select_random_ranges 5.27ms 5.21ms -55us 0.990x PASS
mem_reads covering_index_scan 4.31ms 4.38ms +71us 1.016x PASS
mem_reads groupby_scan 35.89ms 35.84ms -42us 0.999x PASS
mem_reads index_join 9.10ms 8.55ms -553us 0.939x PASS
mem_reads index_join_scan 5.42ms 5.37ms -48us 0.991x PASS
mem_reads types_table_scan 1.24s 1.24s +1.07ms 1.001x PASS
mem_reads table_scan 1.37s 1.38s +10.35ms 1.008x PASS
mem_reads oltp_read_only 131.53ms 133.81ms +2.28ms 1.017x PASS
mem_writes oltp_bulk_insert 345.66ms 345.57ms -87us 1.000x PASS
mem_writes oltp_insert 38.00ms 39.11ms +1.11ms 1.029x PASS
mem_writes oltp_update_index 133.33ms 134.75ms +1.42ms 1.011x PASS
mem_writes oltp_update_non_index 78.20ms 78.47ms +261us 1.003x PASS
mem_writes oltp_delete_insert 103.35ms 103.76ms +411us 1.004x PASS
mem_writes oltp_write_only 61.30ms 61.30ms +7us 1.000x PASS
mem_writes types_delete_insert 50.77ms 50.75ms -16us 1.000x PASS
mem_writes oltp_read_write 137.96ms 139.53ms +1.57ms 1.011x PASS
file_reads oltp_point_select 56.41ms 56.98ms +568us 1.010x PASS
file_reads oltp_range_select 15.74ms 15.62ms -128us 0.992x PASS
file_reads oltp_sum_range 15.29ms 15.40ms +114us 1.007x PASS
file_reads oltp_order_range 3.46ms 3.46ms -4us 0.999x PASS
file_reads oltp_distinct_range 4.54ms 4.56ms +23us 1.005x PASS
file_reads oltp_index_scan 8.20ms 8.15ms -52us 0.994x PASS
file_reads select_random_points 21.87ms 22.18ms +311us 1.014x PASS
file_reads select_random_ranges 7.48ms 7.46ms -19us 0.997x PASS
file_reads covering_index_scan 6.89ms 6.92ms +39us 1.006x PASS
file_reads groupby_scan 36.52ms 36.33ms -195us 0.995x PASS
file_reads index_join 10.93ms 10.84ms -92us 0.992x PASS
file_reads index_join_scan 5.94ms 5.98ms +40us 1.007x PASS
file_reads types_table_scan 1.25s 1.24s -10.13ms 0.992x PASS
file_reads table_scan 1.40s 1.39s -9.37ms 0.993x PASS
file_reads oltp_read_only 164.27ms 163.48ms -791us 0.995x PASS
file_writes oltp_bulk_insert 357.05ms 356.36ms -685us 0.998x PASS
file_writes oltp_insert 44.78ms 45.16ms +384us 1.009x PASS
file_writes oltp_update_index 148.07ms 151.37ms +3.30ms 1.022x PASS
file_writes oltp_update_non_index 91.75ms 92.89ms +1.13ms 1.012x PASS
file_writes oltp_delete_insert 118.08ms 117.29ms -795us 0.993x PASS
file_writes oltp_write_only 71.16ms 72.61ms +1.46ms 1.020x PASS
file_writes types_delete_insert 60.00ms 60.24ms +246us 1.004x PASS
file_writes oltp_read_write 150.48ms 146.68ms -3.81ms 0.975x PASS
ac_reads oltp_point_select 56.42ms 56.02ms -395us 0.993x PASS
ac_reads oltp_range_select 15.68ms 15.53ms -151us 0.990x PASS
ac_reads oltp_sum_range 15.33ms 15.34ms +8us 1.001x PASS
ac_reads oltp_order_range 3.45ms 3.49ms +32us 1.009x PASS
ac_reads oltp_distinct_range 4.53ms 4.60ms +71us 1.016x PASS
ac_reads oltp_index_scan 8.16ms 8.20ms +40us 1.005x PASS
ac_reads select_random_points 21.84ms 21.93ms +87us 1.004x PASS
ac_reads select_random_ranges 7.47ms 7.46ms -17us 0.998x PASS
ac_reads covering_index_scan 6.91ms 6.95ms +35us 1.005x PASS
ac_reads groupby_scan 36.20ms 36.30ms +104us 1.003x PASS
ac_reads index_join 11.11ms 10.60ms -512us 0.954x PASS
ac_reads index_join_scan 6.04ms 5.90ms -148us 0.976x PASS
ac_reads types_table_scan 1.22s 1.23s +4.95ms 1.004x PASS
ac_reads table_scan 1.37s 1.36s -6.53ms 0.995x PASS
ac_reads oltp_read_only 161.92ms 160.63ms -1.29ms 0.992x PASS
ac_writes oltp_bulk_insert_ac 55.95ms 56.79ms +838us 1.015x PASS
ac_writes oltp_insert_ac 71.50ms 72.71ms +1.21ms 1.017x PASS
ac_writes oltp_update_index_ac 79.77ms 80.17ms +401us 1.005x PASS
ac_writes oltp_update_non_index_ac 63.51ms 64.62ms +1.10ms 1.017x PASS
ac_writes oltp_delete_insert_ac 73.11ms 73.04ms -72us 0.999x PASS
ac_writes oltp_write_only_ac 75.72ms 73.65ms -2.07ms 0.973x PASS
ac_writes types_delete_insert_ac 65.90ms 66.39ms +492us 1.007x PASS
ac_writes oltp_read_write_ac 79.11ms 79.78ms +666us 1.008x PASS
compositepk details
Section Test Baseline Candidate Delta Ratio Result
mem_reads oltp_point_select 30.36ms 30.58ms +219us 1.007x PASS
mem_reads oltp_range_select 16.89ms 17.63ms +745us 1.044x PASS
mem_reads oltp_sum_range 16.71ms 17.13ms +419us 1.025x PASS
mem_reads oltp_order_range 3.40ms 3.34ms -64us 0.981x PASS
mem_reads oltp_distinct_range 4.29ms 4.40ms +117us 1.027x PASS
mem_reads oltp_index_scan 4.46ms 4.55ms +86us 1.019x PASS
mem_reads select_random_points 26.98ms 27.64ms +661us 1.025x PASS
mem_reads select_random_ranges 7.06ms 7.02ms -33us 0.995x PASS
mem_reads covering_index_scan 3.43ms 3.44ms +18us 1.005x PASS
mem_reads groupby_scan 35.16ms 35.97ms +809us 1.023x PASS
mem_reads index_join 8.78ms 8.73ms -44us 0.995x PASS
mem_reads index_join_scan 4.67ms 4.70ms +29us 1.006x PASS
mem_reads types_table_scan 1.07s 1.07s -2.56ms 0.998x PASS
mem_reads table_scan 1.17s 1.18s +7.11ms 1.006x PASS
mem_reads oltp_read_only 139.64ms 139.56ms -72us 0.999x PASS
mem_writes oltp_bulk_insert 254.11ms 257.78ms +3.66ms 1.014x PASS
mem_writes oltp_insert 26.37ms 26.33ms -42us 0.998x PASS
mem_writes oltp_update_index 95.04ms 92.35ms -2.69ms 0.972x PASS
mem_writes oltp_update_non_index 57.15ms 57.97ms +819us 1.014x PASS
mem_writes oltp_delete_insert 71.44ms 71.00ms -440us 0.994x PASS
mem_writes oltp_write_only 42.42ms 41.48ms -948us 0.978x PASS
mem_writes types_delete_insert 39.63ms 38.12ms -1.51ms 0.962x PASS
mem_writes oltp_read_write 118.50ms 118.45ms -53us 1.000x PASS
file_reads oltp_point_select 37.21ms 36.96ms -252us 0.993x PASS
file_reads oltp_range_select 18.49ms 18.25ms -234us 0.987x PASS
file_reads oltp_sum_range 17.93ms 17.93ms +2us 1.000x PASS
file_reads oltp_order_range 3.49ms 3.42ms -67us 0.981x PASS
file_reads oltp_distinct_range 4.42ms 4.42ms +7us 1.002x PASS
file_reads oltp_index_scan 5.37ms 5.37ms -2us 1.000x PASS
file_reads select_random_points 28.91ms 28.89ms -14us 1.000x PASS
file_reads select_random_ranges 7.95ms 8.13ms +184us 1.023x PASS
file_reads covering_index_scan 3.99ms 4.06ms +64us 1.016x PASS
file_reads groupby_scan 36.32ms 36.03ms -288us 0.992x PASS
file_reads index_join 9.66ms 9.66ms -7us 0.999x PASS
file_reads index_join_scan 4.99ms 4.93ms -62us 0.988x PASS
file_reads types_table_scan 1.08s 1.08s +732us 1.001x PASS
file_reads table_scan 1.19s 1.18s -5.46ms 0.995x PASS
file_reads oltp_read_only 150.00ms 150.06ms +54us 1.000x PASS
file_writes oltp_bulk_insert 308.02ms 308.75ms +729us 1.002x PASS
file_writes oltp_insert 44.78ms 45.48ms +699us 1.016x PASS
file_writes oltp_update_index 155.70ms 157.52ms +1.82ms 1.012x PASS
file_writes oltp_update_non_index 109.78ms 109.95ms +162us 1.001x PASS
file_writes oltp_delete_insert 128.00ms 127.79ms -207us 0.998x PASS
file_writes oltp_write_only 89.67ms 88.77ms -893us 0.990x PASS
file_writes types_delete_insert 71.84ms 72.95ms +1.11ms 1.015x PASS
file_writes oltp_read_write 163.91ms 167.80ms +3.89ms 1.024x PASS
ac_reads oltp_point_select 36.75ms 36.95ms +195us 1.005x PASS
ac_reads oltp_range_select 18.63ms 18.56ms -73us 0.996x PASS
ac_reads oltp_sum_range 17.64ms 17.38ms -263us 0.985x PASS
ac_reads oltp_order_range 3.39ms 3.39ms +0us 1.000x PASS
ac_reads oltp_distinct_range 4.50ms 4.41ms -94us 0.979x PASS
ac_reads oltp_index_scan 5.36ms 5.31ms -44us 0.992x PASS
ac_reads select_random_points 28.33ms 28.71ms +378us 1.013x PASS
ac_reads select_random_ranges 7.89ms 7.94ms +45us 1.006x PASS
ac_reads covering_index_scan 4.03ms 4.06ms +29us 1.007x PASS
ac_reads groupby_scan 35.41ms 36.37ms +958us 1.027x PASS
ac_reads index_join 9.41ms 9.39ms -27us 0.997x PASS
ac_reads index_join_scan 4.92ms 4.90ms -22us 0.996x PASS
ac_reads types_table_scan 1.06s 1.07s +5.11ms 1.005x PASS
ac_reads table_scan 1.18s 1.18s +965us 1.001x PASS
ac_reads oltp_read_only 147.42ms 147.17ms -246us 0.998x PASS
ac_writes oltp_bulk_insert_ac 86.67ms 84.18ms -2.49ms 0.971x PASS
ac_writes oltp_insert_ac 95.09ms 91.91ms -3.18ms 0.967x PASS
ac_writes oltp_update_index_ac 101.77ms 100.46ms -1.31ms 0.987x PASS
ac_writes oltp_update_non_index_ac 90.59ms 88.57ms -2.02ms 0.978x PASS
ac_writes oltp_delete_insert_ac 96.08ms 93.49ms -2.59ms 0.973x PASS
ac_writes oltp_write_only_ac 93.86ms 95.17ms +1.31ms 1.014x PASS
ac_writes types_delete_insert_ac 87.85ms 88.02ms +163us 1.002x PASS
ac_writes oltp_read_write_ac 100.41ms 98.56ms -1.85ms 0.982x PASS
int details
Section Test Baseline Candidate Delta Ratio Result
mem_reads oltp_point_select 28.26ms 27.27ms -994us 0.965x PASS
mem_reads oltp_range_select 11.18ms 10.98ms -200us 0.982x PASS
mem_reads oltp_sum_range 10.59ms 10.65ms +54us 1.005x PASS
mem_reads oltp_order_range 2.78ms 2.78ms +3us 1.001x PASS
mem_reads oltp_distinct_range 3.86ms 3.81ms -54us 0.986x PASS
mem_reads oltp_index_scan 4.86ms 4.84ms -26us 0.995x PASS
mem_reads select_random_points 11.31ms 11.16ms -145us 0.987x PASS
mem_reads select_random_ranges 3.90ms 3.90ms +4us 1.001x PASS
mem_reads covering_index_scan 4.12ms 4.09ms -28us 0.993x PASS
mem_reads groupby_scan 33.47ms 33.49ms +14us 1.000x PASS
mem_reads index_join 7.46ms 7.58ms +118us 1.016x PASS
mem_reads index_join_scan 4.98ms 5.06ms +84us 1.017x PASS
mem_reads types_table_scan 1.17s 1.17s -1.31ms 0.999x PASS
mem_reads table_scan 1.30s 1.30s +4.77ms 1.004x PASS
mem_reads oltp_read_only 109.05ms 110.19ms +1.13ms 1.010x PASS
mem_writes oltp_bulk_insert 228.60ms 229.22ms +622us 1.003x PASS
mem_writes oltp_insert 25.07ms 25.58ms +506us 1.020x PASS
mem_writes oltp_update_index 86.36ms 86.19ms -168us 0.998x PASS
mem_writes oltp_update_non_index 49.15ms 47.88ms -1.27ms 0.974x PASS
mem_writes oltp_delete_insert 67.67ms 67.70ms +35us 1.001x PASS
mem_writes oltp_write_only 43.88ms 43.08ms -799us 0.982x PASS
mem_writes types_delete_insert 32.54ms 32.61ms +63us 1.002x PASS
mem_writes oltp_read_write 102.21ms 102.22ms +16us 1.000x PASS
file_reads oltp_point_select 47.53ms 47.98ms +451us 1.009x PASS
file_reads oltp_range_select 13.07ms 13.11ms +39us 1.003x PASS
file_reads oltp_sum_range 12.75ms 12.57ms -176us 0.986x PASS
file_reads oltp_order_range 3.04ms 3.04ms +1us 1.000x PASS
file_reads oltp_distinct_range 4.09ms 4.09ms +5us 1.001x PASS
file_reads oltp_index_scan 7.25ms 7.33ms +77us 1.011x PASS
file_reads select_random_points 13.13ms 13.43ms +302us 1.023x PASS
file_reads select_random_ranges 5.86ms 5.89ms +29us 1.005x PASS
file_reads covering_index_scan 6.47ms 6.66ms +194us 1.030x PASS
file_reads groupby_scan 33.69ms 34.08ms +389us 1.012x PASS
file_reads index_join 9.66ms 9.63ms -23us 0.998x PASS
file_reads index_join_scan 5.36ms 5.35ms -10us 0.998x PASS
file_reads types_table_scan 1.17s 1.17s +2.68ms 1.002x PASS
file_reads table_scan 1.29s 1.30s +15.48ms 1.012x PASS
file_reads oltp_read_only 140.41ms 141.55ms +1.15ms 1.008x PASS
file_writes oltp_bulk_insert 277.99ms 294.08ms +16.09ms 1.058x PASS
file_writes oltp_insert 38.56ms 38.72ms +163us 1.004x PASS
file_writes oltp_update_index 151.48ms 196.50ms +45.02ms 1.297x PASS
file_writes oltp_update_non_index 102.80ms 98.34ms -4.46ms 0.957x PASS
file_writes oltp_delete_insert 114.00ms 114.69ms +692us 1.006x PASS
file_writes oltp_write_only 78.69ms 78.76ms +64us 1.001x PASS
file_writes types_delete_insert 56.90ms 56.98ms +81us 1.001x PASS
file_writes oltp_read_write 142.72ms 138.56ms -4.16ms 0.971x PASS
ac_reads oltp_point_select 47.27ms 47.36ms +92us 1.002x PASS
ac_reads oltp_range_select 12.84ms 12.63ms -205us 0.984x PASS
ac_reads oltp_sum_range 12.79ms 12.66ms -134us 0.990x PASS
ac_reads oltp_order_range 3.04ms 3.05ms +10us 1.003x PASS
ac_reads oltp_distinct_range 4.03ms 4.01ms -20us 0.995x PASS
ac_reads oltp_index_scan 7.31ms 7.40ms +92us 1.013x PASS
ac_reads select_random_points 13.76ms 13.68ms -81us 0.994x PASS
ac_reads select_random_ranges 5.92ms 5.81ms -110us 0.981x PASS
ac_reads covering_index_scan 6.50ms 6.59ms +88us 1.014x PASS
ac_reads groupby_scan 33.55ms 33.40ms -153us 0.995x PASS
ac_reads index_join 9.78ms 9.67ms -112us 0.989x PASS
ac_reads index_join_scan 5.29ms 5.07ms -216us 0.959x PASS
ac_reads types_table_scan 1.17s 1.17s -3.62ms 0.997x PASS
ac_reads table_scan 1.30s 1.30s +52us 1.000x PASS
ac_reads oltp_read_only 141.64ms 143.01ms +1.37ms 1.010x PASS
ac_writes oltp_bulk_insert_ac 315.36ms 104.64ms -210.72ms 0.332x PASS
ac_writes oltp_insert_ac 149.90ms 121.25ms -28.65ms 0.809x PASS
ac_writes oltp_update_index_ac 136.80ms 121.73ms -15.07ms 0.890x PASS
ac_writes oltp_update_non_index_ac 111.98ms 115.42ms +3.44ms 1.031x PASS
ac_writes oltp_delete_insert_ac 161.52ms 123.32ms -38.20ms 0.764x PASS
ac_writes oltp_write_only_ac 175.47ms 106.37ms -69.10ms 0.606x PASS
ac_writes types_delete_insert_ac 311.75ms 232.12ms -79.64ms 0.745x PASS
ac_writes oltp_read_write_ac 191.70ms 135.34ms -56.35ms 0.706x PASS
textpk details
Section Test Baseline Candidate Delta Ratio Result
mem_reads oltp_point_select 34.81ms 35.72ms +912us 1.026x PASS
mem_reads oltp_range_select 13.64ms 13.79ms +152us 1.011x PASS
mem_reads oltp_sum_range 13.55ms 13.40ms -148us 0.989x PASS
mem_reads oltp_order_range 3.25ms 3.23ms -22us 0.993x PASS
mem_reads oltp_distinct_range 4.31ms 4.29ms -22us 0.995x PASS
mem_reads oltp_index_scan 5.99ms 6.01ms +26us 1.004x PASS
mem_reads select_random_points 20.42ms 20.87ms +458us 1.022x PASS
mem_reads select_random_ranges 5.30ms 5.29ms -17us 0.997x PASS
mem_reads covering_index_scan 4.72ms 4.70ms -22us 0.995x PASS
mem_reads groupby_scan 36.91ms 36.66ms -257us 0.993x PASS
mem_reads index_join 9.37ms 9.49ms +117us 1.012x PASS
mem_reads index_join_scan 5.62ms 5.79ms +172us 1.031x PASS
mem_reads types_table_scan 1.29s 1.29s +3.97ms 1.003x PASS
mem_reads table_scan 1.46s 1.45s -7.03ms 0.995x PASS
mem_reads oltp_read_only 134.69ms 134.04ms -643us 0.995x PASS
mem_writes oltp_bulk_insert 356.03ms 353.90ms -2.13ms 0.994x PASS
mem_writes oltp_insert 39.37ms 39.27ms -103us 0.997x PASS
mem_writes oltp_update_index 143.63ms 144.39ms +755us 1.005x PASS
mem_writes oltp_update_non_index 79.46ms 81.18ms +1.72ms 1.022x PASS
mem_writes oltp_delete_insert 107.78ms 108.14ms +350us 1.003x PASS
mem_writes oltp_write_only 63.21ms 63.44ms +230us 1.004x PASS
mem_writes types_delete_insert 53.54ms 52.15ms -1.39ms 0.974x PASS
mem_writes oltp_read_write 136.88ms 138.03ms +1.15ms 1.008x PASS
file_reads oltp_point_select 56.66ms 56.81ms +149us 1.003x PASS
file_reads oltp_range_select 15.71ms 15.72ms +7us 1.000x PASS
file_reads oltp_sum_range 15.45ms 15.52ms +73us 1.005x PASS
file_reads oltp_order_range 3.45ms 3.45ms +5us 1.001x PASS
file_reads oltp_distinct_range 4.59ms 4.58ms -9us 0.998x PASS
file_reads oltp_index_scan 8.24ms 8.12ms -119us 0.986x PASS
file_reads select_random_points 22.07ms 22.43ms +359us 1.016x PASS
file_reads select_random_ranges 7.48ms 7.46ms -18us 0.998x PASS
file_reads covering_index_scan 6.92ms 6.91ms -2us 1.000x PASS
file_reads groupby_scan 36.90ms 36.73ms -169us 0.995x PASS
file_reads index_join 10.59ms 10.53ms -61us 0.994x PASS
file_reads index_join_scan 5.90ms 6.00ms +106us 1.018x PASS
file_reads types_table_scan 1.23s 1.23s -1.15ms 0.999x PASS
file_reads table_scan 1.36s 1.36s +1.77ms 1.001x PASS
file_reads oltp_read_only 162.68ms 160.83ms -1.85ms 0.989x PASS
file_writes oltp_bulk_insert 363.96ms 363.35ms -616us 0.998x PASS
file_writes oltp_insert 45.45ms 45.43ms -18us 1.000x PASS
file_writes oltp_update_index 153.67ms 153.99ms +316us 1.002x PASS
file_writes oltp_update_non_index 92.60ms 93.82ms +1.23ms 1.013x PASS
file_writes oltp_delete_insert 119.54ms 119.69ms +149us 1.001x PASS
file_writes oltp_write_only 73.42ms 73.62ms +197us 1.003x PASS
file_writes types_delete_insert 60.90ms 60.55ms -357us 0.994x PASS
file_writes oltp_read_write 147.49ms 148.74ms +1.25ms 1.008x PASS
ac_reads oltp_point_select 56.55ms 56.58ms +22us 1.000x PASS
ac_reads oltp_range_select 15.88ms 15.78ms -98us 0.994x PASS
ac_reads oltp_sum_range 15.58ms 15.65ms +73us 1.005x PASS
ac_reads oltp_order_range 3.44ms 3.49ms +55us 1.016x PASS
ac_reads oltp_distinct_range 4.54ms 4.56ms +16us 1.004x PASS
ac_reads oltp_index_scan 8.12ms 8.26ms +135us 1.017x PASS
ac_reads select_random_points 22.24ms 22.23ms -17us 0.999x PASS
ac_reads select_random_ranges 7.51ms 7.47ms -41us 0.995x PASS
ac_reads covering_index_scan 6.98ms 6.91ms -78us 0.989x PASS
ac_reads groupby_scan 36.87ms 36.92ms +49us 1.001x PASS
ac_reads index_join 10.59ms 10.89ms +308us 1.029x PASS
ac_reads index_join_scan 5.86ms 5.89ms +33us 1.006x PASS
ac_reads types_table_scan 1.23s 1.23s -4.15ms 0.997x PASS
ac_reads table_scan 1.36s 1.37s +5.63ms 1.004x PASS
ac_reads oltp_read_only 161.53ms 161.61ms +79us 1.000x PASS
ac_writes oltp_bulk_insert_ac 56.64ms 54.32ms -2.32ms 0.959x PASS
ac_writes oltp_insert_ac 66.66ms 67.49ms +828us 1.012x PASS
ac_writes oltp_update_index_ac 80.86ms 80.97ms +110us 1.001x PASS
ac_writes oltp_update_non_index_ac 63.17ms 63.41ms +234us 1.004x PASS
ac_writes oltp_delete_insert_ac 72.01ms 71.36ms -654us 0.991x PASS
ac_writes oltp_write_only_ac 72.43ms 71.78ms -647us 0.991x PASS
ac_writes types_delete_insert_ac 64.47ms 63.56ms -914us 0.986x PASS
ac_writes oltp_read_write_ac 79.62ms 79.09ms -535us 0.993x PASS
vc details
Section Test Baseline Candidate Delta Ratio Result
vc status_clean_many_tables 91.20ms 91.10ms -100us 0.999x PASS
vc status_dirty_many_tables 94.45ms 94.39ms -61us 0.999x PASS
vc diff_regular_working_one_table 86.15ms 85.87ms -282us 0.997x PASS
vc diff_regular_working_many_tables 99.43ms 99.41ms -18us 1.000x PASS
vc diff_stat_working_many_tables 99.53ms 99.98ms +451us 1.005x PASS
vc diff_schema_working_many_tables 99.87ms 100.20ms +328us 1.003x PASS
vc branch_list_many_branches 23.83ms 23.89ms +53us 1.002x PASS
vc branch_create_delete 25.84ms 25.98ms +140us 1.005x PASS
vc checkout_branch_clean 59.19ms 59.16ms -30us 0.999x PASS
vc merge_data_no_conflicts 31.12ms 31.42ms +293us 1.009x PASS
vc merge_schema_no_conflicts 23.67ms 23.57ms -97us 0.996x PASS
vc merge_data_conflicts 34.85ms 36.04ms +1.19ms 1.034x PASS
vc merge_data_conflicts_with_resolve 34.79ms 35.11ms +316us 1.009x PASS

All relative performance gates passed.

@timsehn
timsehn merged commit 0e6af98 into master Sep 2, 2026
68 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Contract test scripts (storage format / concurrency / sqlite compatibility) are wired into no CI workflow

1 participant

@timsehn