Skip to content

Pin python in ci integration tests to prevent intermitent codspeed segfaults in walltime#105

Merged
GuillaumeLagrange merged 1 commit intomasterfrom
cod-2199-pytest-codspeed-segfaults-in-walltime
Feb 6, 2026
Merged

Pin python in ci integration tests to prevent intermitent codspeed segfaults in walltime#105
GuillaumeLagrange merged 1 commit intomasterfrom
cod-2199-pytest-codspeed-segfaults-in-walltime

Conversation

@GuillaumeLagrange
Copy link
Contributor

@GuillaumeLagrange GuillaumeLagrange commented Feb 6, 2026

All observed crashes occured with 3.14.3, although it did not crash all the time.
Pin for now to unblock other PRs, and investigate later

@codspeed-hq
Copy link

codspeed-hq bot commented Feb 6, 2026

Merging this PR will degrade performance by 18.32%

⚡ 10 improved benchmarks
❌ 14 (👁 14) regressed benchmarks
✅ 143 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime test_fs_read[1000] 857.1 ns 795.3 ns +7.77%
👁 WallTime test_threadpool_map[10] 2.5 ms 2.6 ms -2.06%
WallTime test_multiprocessing_map[10000] 101.3 ms 82.1 ms +23.32%
👁 WallTime test_tcp_connection[google.com-443] 1.1 ms 1.2 ms -2.44%
WallTime test_iir_filter_process 3.2 µs 3.1 µs +3.09%
👁 WallTime test_multiprocessing_map[1000] 57 ms 69.8 ms -18.32%
👁 WallTime test_noop_lambda_decorated 1.3 µs 1.4 µs -8.62%
👁 WallTime test_recursive_fibo_20 5.5 ms 5.8 ms -5.28%
👁 WallTime test_combination_sum[candidates0-8] 11.8 µs 12.1 µs -2.71%
👁 WallTime test_open_knight_tour[1] 4 µs 4.1 µs -2.94%
👁 WallTime test_tcp_connection[1.1.1.1-53] 834.6 µs 1,001.5 µs -16.67%
WallTime test_multiprocessing_map[100] 54.2 ms 53.1 ms +2.01%
👁 WallTime test_noop_pass 483.4 ns 506.5 ns -4.56%
👁 WallTime test_make_highshelf 7.7 µs 7.9 µs -2.58%
👁 WallTime test_make_bandpass 5.9 µs 6.1 µs -3.54%
WallTime test_array_alloc[100] 1.2 µs 1.1 µs +7.91%
WallTime test_sum_of_squares[sum_of_squares_sum_comprehension_power] 227.1 µs 218.2 µs +4.09%
WallTime test_noop_pass_decorated 748 ns 729 ns +2.61%
WallTime test_make_highpass 5.9 µs 5.8 µs +2.67%
👁 WallTime test_multiprocessing_map[100000] 192.2 ms 231.8 ms -17.08%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing cod-2199-pytest-codspeed-segfaults-in-walltime (c3a194a) with master (adee8a1)

Open in CodSpeed

@GuillaumeLagrange GuillaumeLagrange force-pushed the cod-2199-pytest-codspeed-segfaults-in-walltime branch 4 times, most recently from 6dca575 to a618ede Compare February 6, 2026 14:42
@GuillaumeLagrange GuillaumeLagrange force-pushed the cod-2199-pytest-codspeed-segfaults-in-walltime branch from a618ede to c3a194a Compare February 6, 2026 14:49
@GuillaumeLagrange GuillaumeLagrange marked this pull request as ready for review February 6, 2026 15:05
@GuillaumeLagrange GuillaumeLagrange changed the title Pytest codspeed segfaults in walltime Pin python in ci integration tests to prevent intermitent codspeed segfaults in walltime Feb 6, 2026
@edgarrmondragon
Copy link
Contributor

FWIW Python 3.13.12 is similarly affected:

Works well with 3.13.11, so I pinned to the patch version and opened that PR to confirm. Should I create an issue?

@GuillaumeLagrange
Copy link
Contributor Author

GuillaumeLagrange commented Feb 6, 2026

@edgarrmondragon Thank you very much for the report, I have created the issue where we'll clarify. Please let us know if you find other versions that are affected

@GuillaumeLagrange GuillaumeLagrange merged commit c3a194a into master Feb 6, 2026
36 checks passed
@GuillaumeLagrange GuillaumeLagrange deleted the cod-2199-pytest-codspeed-segfaults-in-walltime branch February 6, 2026 15:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants