Conversation
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #1642 +/- ##
==========================================
+ Coverage 71.35% 71.46% +0.11%
==========================================
Files 429 430 +1
Lines 63779 63954 +175
==========================================
+ Hits 45509 45707 +198
+ Misses 18270 18247 -23
🚀 New features to boost your workflow:
|
Clippy Allow Annotation ReportComparing clippy allow annotations between branches:
Summary by Rule
Annotation Counts by File
Annotation Stats by Crate
About This ReportThis report tracks Clippy allow annotations for specific rules, showing how they've changed in this PR. Decreasing the number of these annotations generally improves code quality. |
BenchmarksComparisonBenchmark execution time: 2026-03-13 17:05:31 Comparing candidate commit f131d99 in PR branch Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 2 unstable metrics.
|
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 88.892µs | 89.266µs ± 0.288µs | 89.234µs ± 0.061µs | 89.301µs | 89.497µs | 89.650µs | 92.931µs | 4.14% | 10.426 | 130.013 | 0.32% | 0.020µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [89.226µs; 89.306µs] or [-0.045%; +0.045%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | 190.586ns | 192.779ns ± 1.875ns | 192.606ns ± 1.283ns | 193.616ns | 196.139ns | 198.984ns | 201.277ns | 4.50% | 1.286 | 2.418 | 0.97% | 0.133ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | [192.519ns; 193.039ns] or [-0.135%; +0.135%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | 729.259µs | 732.854µs ± 1.394µs | 732.957µs ± 0.971µs | 733.792µs | 735.042µs | 735.949µs | 736.101µs | 0.43% | -0.020 | -0.410 | 0.19% | 0.099µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample2_frames_x1000 | execution_time | [732.661µs; 733.047µs] or [-0.026%; +0.026%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | 144.524µs | 146.537µs ± 1.712µs | 146.286µs ± 0.557µs | 146.860µs | 148.084µs | 154.128µs | 162.397µs | 11.01% | 5.538 | 42.100 | 1.17% | 0.121µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | [146.300µs; 146.774µs] or [-0.162%; +0.162%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.896µs | 3.916µs ± 0.005µs | 3.916µs ± 0.002µs | 3.917µs | 3.920µs | 3.925µs | 3.966µs | 1.28% | 6.132 | 54.146 | 0.14% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 252152797.687op/s | 255345881.600op/s ± 345965.333op/s | 255381349.834op/s ± 103180.582op/s | 255480149.202op/s | 255591297.225op/s | 255677307.107op/s | 256675419.416op/s | 0.51% | -6.056 | 53.428 | 0.14% | 24463.443op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 79.599µs | 80.014µs ± 0.080µs | 80.014µs ± 0.043µs | 80.049µs | 80.131µs | 80.191µs | 80.421µs | 0.51% | 0.162 | 6.078 | 0.10% | 0.006µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12434537.136op/s | 12497817.222op/s ± 12434.468op/s | 12497737.285op/s ± 6649.254op/s | 12504961.656op/s | 12515299.704op/s | 12521677.466op/s | 12562985.786op/s | 0.52% | -0.138 | 6.085 | 0.10% | 879.250op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 67.832µs | 67.940µs ± 0.069µs | 67.936µs ± 0.038µs | 67.974µs | 68.026µs | 68.077µs | 68.557µs | 0.91% | 3.736 | 30.956 | 0.10% | 0.005µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 14586406.868op/s | 14718952.847op/s ± 14816.484op/s | 14719826.258op/s ± 8200.086op/s | 14728009.856op/s | 14736931.313op/s | 14741000.384op/s | 14742244.309op/s | 0.15% | -3.679 | 30.288 | 0.10% | 1047.684op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.896µs | 3.915µs ± 0.003µs | 3.915µs ± 0.001µs | 3.917µs | 3.920µs | 3.923µs | 3.938µs | 0.58% | 0.978 | 17.873 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 253958489.674op/s | 255405186.608op/s ± 206251.686op/s | 255434486.259op/s ± 91380.506op/s | 255515405.885op/s | 255599189.075op/s | 255638797.874op/s | 256682827.396op/s | 0.49% | -0.932 | 17.801 | 0.08% | 14584.197op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 64.592µs | 64.694µs ± 0.049µs | 64.687µs ± 0.034µs | 64.726µs | 64.780µs | 64.829µs | 64.864µs | 0.27% | 0.692 | 0.414 | 0.08% | 0.003µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 15416930.495op/s | 15457395.439op/s ± 11696.030op/s | 15458978.827op/s ± 8150.430op/s | 15465470.630op/s | 15473923.190op/s | 15476171.390op/s | 15481717.640op/s | 0.15% | -0.687 | 0.404 | 0.08% | 827.034op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 45.470µs | 45.736µs ± 0.106µs | 45.740µs ± 0.067µs | 45.803µs | 45.911µs | 45.957µs | 45.977µs | 0.52% | -0.209 | -0.092 | 0.23% | 0.007µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 21749977.356op/s | 21864601.877op/s ± 50486.559op/s | 21862503.635op/s ± 32154.069op/s | 21895096.046op/s | 21959422.197op/s | 21986050.402op/s | 21992606.467op/s | 0.60% | 0.222 | -0.087 | 0.23% | 3569.939op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.592µs | 6.632µs ± 0.011µs | 6.635µs ± 0.004µs | 6.639µs | 6.645µs | 6.648µs | 6.650µs | 0.23% | -1.302 | 1.469 | 0.17% | 0.001µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 150371189.637op/s | 150792202.166op/s ± 252838.597op/s | 150710993.347op/s ± 99865.490op/s | 150879231.478op/s | 151293511.403op/s | 151600398.411op/s | 151688644.431op/s | 0.65% | 1.310 | 1.498 | 0.17% | 17878.389op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.900µs | 3.915µs ± 0.002µs | 3.915µs ± 0.001µs | 3.916µs | 3.919µs | 3.921µs | 3.922µs | 0.17% | -0.710 | 7.149 | 0.06% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 255001025.396op/s | 255431217.919op/s ± 158838.387op/s | 255443323.189op/s ± 89349.374op/s | 255527942.841op/s | 255636662.040op/s | 255689830.362op/s | 256433812.917op/s | 0.39% | 0.726 | 7.246 | 0.06% | 11231.570op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 65.609µs | 65.725µs ± 0.048µs | 65.729µs ± 0.033µs | 65.757µs | 65.798µs | 65.833µs | 65.856µs | 0.19% | -0.044 | -0.307 | 0.07% | 0.003µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15184580.485op/s | 15214940.460op/s ± 11007.941op/s | 15213986.208op/s ± 7644.435op/s | 15223379.589op/s | 15232547.841op/s | 15238800.723op/s | 15241730.863op/s | 0.18% | 0.048 | -0.308 | 0.07% | 778.379op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 53.366µs | 53.431µs ± 0.033µs | 53.426µs ± 0.019µs | 53.446µs | 53.489µs | 53.537µs | 53.548µs | 0.23% | 0.936 | 1.349 | 0.06% | 0.002µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 18674720.637op/s | 18715775.514op/s ± 11554.818op/s | 18717322.778op/s ± 6512.963op/s | 18723425.869op/s | 18731697.861op/s | 18734459.199op/s | 18738673.942op/s | 0.11% | -0.931 | 1.336 | 0.06% | 817.049op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.895µs | 3.915µs ± 0.003µs | 3.915µs ± 0.001µs | 3.916µs | 3.919µs | 3.921µs | 3.924µs | 0.23% | -1.503 | 14.376 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 254845836.223op/s | 255417776.874op/s ± 175660.129op/s | 255428390.651op/s ± 83078.840op/s | 255507888.808op/s | 255633747.578op/s | 255734065.462op/s | 256724859.979op/s | 0.51% | 1.532 | 14.602 | 0.07% | 12421.047op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 50.162µs | 50.215µs ± 0.027µs | 50.213µs ± 0.016µs | 50.231µs | 50.257µs | 50.293µs | 50.341µs | 0.25% | 0.883 | 2.100 | 0.05% | 0.002µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 19864512.109op/s | 19914217.037op/s ± 10573.077op/s | 19915142.574op/s ± 6301.158op/s | 19920881.232op/s | 19929168.447op/s | 19932882.140op/s | 19935276.139op/s | 0.10% | -0.878 | 2.079 | 0.05% | 747.629op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 45.491µs | 45.743µs ± 0.104µs | 45.744µs ± 0.072µs | 45.816µs | 45.899µs | 45.972µs | 46.009µs | 0.58% | -0.067 | -0.297 | 0.23% | 0.007µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 21735028.957op/s | 21861563.312op/s ± 49724.612op/s | 21860833.053op/s ± 34312.035op/s | 21893451.123op/s | 21948263.490op/s | 21968877.039op/s | 21982284.086op/s | 0.56% | 0.079 | -0.299 | 0.23% | 3516.061op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.595µs | 6.632µs ± 0.010µs | 6.635µs ± 0.004µs | 6.638µs | 6.644µs | 6.646µs | 6.651µs | 0.25% | -1.162 | 1.141 | 0.15% | 0.001µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 150346499.363op/s | 150791235.433op/s ± 227205.477op/s | 150718783.272op/s ± 88449.053op/s | 150870697.367op/s | 151238316.393op/s | 151373574.107op/s | 151639820.356op/s | 0.61% | 1.170 | 1.166 | 0.15% | 16065.853op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.916µs; 3.917µs] or [-0.019%; +0.019%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255297934.132op/s; 255393829.068op/s] or [-0.019%; +0.019%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [80.003µs; 80.025µs] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12496093.924op/s; 12499540.520op/s] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [67.930µs; 67.949µs] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [14716899.425op/s; 14721006.269op/s] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.915µs; 3.916µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255376602.108op/s; 255433771.108op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [64.687µs; 64.701µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [15455774.481op/s; 15459016.396op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [45.722µs; 45.751µs] or [-0.032%; +0.032%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [21857604.925op/s; 21871598.829op/s] or [-0.032%; +0.032%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.630µs; 6.633µs] or [-0.023%; +0.023%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [150757161.168op/s; 150827243.163op/s] or [-0.023%; +0.023%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.915µs; 3.915µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255409204.446op/s; 255453231.392op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [65.718µs; 65.731µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15213414.866op/s; 15216466.055op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [53.426µs; 53.435µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [18714174.127op/s; 18717376.900op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.915µs; 3.916µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255393432.070op/s; 255442121.678op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [50.212µs; 50.219µs] or [-0.007%; +0.007%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [19912751.710op/s; 19915682.364op/s] or [-0.007%; +0.007%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [45.728µs; 45.757µs] or [-0.032%; +0.032%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [21854671.959op/s; 21868454.665op/s] or [-0.032%; +0.032%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.630µs; 6.633µs] or [-0.021%; +0.021%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [150759746.939op/s; 150822723.927op/s] or [-0.021%; +0.021%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 13.003ms | 13.038ms ± 0.020ms | 13.035ms ± 0.008ms | 13.047ms | 13.061ms | 13.077ms | 13.241ms | 1.57% | 5.451 | 50.515 | 0.15% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [13.036ms; 13.041ms] or [-0.021%; +0.021%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 32.374µs | 33.191µs ± 1.156µs | 32.452µs ± 0.049µs | 34.783µs | 35.183µs | 35.248µs | 36.005µs | 10.95% | 0.922 | -1.067 | 3.47% | 0.082µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [33.030µs; 33.351µs] or [-0.483%; +0.483%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 14.673ms | 14.725ms ± 0.030ms | 14.722ms ± 0.014ms | 14.735ms | 14.790ms | 14.828ms | 14.923ms | 1.36% | 2.365 | 10.475 | 0.20% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [14.721ms; 14.729ms] or [-0.028%; +0.028%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 4.949µs | 5.033µs ± 0.045µs | 5.023µs ± 0.028µs | 5.051µs | 5.105µs | 5.110µs | 5.111µs | 1.76% | 0.372 | -0.963 | 0.89% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.027µs; 5.039µs] or [-0.124%; +0.124%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.167µs | 3.157µs ± 1.430µs | 2.987µs ± 0.023µs | 3.008µs | 3.325µs | 13.794µs | 15.129µs | 406.42% | 7.521 | 57.123 | 45.16% | 0.101µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [2.959µs; 3.356µs] or [-6.275%; +6.275%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 205.053µs | 205.845µs ± 0.582µs | 205.677µs ± 0.342µs | 206.208µs | 207.009µs | 207.582µs | 208.053µs | 1.16% | 1.204 | 1.384 | 0.28% | 0.041µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 4806468.832op/s | 4858059.073op/s ± 13688.966op/s | 4861984.045op/s ± 8088.027op/s | 4867598.685op/s | 4873633.533op/s | 4875562.734op/s | 4876782.810op/s | 0.30% | -1.188 | 1.325 | 0.28% | 967.956op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 18.553µs | 18.670µs ± 0.098µs | 18.640µs ± 0.024µs | 18.669µs | 18.897µs | 19.030µs | 19.173µs | 2.86% | 2.439 | 6.293 | 0.52% | 0.007µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 52156793.931op/s | 53562078.904op/s ± 277483.847op/s | 53647263.790op/s ± 69738.016op/s | 53702765.904op/s | 53790955.177op/s | 53836278.511op/s | 53898777.183op/s | 0.47% | -2.402 | 6.068 | 0.52% | 19621.071op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.674µs | 10.806µs ± 0.047µs | 10.807µs ± 0.034µs | 10.838µs | 10.884µs | 10.929µs | 10.941µs | 1.24% | 0.031 | -0.079 | 0.44% | 0.003µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 91400535.286op/s | 92542647.260op/s ± 404836.464op/s | 92533337.065op/s ± 288631.493op/s | 92884679.069op/s | 93150229.927op/s | 93399996.153op/s | 93687266.184op/s | 1.25% | -0.006 | -0.090 | 0.44% | 28626.261op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [205.764µs; 205.926µs] or [-0.039%; +0.039%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [4856161.914op/s; 4859956.232op/s] or [-0.039%; +0.039%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [18.657µs; 18.684µs] or [-0.073%; +0.073%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [53523622.312op/s; 53600535.497op/s] or [-0.072%; +0.072%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.799µs; 10.813µs] or [-0.061%; +0.061%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [92486540.820op/s; 92598753.701op/s] or [-0.061%; +0.061%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | 3.423ms | 3.462ms ± 0.042ms | 3.447ms ± 0.010ms | 3.461ms | 3.570ms | 3.612ms | 3.634ms | 5.43% | 2.209 | 4.262 | 1.22% | 0.003ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2598 | execution_time | [3.456ms; 3.467ms] or [-0.169%; +0.169%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 49.334ms | 49.606ms ± 0.622ms | 49.509ms ± 0.050ms | 49.568ms | 49.683ms | 52.935ms | 55.673ms | 12.45% | 7.521 | 60.686 | 1.25% | 0.044ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [49.520ms; 49.692ms] or [-0.174%; +0.174%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 493.379µs | 494.244µs ± 0.751µs | 494.191µs ± 0.234µs | 494.406µs | 494.837µs | 495.182µs | 503.396µs | 1.86% | 9.145 | 108.432 | 0.15% | 0.053µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1986506.763op/s | 2023297.693op/s ± 3034.568op/s | 2023509.129op/s ± 958.930op/s | 2024567.167op/s | 2025779.827op/s | 2026444.327op/s | 2026839.407op/s | 0.16% | -9.023 | 106.447 | 0.15% | 214.576op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 370.587µs | 371.199µs ± 0.282µs | 371.174µs ± 0.174µs | 371.356µs | 371.748µs | 371.976µs | 372.077µs | 0.24% | 0.565 | 0.339 | 0.08% | 0.020µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2687615.421op/s | 2693974.003op/s ± 2045.057op/s | 2694157.380op/s ± 1259.820op/s | 2695396.389op/s | 2697091.295op/s | 2697716.787op/s | 2698423.909op/s | 0.16% | -0.561 | 0.332 | 0.08% | 144.607op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 167.313µs | 167.660µs ± 0.316µs | 167.612µs ± 0.079µs | 167.694µs | 167.918µs | 169.799µs | 170.104µs | 1.49% | 5.616 | 37.069 | 0.19% | 0.022µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5878750.096op/s | 5964483.951op/s ± 11139.715op/s | 5966173.600op/s ± 2802.429op/s | 5968515.111op/s | 5972331.300op/s | 5975920.779op/s | 5976816.069op/s | 0.18% | -5.573 | 36.646 | 0.19% | 787.697op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 37.125µs | 37.293µs ± 0.055µs | 37.299µs ± 0.038µs | 37.333µs | 37.371µs | 37.395µs | 37.441µs | 0.38% | -0.397 | -0.028 | 0.15% | 0.004µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26708969.485op/s | 26814641.121op/s ± 39221.582op/s | 26810632.408op/s ± 27645.576op/s | 26839819.287op/s | 26883582.393op/s | 26902049.245op/s | 26936342.767op/s | 0.47% | 0.405 | -0.022 | 0.15% | 2773.385op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 45.400µs | 45.627µs ± 0.129µs | 45.619µs ± 0.109µs | 45.732µs | 45.824µs | 45.874µs | 45.893µs | 0.60% | 0.071 | -1.065 | 0.28% | 0.009µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 21789968.431op/s | 21917138.075op/s ± 62012.889op/s | 21920589.512op/s ± 52200.524op/s | 21967805.209op/s | 22010929.798op/s | 22024127.379op/s | 22026604.222op/s | 0.48% | -0.064 | -1.067 | 0.28% | 4384.973op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [494.140µs; 494.348µs] or [-0.021%; +0.021%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [2022877.131op/s; 2023718.255op/s] or [-0.021%; +0.021%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [371.160µs; 371.238µs] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2693690.578op/s; 2694257.428op/s] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [167.616µs; 167.704µs] or [-0.026%; +0.026%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5962940.093op/s; 5966027.808op/s] or [-0.026%; +0.026%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.286µs; 37.301µs] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26809205.387op/s; 26820076.855op/s] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [45.609µs; 45.645µs] or [-0.039%; +0.039%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [21908543.685op/s; 21925732.465op/s] or [-0.039%; +0.039%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 161.064µs | 161.712µs ± 0.285µs | 161.656µs ± 0.131µs | 161.818µs | 162.143µs | 162.878µs | 163.213µs | 0.96% | 2.118 | 7.482 | 0.18% | 0.020µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [161.672µs; 161.751µs] or [-0.024%; +0.024%] | None | None | None |
Group 16
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | 4.129ms | 4.133ms ± 0.007ms | 4.132ms ± 0.001ms | 4.134ms | 4.137ms | 4.142ms | 4.220ms | 2.12% | 11.727 | 152.006 | 0.16% | 0.000ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| profile_add_sample_frames_x1000 | execution_time | [4.132ms; 4.134ms] or [-0.022%; +0.022%] | None | None | None |
Group 17
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 18.060µs | 25.764µs ± 9.380µs | 18.599µs ± 0.428µs | 33.972µs | 43.235µs | 43.742µs | 65.890µs | 254.26% | 0.889 | 0.148 | 36.32% | 0.663µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [24.464µs; 27.064µs] or [-5.046%; +5.046%] | None | None | None |
Group 18
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.305µs | 2.388µs ± 0.023µs | 2.387µs ± 0.004µs | 2.396µs | 2.422µs | 2.451µs | 2.456µs | 2.87% | -0.973 | 4.116 | 0.95% | 0.002µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.385µs; 2.391µs] or [-0.132%; +0.132%] | None | None | None |
Group 19
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | f131d99 | 1773416604 | julio/rd-week-dynamic-pipeline |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 245.720ns | 254.030ns ± 10.589ns | 249.810ns ± 2.887ns | 255.708ns | 284.288ns | 286.101ns | 286.875ns | 14.84% | 1.970 | 2.838 | 4.16% | 0.749ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [252.562ns; 255.497ns] or [-0.578%; +0.578%] | None | None | None |
Baseline
Omitted due to size.
Artifact Size Benchmark Reportaarch64-alpine-linux-musl
aarch64-unknown-linux-gnu
libdatadog-x64-windows
libdatadog-x86-windows
x86_64-alpine-linux-musl
x86_64-unknown-linux-gnu
|
Create actions workspace to share and build code for repo actions: * Move code from clippy-annotation-reporter to ci-shared crate. * Port code from changed-crates bash script to changed-crates binary inside ci-crates. * Create affected-crates binary to compute dependency graph and get affected crates by the PR. * Modify lint workflow to manage affected crates.
d33ce6c to
089947d
Compare
This comment has been minimized.
This comment has been minimized.
7e53a10 to
34635e3
Compare
# What does this PR do? A brief description of the change being made with this pull request. # Motivation What inspired you to submit this pull request? # Additional Notes Anything else we should know when reviewing? # How to test the change? Describe here in detail how the change can be validated.
# What does this PR do? Remove the `github.event_name == 'pull_request'` checks # Motivation What inspired you to submit this pull request? # Additional Notes Anything else we should know when reviewing? # How to test the change? Describe here in detail how the change can be validated.
56bf633 to
91b03cc
Compare
91b03cc to
a434e47
Compare
8265042 to
0e12df0
Compare
What does this PR do?
Makes all CI workflows dynamic — they detect which crates were changed/affected by a PR and only run jobs for those crates, skipping everything on pushes to
mainwhere nothing changed.Key changes
New
crates-reportercomposite action (replaceschanged-crates)cargo-metadatato detect changed crates and compute transitive dependants (affected crates), giving a richer output:crates,affected_crates,crates_count,affected_crates_count,statusci-sharedlibrary crate provides shared logic (git,workspace,crate_detection,github_output) reused across multiple action binariesCargo.toml/Cargo.lockworkspace at.github/actions/replaces per-action workspacestest.yml— unit tests now only run on affected packages (direct + transitive dependants), not the full workspace. Thecross-centos7job was made dynamic: it builds the nextest command conditionally based on$PACKAGES/$CRASHTRACKER_FEATUREfrom the setup stagetest-ffi.yml(new, split fromtest.yml) — FFI jobs extracted into their own workflow, also driven by the setup stage; only runs when-fficrates are affectedlint.yml—rustfmtnow runs only on directly changed crates;clippyruns on affected crates (since a change can introduce warnings in dependants)miri.yml— Miri now runs only on affected crates on PRs; still runs--workspaceon pushes tomainfuzz.yml— fuzz jobs now filter to only the fuzz-capable crates that were affectedMotivation
Previously, every PR triggered CI jobs against the entire workspace regardless of what changed. With the current approach:
cargo-metadataResults
The new pipeline has been tested with two crates. libdd-common which is a foundational crate and has a lot of transitive dependencies (almost all workspace) and libdd-data-pipeline-ffi which only has one transitive dependency.