DAOS-18301 container: Debug rebuild-destroy tests #17426

liw · 2026-01-23T04:58:38Z

Test-tag: test_ec_online_rebuild
Test-repeat: 3
Skip-unit-tests: true
Skip-unit-test: true
Skip-nlt: true
Skip-fault-injection-test: true

Steps for the author:

Commit message follows the guidelines.
Appropriate Features or Test-tag pragmas were used.
Appropriate Functional Test Stages were run.
At least two positive code reviews including at least one code owner from each category referenced in the PR.
Testing is complete. If necessary, forced-landing label added and a reason added in a comment.

After all prior steps are complete:

Gatekeeper requested (daos-gatekeeper added as a reviewer).

github-actions · 2026-01-23T04:58:54Z

Ticket title is 'erasurecode/online_rebuild.py:EcodOnlineRebuild.test_ec_online_rebuild - timeout during container destroy in teardown'
Status is 'In Progress'
Labels: '2.6.4-aurora.p1,ci_master_weekly,weekly_test'
https://daosio.atlassian.net/browse/DAOS-18301

daosbuild3 · 2026-01-26T05:11:54Z

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/3/execution/node/789/log

daosbuild3 · 2026-01-29T04:52:06Z

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/5/execution/node/789/log

daosbuild3 · 2026-02-02T09:42:42Z

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/6/execution/node/793/log

daosbuild3 · 2026-02-03T15:25:11Z

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/7/execution/node/791/log

daosbuild3 · 2026-02-04T01:31:06Z

Test stage Test RPMs on EL 8.6 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/8/execution/node/617/log

daosbuild3 · 2026-02-04T02:20:56Z

Test stage Test RPMs on EL 8.6 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/9/execution/node/617/log

daosbuild3 · 2026-02-04T06:44:35Z

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/10/execution/node/791/log

daosbuild3 · 2026-02-04T19:46:01Z

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/13/execution/node/787/log

daosbuild3 · 2026-02-05T01:28:35Z

Test stage Build on Leap 15.5 with Intel-C and TARGET_PREFIX completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/14/execution/node/255/log

daosbuild3 · 2026-02-05T01:32:02Z

Test stage Build on EL 8.8 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/14/execution/node/312/log

daosbuild3 · 2026-02-05T01:35:13Z

Test stage Build on EL 9 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/14/execution/node/369/log

daosbuild3 · 2026-02-05T01:35:33Z

Test stage Build on Leap 15.5 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/14/execution/node/376/log

daosbuild3 · 2026-02-05T01:54:57Z

Test stage Build on Leap 15.5 with Intel-C and TARGET_PREFIX completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/15/execution/node/255/log

daosbuild3 · 2026-02-05T05:45:05Z

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos/job/PR-17426/16/display/redirect

daosbuild3 · 2026-02-05T05:45:12Z

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos/job/PR-17426/16/display/redirect

Test-tag: test_ec_online_rebuild Test-repeat: 3 Skip-unit-tests: true Skip-unit-test: true Skip-nlt: true Skip-fault-injection-test: true Signed-off-by: Li Wei <liwei@hpe.com>

daosbuild3 · 2026-02-06T09:43:23Z

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/18/execution/node/787/log

Introduce a simple type-checked vector template to gurt. See D_VEC_DECLARE and D_VEC_DEFINE for its usage. Signed-off-by: Li Wei <wei.g.li@intel.com> Required-githooks: true

daosbuild3 · 2026-02-09T13:56:05Z

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/19/execution/node/791/log

Introduce a non-production reference tracker mechanism for debugging reference counting problems. See d_ref_tracker. This tracking is only compiled in for non-release builds; there should be no performance or memory overhead for release builds. Signed-off-by: Li Wei <liwei@hpe.com>

Test-tag: test_ec_online_rebuild Test-repeat: 3 Skip-unit-tests: true Skip-unit-test: true Skip-nlt: true Skip-fault-injection-test: true Signed-off-by: Li Wei <liwei@hpe.com>

daosbuild3 · 2026-02-10T07:57:25Z

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17426/20/execution/node/791/log

liw force-pushed the liw/cont-destroy-rebuild-test-old branch from 4b98024 to 8b9729f Compare January 28, 2026 08:10

liw force-pushed the liw/cont-destroy-rebuild-test-old branch from 8b9729f to ee22653 Compare February 2, 2026 06:03

liw force-pushed the liw/cont-destroy-rebuild-test-old branch from ee22653 to acfc906 Compare February 3, 2026 08:47

liw force-pushed the liw/cont-destroy-rebuild-test-old branch from acfc906 to a96183b Compare February 4, 2026 01:01

liw force-pushed the liw/cont-destroy-rebuild-test-old branch from a96183b to 678e0d8 Compare February 4, 2026 03:03

liw force-pushed the liw/cont-destroy-rebuild-test-old branch from 678e0d8 to 58fd6f9 Compare February 5, 2026 01:12

liw force-pushed the liw/cont-destroy-rebuild-test-old branch from 58fd6f9 to 7e5fecb Compare February 5, 2026 01:54

DAOS-18301 container: Debug rebuild-destroy tests

021f26d

Test-tag: test_ec_online_rebuild Test-repeat: 3 Skip-unit-tests: true Skip-unit-test: true Skip-nlt: true Skip-fault-injection-test: true Signed-off-by: Li Wei <liwei@hpe.com>

liw force-pushed the liw/cont-destroy-rebuild-test-old branch from 7e5fecb to 021f26d Compare February 5, 2026 07:47

DAOS-14679 gurt: Introduce d_vec

8a86190

Introduce a simple type-checked vector template to gurt. See D_VEC_DECLARE and D_VEC_DEFINE for its usage. Signed-off-by: Li Wei <wei.g.li@intel.com> Required-githooks: true

liw force-pushed the liw/cont-destroy-rebuild-test-old branch from 7dbc51f to 4177fcf Compare February 10, 2026 00:42

Track ds_cont_child

042d3b5

Test-tag: test_ec_online_rebuild Test-repeat: 3 Skip-unit-tests: true Skip-unit-test: true Skip-nlt: true Skip-fault-injection-test: true Signed-off-by: Li Wei <liwei@hpe.com>

liw force-pushed the liw/cont-destroy-rebuild-test-old branch from 4177fcf to 042d3b5 Compare February 10, 2026 07:54

DAOS-18301 container: Debug rebuild-destroy tests #17426

Are you sure you want to change the base?

DAOS-18301 container: Debug rebuild-destroy tests #17426

Uh oh!

Conversation

liw commented Jan 23, 2026

Steps for the author:

After all prior steps are complete:

Uh oh!

github-actions bot commented Jan 23, 2026

Uh oh!

daosbuild3 commented Jan 26, 2026

Uh oh!

daosbuild3 commented Jan 29, 2026

Uh oh!

daosbuild3 commented Feb 2, 2026

Uh oh!

daosbuild3 commented Feb 3, 2026

Uh oh!

daosbuild3 commented Feb 4, 2026

Uh oh!

daosbuild3 commented Feb 4, 2026

Uh oh!

daosbuild3 commented Feb 4, 2026

Uh oh!

daosbuild3 commented Feb 4, 2026

Uh oh!

daosbuild3 commented Feb 5, 2026

Uh oh!

daosbuild3 commented Feb 5, 2026

Uh oh!

daosbuild3 commented Feb 5, 2026

Uh oh!

daosbuild3 commented Feb 5, 2026

Uh oh!

daosbuild3 commented Feb 5, 2026

Uh oh!

daosbuild3 commented Feb 5, 2026

Uh oh!

daosbuild3 commented Feb 5, 2026

Uh oh!

daosbuild3 commented Feb 6, 2026

Uh oh!

daosbuild3 commented Feb 9, 2026

Uh oh!

daosbuild3 commented Feb 10, 2026

Uh oh!

Reviewers

Assignees

Labels

Milestone

Development

Uh oh!

2 participants