Skip to content

Review all existing tests #353

@mawad-amd

Description

@mawad-amd

Review all existing tests

We like tests but we like tests too much. We have 2,454 tests (see #348 for reference).

Your job: Review the entire test suite and tell us what's redundant, duplicate, unnecessarily time-consuming, or just plain wasteful.

What we want:

A response with:

  • Summary of findings (what's bloated, what's redundant, what's slow)
  • Specific examples of problematic tests with reasoning
  • A plan for reducing test count while maintaining coverage
  • Estimated time/cost savings

No code changes. Just analysis and recommendations.

Tools:

  • Check .github/workflows/ to understand the CI testing structure (60 test matrix jobs across 5 directories, 4 rank configs, 3 install methods)
  • Use gh CLI to check CI run times and patterns from recent PRs (start with Fix DMA-BUF Export/Import with PyTorch Caching Allocator Offsets #348)
  • Look at test execution logs for timing data
  • Dig through the test code in tests/

Give us specific recommendations with reasoning. No handwaving - we need actionable insights.

Metadata

Metadata

Labels

duplicateThis issue or pull request already existsexamplesExamples showcasing Iris APIs and usageirisIris project issuetestUnit/integration test related issues

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions