Skip to content

Run test-suite in CIs#116

Merged
pi8027 merged 2 commits intomath-comp:masterfrom
proux01:cis-test-suite
May 14, 2025
Merged

Run test-suite in CIs#116
pi8027 merged 2 commits intomath-comp:masterfrom
proux01:cis-test-suite

Conversation

@proux01
Copy link
Copy Markdown
Collaborator

@proux01 proux01 commented May 10, 2025

Once we work again on MC master, we should probably merge this so that various CIs do run the test-suite.

ring/field expressions before applying the proof procedures."""

build: [make "-j%{jobs}%"]
build: [make "-j%{jobs}%" "build"]
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is wrong for two reasons:

  • This file is auto-generated from meta.yml.
  • There is a run-test field below. What's written in this build field should not run the test suite.

Copy link
Copy Markdown
Member

@pi8027 pi8027 May 10, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, wait. Did you change the behavior of make to run the test suite? (Well, that looks wrong anyway.)
How does that run the test suite in the CI of MathComp and Rocq opam archive?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file is auto-generated from meta.yml.

Right, we have to set the make_target variable there apparently.

How does that run the test suite in the CI of MathComp and Rocq opam archive?

I don't know about the OPAM archive CI but we'll get it into Rocq's own CI and all the nix based one (including MC) which is the most important.

Copy link
Copy Markdown
Member

@pi8027 pi8027 May 10, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Although I agree that we should run the test suite in Rocq and MathComp CI, that should be done on the CI side, not by tweaking the default make target.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unfortunately, doing this requires some non trivial work (otherwise it would already have been done for long). Meanwhile, I prefer having something that "looks wrong" than something potentially broken without us even noticing. Note that the proposed Makefile scheme is not so exotic, at least elpi and HB are doing something similar.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suggest discussing it tomorrow.

@proux01 proux01 marked this pull request as ready for review May 10, 2025 20:38
@pi8027 pi8027 merged commit 9d17d45 into math-comp:master May 14, 2025
6 checks passed
@proux01 proux01 deleted the cis-test-suite branch May 14, 2025 08:20
SkySkimmer added a commit to SkySkimmer/rocq that referenced this pull request May 14, 2025
It seems to break on some test: https://gitlab.inria.fr/coq/coq/-/jobs/5738407
~~~
COQNATIVE examples/from_sander.vo
Fatal error: exception Stack overflow
~~~

(I think the test wasn't run until math-comp/algebra-tactics#116)
SkySkimmer added a commit to SkySkimmer/rocq that referenced this pull request May 14, 2025
It seems to break on some test: https://gitlab.inria.fr/coq/coq/-/jobs/5738407
~~~
COQNATIVE examples/from_sander.vo
Fatal error: exception Stack overflow
~~~

(I think the test wasn't run until math-comp/algebra-tactics#116)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants