Should TestOnPR.yml run more tests?

[lucaferranti]

Description

In the current setup, two yaml files to run CI tests are generated

• Test.yml: Runs on multiple OSs and julia versions (assuming the user chooses to do so of course)
• TestOnPRs.yml: only runs on latest julia version and ubuntu (even if user selects multiple OSs and julia versions)

What is the rationale for this choice?

To me, would make more sense to run the whole matrix both on main and on PR. The motivation for this is that if a PR introduces an OS-dependent problem (for example, it's not rare for packages using wrappers of C-libraries to fail only on windows) I would prefer to catch this before merging the PR to main.

[abelsiqueira]

This should be an option, indeed. The rationale is faster development based on the Tulipa project, where running on 1.6+Windows was taking ~2x than latest+Ubuntu.
I've also had requests to run the TestOnPRs on a matrix, and let the user decide the matrix (which is a bit harder with a template, but feasible with manual intervention).