You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We've started to write Cram-based functional tests for this workflow and associated scripts, but we do not currently run these tests as part of our standard Travis CI.
Description
Not all critical components of the workflow are tested by the minimal CI profile. We should run functional tests along with the current minimal Snakemake run as part of CI.
Possible solution
Naively, we could make this happen by installing Cram with pip and running Cram on all *.t files in the tests/ directory.
Comments in tests/different-inputs.t suggest that Cram should be run with cram --preserve-env tests/different-inputs.t.
In practice, the "different inputs" test takes >8 minutes to run, more than we typically prefer for CI tests. Maybe we could pare these tests down to more minimal versions that test the same logic?
The text was updated successfully, but these errors were encountered:
#671 started down this road, but using GitHub Actions, it'd be great to pick this up. (I'd prefer we move to one CI runner where possible, but that's part of a bigger discussion.)
Context
We've started to write Cram-based functional tests for this workflow and associated scripts, but we do not currently run these tests as part of our standard Travis CI.
Description
Not all critical components of the workflow are tested by the minimal CI profile. We should run functional tests along with the current minimal Snakemake run as part of CI.
Possible solution
Naively, we could make this happen by installing Cram with pip and running Cram on all
*.t
files in thetests/
directory.Comments in
tests/different-inputs.t
suggest that Cram should be run withcram --preserve-env tests/different-inputs.t
.In practice, the "different inputs" test takes >8 minutes to run, more than we typically prefer for CI tests. Maybe we could pare these tests down to more minimal versions that test the same logic?
The text was updated successfully, but these errors were encountered: