-
Notifications
You must be signed in to change notification settings - Fork 52
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding metabox tests to packaging (Infra) #960
Conversation
c3d52ef
to
bb03eae
Compare
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #960 +/- ##
=======================================
Coverage 39.19% 39.19%
=======================================
Files 315 315
Lines 34898 34898
Branches 5972 5972
=======================================
Hits 13679 13679
Misses 20608 20608
Partials 611 611
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
This test makes sure that the current packaging driver is applicable for a specific os version.
bb03eae
to
4f63223
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just one major comment, the rest you can take it or leave it
Co-authored-by: Massimiliano <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1, ty, keep in mind that possible followup
* Added new metabox test for packaging versions This test makes sure that the current packaging driver is applicable for a specific os version. * Added assert in file * Fixed run_manage and assert_in_file actions * Cleaned previous implementation of the tests * Apply suggestions from code review Co-authored-by: Massimiliano <[email protected]> * Applied the rest of the PR comments * Added a Xenial scenario --------- Co-authored-by: Massimiliano <[email protected]>
* Added new metabox test for packaging versions This test makes sure that the current packaging driver is applicable for a specific os version. * Added assert in file * Fixed run_manage and assert_in_file actions * Cleaned previous implementation of the tests * Apply suggestions from code review Co-authored-by: Massimiliano <[email protected]> * Applied the rest of the PR comments * Added a Xenial scenario --------- Co-authored-by: Massimiliano <[email protected]>
Description
As a followup to #909, We have implemented a new metabox tests that checks that a "packaging.pxu" file produces the correct output "substvar" file with the propper dependencies.
This new test takes a more E2E approach as suggested. Now, we run the test directly from the scenario without having to all any external python script. For that purpose, we have added two new more actions:
Resolved issues
Closes https://warthogs.atlassian.net/browse/CHECKBOX-1156
Documentation
No changes to the documentation
Tests
To run the tests:
metabox configs/local-source-18.04.py --tag packaging
: the test should not pass in bionicmetabox configs/local-source-20.04.py --tag packaging
: the test should pass in focalmetabox configs/local-source-22.04.py --tag packaging
: the test should pass in jammy