Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add new e2e-monitoring test to library-go #57664

Merged

Conversation

dgrisonnet
Copy link
Member

New test added in openshift/library-go#1823

Signed-off-by: Damien Grisonnet <[email protected]>
@openshift-ci-robot
Copy link
Contributor

[REHEARSALNOTIFIER]
@dgrisonnet: the pj-rehearse plugin accommodates running rehearsal tests for the changes in this PR. Expand 'Interacting with pj-rehearse' for usage details. The following rehearsable tests have been affected by this change:

Test name Repo Type Reason
pull-ci-openshift-library-go-master-e2e-monitoring openshift/library-go presubmit Presubmit changed

Prior to this PR being merged, you will need to either run and acknowledge or opt to skip these rehearsals.

Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 5 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 10 rehearsals
Comment: /pj-rehearse max to run up to 25 rehearsals
Comment: /pj-rehearse auto-ack to run up to 5 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse abort to abort all active rehearsals
Comment: /pj-rehearse network-access-allowed to allow rehearsals of tests that have the restrict_network_access field set to false. This must be executed by an openshift org member who is not the PR author

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

@dgrisonnet
Copy link
Member Author

/pj-rehearse ack

@openshift-ci-robot
Copy link
Contributor

@dgrisonnet: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-ci-robot openshift-ci-robot added the rehearsals-ack Signifies that rehearsal jobs have been acknowledged label Oct 9, 2024
@rexagod
Copy link
Member

rexagod commented Oct 9, 2024

/pj-rehearse ack

@openshift-ci-robot
Copy link
Contributor

@rexagod: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@deads2k
Copy link
Contributor

deads2k commented Oct 9, 2024

make sure this runs prior to merge. Feel free to release after.

/approve
/hold

@openshift-ci openshift-ci bot added do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. approved Indicates a PR has been approved by an approver from all required OWNERS files. labels Oct 9, 2024
@dgrisonnet
Copy link
Member Author

/pj-rehearse pull-ci-openshift-library-go-master-e2e-monitoring

@openshift-ci-robot
Copy link
Contributor

@dgrisonnet: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@p0lyn0mial
Copy link
Contributor

ci/rehearse/openshift/library-go/master/e2e-monitoring is green.

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Oct 11, 2024
Copy link
Contributor

openshift-ci bot commented Oct 11, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: deads2k, dgrisonnet, p0lyn0mial

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@p0lyn0mial
Copy link
Contributor

/hold cancel

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Oct 11, 2024
@rexagod
Copy link
Member

rexagod commented Oct 11, 2024

/hold

Did the test actually run?

make: Nothing to be done for 'test-e2e-monitoring'.

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Oct 11, 2024
@dgrisonnet
Copy link
Member Author

Did the test actually run?

make: Nothing to be done for 'test-e2e-monitoring'.

This is the expected result, it ran but we just added a placeholder Makefile rule (openshift/library-go#1829)

@rexagod
Copy link
Member

rexagod commented Oct 14, 2024

ACK, apologies for blocking the original PR, and PLMK if I'm missing something here, but shouldn't the integration tests actually run on PRs and actively block them if they fail? This is in line with the fact that vetting master currently fails for encryption_test.go as that signature was changed, but uncaught. Despite this being a compilation error rather than a logical one, I'd root for an integration suite that runs these tests over a go vet step (over a placeholder step).

cc @p0lyn0mial

@dgrisonnet
Copy link
Member Author

ACK, apologies for blocking the original PR, and PLMK if I'm missing something here, but shouldn't the integration tests actually run on PRs and actively block them if they fail?

Yes but we don't really need to run them if the code path hasn't been touched.

Despite this being a compilation error rather than a logical one, I'd root for an integration suite that runs these tests over a go vet step

If the reason was logical it would be flagged by the integration test since the code path would be touched. But here it is just a compilation error that can easily be caught once we try to update the dependency in one of the consumer, we don't really need to run the integration suite for that?

@dgrisonnet
Copy link
Member Author

dgrisonnet commented Oct 14, 2024

The placeholder step is just here because pj-rehearse doesn't support targeting a specific PR. We have to first merge the PR here with a test that is never failing and then update the rule in the library-go PR to test the code and verify that the new integration test works.

@dgrisonnet
Copy link
Member Author

/unhold

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Oct 14, 2024
@openshift-merge-bot openshift-merge-bot bot merged commit b3e29d3 into openshift:master Oct 14, 2024
15 of 16 checks passed
josecastillolema pushed a commit to josecastillolema/release that referenced this pull request Oct 15, 2024
* config/library-go: add monitoring-e2e test

Signed-off-by: Damien Grisonnet <[email protected]>

* jobs: regenerate

Signed-off-by: Damien Grisonnet <[email protected]>

---------

Signed-off-by: Damien Grisonnet <[email protected]>
@rexagod
Copy link
Member

rexagod commented Oct 15, 2024

Ah, I see, the integration tests have been split up into separate targets so they can be run lazily based on the related codepath changes. However, it seems the e2e-encryption suite had its rule here added later on as it's still just a placeholder, but I'll send a patch to fix it, thanks for the clarification!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged. rehearsals-ack Signifies that rehearsal jobs have been acknowledged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants