Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

2.0.4 wmagent #1

Open
wants to merge 122 commits into
base: datamap2
Choose a base branch
from
Open

2.0.4 wmagent #1

wants to merge 122 commits into from

Conversation

khurtado
Copy link
Owner

@khurtado khurtado commented Aug 1, 2022

Rebase

amaltaro and others added 30 commits March 15, 2022 08:28
revert check for existent document
Add the proper activity for the T0-Agent when is subscribing data to Tape_Test rses.
Trying the new map of OS_ARCH

replace slc7 by rhel7

apply Valentins suggestion
Assign the correct activity for Tape_Test RSEs
When ScramArch is empty str/list/None, return any as required_os
If job requires rhel8 container, use slc7 python libraries
Enhance logic to map ScramArch to OS
Signed-off-by: Alan Malta Rodrigues <[email protected]>
Bump WMAgent deployment example to the latest stable version
Remove no longer needed code in the StatusChangeTasks ReqMgr2 thread
update shebang for wmagent-resource script
Support adding diskless resources into the database
Add bin and dependencies to wmcore PyPI package
move ckey/cert functions to Utils.CertTools
Remove PFNs from a final document we send to WMArchive
Signed-off-by: Alan Malta Rodrigues <[email protected]>
amaltaro and others added 30 commits May 19, 2022 07:56
[MSTransferor] Define grouping=ALL for workflows with parents
Signed-off-by: Alan Malta Rodrigues <[email protected]>
[CouchDB] Remove CouchDB all_or_nothing option for bulk API
Fix log message

Typo

Change DAO parsing method.

Include files left behind from previous commit.

Fix docstring

Add blockDeletionDelayHours.

Typo

Pylint changes

Bugfix - missed plural in variable name mapping

Review comments

Review comments 2

Review comments 2
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-PYJWT-2840625
…ckDelition_fix-11042

Split Deletable Blocks checks in two stages.
…83ec072d

[Snyk] Security upgrade pyjwt from 2.3.0 to 2.4.0
Remove CouchDB JobDump/highestJobID view
some of Valentins suggestions

Valentins return suggestion
Avoid raising exception when ReqMgr2 request is not found
Check if key exists when deleting standalone documents in Couch
Signed-off-by: Alan Malta Rodrigues <[email protected]>
… in AgentStatusPoller

Make Couch/replication check compatible between different versions of CouchDB

fix getActiveTasks call

fix isReplicationOK method; evaluate stale replication in the last hour

change replication checks once again
fix unit tests

update unit tests
[CouchDB] New CouchDB 3.x APIs for tracking replications; fix replication check in AgentStatusPoller
Signed-off-by: Alan Malta Rodrigues <[email protected]>
…locks not yet deleted.

Add GetDeletedBlocksByWorkflow DAO to WMBS.

Aggregate all results in the DAO per workflowName

Add extra protection for T0 at cleanCouchPoller

Typo

Update docstrings and log messages

Remove redundant statements:

Remove redundant range() start argument

Remove redundant pass statement

Remove redundant DISTINCT statement

Typo

Add CountUndeletedBlocksByWorkflow DAO && Decrease execution complexity in workflows with undeleted blocks check.

Change log level to info.

remove keynames remapping from GetDeletedBlocksByWorkflow DAO

Pylint fixes.

Review fixes
…chiveDelay_fix-11154

Add extra protection for T0 to prevent archival of workflows having blocks not yet deleted
Signed-off-by: Alan Malta Rodrigues <[email protected]>
Use RequestDBWriter with couch credentials

Fix replication to use credentials on both source/target

New Couch status 410; replace temp view by permanent one

Fix RotatingDatabase class in CMSCouch - temp view

Keep sanitizing url in Requests class

only add replication sleep time for unittest replications

do not allow cmsweb couchdb databases to be deleted

log replication doc deletion and creation in AgentStatusPoller

Create parameter for seconds to sleep after replication is created

fix docstring
Bundle of patches for WMAgent 2.0.4.patch1
Signed-off-by: Alan Malta Rodrigues <[email protected]>
Load credentials when saving spec file in local workqueue - wmagent branch
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants