WMAgent production patch release: 2.0.4.patch1
This is a major release upgrade because it's the first WMAgent stable release compatible with CouchDB 3.1 (and dependent on). It also has a few important features and bug-fixes required for data taking and the T0 agent. Lastly, it has the usual and continuous code and stability improvements.
Release date: 16 June 2022.
WMAgent changes since release: 2.0.2
WMAgent
Software stack
- Upgrade CouchDB to 3.1.2, Erlang to 22.3.4.19 (Alan Malta Rodrigues) cms-sw/cmsdist#7218
- Bring dbs3-client version to 4.0.8 (Alan Malta Rodrigues) #11138
- Removed pep8; added pycodestyle 2.8.0; updated pylint to 2.13.5 (Alan Malta Rodrigues) cms-sw/cmsdist#7846
- Update PyJWT from version 2.3.0 to 2.4.0 (snyk-bot) #11155
Features and/or feature changes
- When ScramArch is empty str/list/None, return any as required_os (Alan Malta Rodrigues) #11083
- If job requires rhel8 container, use slc7 python libraries (Alan Malta Rodrigues) #11077
- Support adding diskless resources into the database (Alan Malta Rodrigues) #11097
- Remove PFNs from a final document we send to WMArchive (Valentin Kuznetsov) #10998
- change fallback for missing system xrootd-client (Dirk Hufnagel) #11117
- Remove support for Unpacking user tarballs. No longer used by CRAB. (khurtado) #11114
- Enforce dataset_lifetime column to be integer and not null (Alan Malta Rodrigues) #11115
- speed up listDatasetFileDetails API (Valentin Kuznetsov) #11099
- Add support for IAM token in the underlying pycurl_manager module (Valentin Kuznetsov) #10939
- Split Deletable Blocks checks in two stages. (Todor Ivanov) #11127
- New CouchDB 3.x APIs for tracking replications; fix replication check in AgentStatusPoller (Alan Malta Rodrigues) #11039
- Add extra protection for T0 to prevent archival of workflows having blocks not yet deleted. (Todor Ivanov) #11169
Bug Fixes
- Assign the correct activity for Tape_Test RSEs (Jhonatan Amado) #11067
- [Tier0] Check CMSSW version before getting sim-datatier map (germanfgv) #11110
- Check if key exists when deleting standalone documents in Couch (Alan Malta Rodrigues) #11165
Enhancements
- Enhance logic to map ScramArch to OS (Alan Malta Rodrigues) #11088
- [PY2] Remove cPickle support (Erik Gough) #11096
- Update wmagent deploy script to add opportunistic resources one by one (Alan Malta Rodrigues) #11097
- Minor test json template updates (Alan Malta Rodrigues) #10864
- Add T3_US_Lancium. (Todor Ivanov) #11126
- Add buildAllDep option && Fix package verstion estimation for ParseSpecCmsswdist. (Todor Ivanov) #11132