20230804-minutes.md

S3 Working Group Minutes

Friday, 2023/08/04

3:00 pm ET

Attendees:

Terrell Russell, Kory Draughn, Justin James, Illyoung Choi (CyVerse), Mike Conway (NIEHS)

Minutes

DISCUSSION

• Native C++ S3 Implementation

  • Better packaged, still depends on unreleased iRODS 4.3.1
    • Newer boost 1.81 (boost::url)
    • New API - rc_switch_user()
      • irods/irods_client_s3_api#12
      • DEMO FRIDAY!
  • Tested with a few clients
    • Boto-based python application - working, so far
    • Minio-based python application - wrong endpoint / generating stacktrace
    • Minio-client (mc) - some success, some failures
    • AWS cli - not working, HMAC signature mismatch
  • Need more eyeballs / S3 handshake knowledge welcome
    • Different authentication algorithms
  • Can we just switch on server version?
    • Use rc_switch_user()
    • Regular, slower implementation
    • Could talk to iRODS 4.2.x

• Next Meeting

  • Sept 2023

• After meeting

  • Using mc --debug, was able to send some additional headers
  • ./mc ls and ./mc cp worked!