✨ jira-permissions-validator: sharding support

[chassing]

Add sharding support to the jira-permissions-validator integration to reduce amount of Jira API calls.

Depends on: app-sre/qontract-schemas#757
Ticket: APPSRE-11408

[rporres]

The code looks fine, what I don't get is the concept. How sharding by board is going to help us?

I'm mainly afraid of how costly is this in resources (we have 50 boards, hence 50 processes running). Have we tried something a bit less costly as static sharding.

Apologies if this has been answered elsewhere...

[chassing]

The code looks fine, what I don't get is the concept. How sharding by board is going to help us?

If the integration hits the rate limit, then just one board is affected. Any retry won't start from the beginning and needs fewer API requests.

I'm mainly afraid of how costly is this in resources (we have 50 boards, hence 50 processes running). Have we tried something a bit less costly as static sharding.

TBH, I don't understand the static sharing concept.

[rporres]

@chassing and I discussed about this in a call. Since we're in bad position with JIRA guys, let's try this (which may be a bit overkill) and in the future maybe look for other solutions like:

• only run PR checks in affected boards
• introduce a random wait per board in the integration and remove per board sharding

For the moment, let's try the overkill solution

[hemslo]

LGTM!