Backend Performance

[nwmac]

Revisit UI once some performance improvements on the backend are made.

Tracked as:

• Steve should only send back metadata for counts that have changed rancher#36681
  • ✔️ Implemented
• Steve should throttle sending of count metadata rancher#36682
  • ✔️ Implemented
• Steve API should allow specific fields in responses to be excluded rancher#36683
  • ✔️ Implemented
• Steve API should allow resources to be un-watched rancher#36684
  • ✔️ No-op
• Steve should support retrieving resources in a given namespace/project rancher#36685
  • ✔️ No-op
• [RFE] Steve should support pagination with sorting and filtering - Step 1 rancher#38427
  • ✔️ Implemented
• [RFE] Steve should support pagination with sorting and filtering - Step 2 rancher#41075
  • [RFE] Filter resources by multiple projects or namespaces through the API rancher#40140
    • ✔️ Implemented
  • [RFE] Add more advanced filtering options to steve rancher#40141
    • ✔️ Implemented
  • [RFE] Steve pagination: aggregated fields rancher#40771
    • ❓ Pending
  • [RFE] Virtual Resource Type to contain Multiple Resources rancher#40772
    • ❓ Pending
  • SQLite backed cache: smarter WebSockets updates for paginated resources rancher#40773
    • ❓ Pending
  • [BUG] Steve Pagination API Issues rancher#42767
    • ❓ Pending
  • Related [EPIC] Performance: SQLite backed cache & Server-Side Pagination #8527
• [RFE] Steve should support sharing watchers across user sessions (Port from Norman to Steve) rancher#38412
  • ❌ Closed, not implemented
• [RFE] Steve should provide pod data along with list of workloads rancher#38428
  • ❌ Closed, not implemented
• [RFE] Steve should only send schema updates when schemas change rancher#38467
  • ✔️ Implemented
• [RFE] Steve: Improve the performance of resource fetch requests rancher#38468
  • ❌ Closed, not implemented (though should be covered by cache/vai backed api feature)
  • Related Handle reduction of schemas in steve schema requests #7716
• [BUG] resource.start event in websockets does not include namespace parameter rancher#40196
  • ✔️ Implemented
  • Related Sockets subscribe to all resources instead of required namespace filter #7919
• [RFE] Steve: Add debounce logic to websocket rancher#39568
  • ❓ Pending

Requested By BE

• Limit Resources Watched on Norman Websockets #7906

[cbron]

@nwmac to what extent are these required in 2.6.5 ? Is UI planning to do some work around them, and what are those deadlines.

[nwmac]

@cbron We aren't planning on doing any work around them now in 2.6.5 - given the short timeframe we can push them out to next release - but we will need them done early to give us to time to use them in the UI.

The most important one for us is rancher/rancher#36683 - this will allow us to make data retrieval of lists more efficient, if we can exclude large data fields from the response.

[samjustus]

36681 & 38412 are going to be our top priority for 2.7, unless advised otherwise.

[gaktive]

@samjustus Upon discussion with UI based on current needs, along with rancher/rancher#36681 and rancher/rancher#38412 (the latter of which @aalves08 is collecting more data on simultaneous users), we'd ask for rancher/rancher#36682 and rancher/rancher#38467 to be prioritized too.

We'd also like a start on rancher/rancher#38427 since that will be a big help down the road.

[nwmac]

@cbron @samjustus Anything you can do on rancher/rancher#38468 for 2.7? Norman is 3 times quicker than Steve at returning data.

[samjustus]

38427 and #38468 will be our priority for 2.7.1

[samjustus]

@nwmac @gaktive Can you please create Jira issues for all of these? Per the new process Denise outlined in Management meeting today (10/10)

[gaktive]

Internal reference: SURE-5393

[gaktive]

Priority tickets based on current thinking and consensus:
1 with all the stars: rancher/rancher#38427
2. rancher/rancher#38412
3. rancher/rancher#38468

[nwmac]

@gaktive Bumping this to 2.7.2 - this issue is for tracking - there is nothing for us to do in 2.7.1 that is not tracked in other issues.

[gaktive]

Added and/or ported over from Jira:

• [RFE] Filter resources by multiple projects or namespaces through the API rancher#40140
• [RFE] Add more advanced filtering options to steve rancher#40141
• [RFE] Steve pagination: aggregated fields rancher#40771
• [RFE] Virtual Resource Type to contain Multiple Resources rancher#40772
• SQLite backed cache: smarter WebSockets updates for paginated resources rancher#40773

Down the road, this epic should focus on what's deliverable for Q2 with a new epic spawned to then copy work to then tackle in Q3.

[gaktive]

Added rancher/rancher#39568 above upon request.

[richard-cox]

A number of the referenced issues have been closed and not completed, some without comment. Needs investigating

[gaktive]

I'll work on tidying this up with @nwmac when he's back.