Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Issue #3579] Update opportunity CSV generation #3682

Merged
merged 3 commits into from
Jan 30, 2025

Conversation

chouinar
Copy link
Collaborator

Summary

Fixes #3579

Time to review: 5 mins

Changes proposed

Remove a few columns from the opportunity CSV extract that shouldn't be used (bad data / duplicative)

For the search endpoint, add a maximum to the page size to prevent someone from using it to fetch everything (if they want that, we have extract files which will be better).

Slight adjustment to CSV writing logic

Cleaned up some old unused pagination code from an earlier implementation

Context for reviewers

For fields removed:

  • Agency == agency code, but been moving us to only use agency code for clarity on what the field actually is, so removing the extra duplicate
  • Agency phone number has bad data and we already removed it from the search API itself

The small adjustment to the CSV writing logic is to have one less iteration over opportunities in the endpoint. No idea if it'll add much performance gain, but will use less memory/cycles for an easy change.

Copy link
Collaborator

@mdragon mdragon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good

@chouinar chouinar merged commit f843338 into main Jan 30, 2025
@chouinar chouinar deleted the chouinar/3579-update-opp-csv branch January 30, 2025 17:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Identify CSV columns and adjust API response
4 participants