Add dcas error handling #385
Conversation
☂️ Python Coverage
Overall Coverage
New FilesNo new covered files... Modified FilesNo covered modified files...
|
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #385 +/- ##
==========================================
+ Coverage 94.29% 94.30% +0.01%
==========================================
Files 250 250
Lines 14087 14116 +29
==========================================
+ Hits 13283 13312 +29
Misses 804 804 ☔ View full report in Codecov by Sentry. |
| @@ -92,6 +92,10 @@ | |||
| # Run everyday at 00:15 UTC | |||
| 'schedule': crontab(minute='15', hour='00'), | |||
| }, | |||
| 'log-farms-without-messages': { | |||
There was a problem hiding this comment.
@osundwajeff we can trigger the task right after pipeline (PR #373), so we don't need to make this as periodic task. Could you also change the task to receive request_id instead of request_date? Thank you,,
|
@osundwajeff could you also add the export to csv/excel from the django admin page? maybe add it as another new ticket. |
| ) | ||
|
|
||
| # Query farms without messages | ||
| df = DataQuery.get_farms_without_messages(parquet_path) |
There was a problem hiding this comment.
can we also do chunks query to avoid loading all the data into memory? it's to ensure the scalability when there are a lot of farms with missing messages
Fix: #317