Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AUTO] Update data #104

Merged
merged 1 commit into from
Nov 9, 2023
Merged

[AUTO] Update data #104

merged 1 commit into from
Nov 9, 2023

Conversation

damianooldoni-bot
Copy link
Contributor

Brief description

This is an automatically generated PR.
The following steps are all automatically performed:

  • Fetch raw data
  • Map raw data to DwC standard and save the output in ./data/processed
  • Get an overview of the changes
  • Run some tests, e.g. check the uniqueness of occurrenceID, check that all occurrences have a eventID and scientificName, ...

Note to the reviewer: the workflow automation is still in a development phase. Please, check the output thoroughly before merging to main. In case, improve the data fecthing fetch_data.Rmd, the mapping dwc_mapping.Rmd, both in ./src or the GitHub workflows fetch-data.yaml and mapping_and_testing.yaml in ./.github/workflows.

Files changed:
M	data/raw/rato_data.csv
@PietrH
Copy link
Member

PietrH commented Nov 9, 2023

Only raw data has changed

@PietrH
Copy link
Member

PietrH commented Nov 9, 2023

The new record in the raw data was removed because of #23 :

Remove occurrences containing multiple type - value pairs information in column waarneming (patch until #23 is solved):

input_data %<>%
  filter(is.na(.data$waarneming) | 
           !str_detect(.data$waarneming, pattern = "; "))

@PietrH PietrH merged commit 3d8d73d into main Nov 9, 2023
1 check passed
@PietrH PietrH deleted the automatic-update-2023-11-09T10-29-44Z branch November 9, 2023 10:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants