First the Google spreadsheet is saved as Excel sheet. Then the Excel sheet is opened and saved in CSV format.
Then, YAML files are auto-generated from database.csv using:
$ rm -f data/*yml # this is to make sure that deleted records get removed also in this repository
$ python convert-db.py database.csvThe individual YAML files are combined into one data on the "generated" branch.
This is done automatically upon each push or pull request towards the main
branch using this workflow:
$ python combine-data.py data > data-combined.ymlYou can also do the opposite of the above and split the combined data file
like this (this will write the data files to the folder data, you can change
the name/location):
$ python split-data.py data-combined.yml data