So it is a semi-automated process. Each stage is automated but we cannot do the whole thing in one go as we need to check the results since the external feeds of data can change causing issues, for example in 2024 there was six months where the monthly discogs data dump was broken, and twice a year MusicBrainz make changes to their database schema, then there are issues with having enough space for the ever increasing database (the largest part being the Acoustid part)
- Create New Database
- Import Discogs db
- Import MusicBrainz db
- Import Acoustid Database
- Create Acoustid Reports
- Create addtional tables based on data (e.g Albunack Ids)
- Create Search Index from database
- Deploy Search Index as WebService
So if everything ran fine the whole process would take one week, but this also depends on me being available after each stage to check the results, and this is not the case because I’m either away, asleep or busy working on something else.

is there any way to invalidate or update the cache ? 

