SongKong Jaikoz

SongKong and Jaikoz Music Tagger Community Forum

Duplicates job crashed mid-way / continues to run in background

Hi @paultaylor,

I have that job that was running on my /music_processed/ folder.

Selected Folder : /music_processed
Loaded 1134798 songs for duplicate checking
There are 146969 duplicate keys
219889 Duplicates found and deleted in 10 days 0 hours 13 minutes 6 seconds

After 10 days, and at mid-way, the job was reported as ended.

If I check the logs : tail -f songkong_debug0-0.log

I can see the job actually is still running, and that it is currently processing the P letter.

Extract:

23/01/2023 18.37.26:CET:DeleteDuplicatesLoadFolderWorker:loadFiles:SEVERE: end:/music_processed/Prince and The New Power Generation/Gett Off:6:1160662
23/01/2023 18.37.26:CET:DeleteDuplicatesLoadFolderWorker:loadFiles:SEVERE: start:/music_processed/Prince and The New Power Generation/Money Don't Matter 2 Night:2:1160662
23/01/2023 18.37.39:CET:DeleteDuplicatesLoadFolderWorker:loadFiles:SEVERE: end:/music_processed/Prince and The New Power Generation/Money Don't Matter 2 Night:2:1160664
23/01/2023 18.37.39:CET:DeleteDuplicatesLoadFolderWorker:loadFiles:SEVERE: start:/music_processed/Prince and The New Power Generation/The Morning Papers:2:1160664

I’ve sent you the support files, of course.

Ah, from the code

            //Now waits for files within the folder to be added to duplicate map
            //Limit to 10 days just in case gets into some kind of infinite loop
            boolean result = es.awaitTermination(10, TimeUnit.DAYS);

It was never expected would ever run for this long!

https://jthink.atlassian.net/browse/SONGKONG-2385

haha I get that :wink:

Now, what do I do ? I mean, it was already running for 10 days and only did reach approx. 50%.

As it already did load half of my files, and the process keeps going in the background, should I stop songkong, and restart the task (but then, it will AGAIN scan the first half and I’m loosing 10 days.

Also, do you have a clue why this duplicates task takes so long ?

I would restart because Im not sure it is going to work properly now that has been triggered, should be much quicker since the duplicates already found have been deleted and empty folders deleted.

I already raised this issue https://jthink.atlassian.net/browse/SONGKONG-2376 but have not had chance to look at it yet.

10 day limit fixed in SongKong 8.9 Bleach released 24th January 2023