My update is running at long last (we'll how long it takes to get through 152K files). I'm hoping that my experience in doing this project will help others who go down asimilar path.
The most annoying part of the whole process was the last: getting the import to run. The problems were not with Yate, but rather with data transparency.
Yate (correctly) wants UTF-8 encoded input. Although both Excel and LibreOffice can export TSV files, neither of them can do so as UTF-8 encoded (Apple's Numbers was ruled out due to file size considerations. As a result, my data (and filenames, which are also part of the dataset) needed to have commas converted to something innocuous; I chose the tilde(~) as it did not occur anywhere in the data.
The second problem was quotes in the data; these confused a parser during the import so also had to be converted; I chose the carat (^) character.
Here is where I put in a plug for the Mac utility A Better Finder Rename, which made the process of replacing tens of thousands of characters reasonably painless.
Several steps remain when the import is done:
* load all my files into Yate and turn the ~s and ^s back into commas and double quotes
* use A Better Finder Rename to do the same to my files
* take a fresh backup of my library. There have been several times in the course of this project that having a backup saved my bacon (I actually have 4 levels of backup, but that's another story.
* rebuild my Plex and Audirvana libraries with the new metadata.
Did I mention making sure you have backups? I did, but I will say it again.
Thanks to Barry for Yate and for his assistance during this project.
Stu
|