This week has been a bit of a slog. I harvested the references for all publications regarding ascidians for the last 20 years. That was the easy part.
The hard part was sanitizing this data. I started doing it manually, but after about and hour your brain switches off and you make more mistakes than you are fixing.
So I wrote a quick and dirty program to sanitize the references. There were about 5 versions of it, each one sorting out another weird case.
The result is that it now takes about 10 minutes to process 100 references where it used to take about 2 hours.
Next week I have to write a program to import and merge these references into our ascidian database. Should be fun!
Posts
No comments:
Post a Comment