First real post here, figured this was as good a place as any for some status updates from the past month or so. These usually go on IRC or Twitter, but Patreon needs some love too, right? ;)
The new E-Hentai Index finished catching up about a week ago. 100% coverage. Started in April, but took way longer than expected due to rate limits~
We are preparing to add the first batch of ~35 Million images from the Twitter accounts of known artists as the base for a new index. This won't be a proper Twitter index, as we don't have a good way to keep things up to date and coverage is very very limited, but it could still come in handy. We plan to add more as it is collected.
DeviantArt is caught up again after sitting with old data for a couple years.
Nico Nico Seiga indexing failed a couple months ago, but was fixed a couple days ago and is now caught up again.
Indexing of pixiv was briefly affected by their implementation of Cloudflare, but is now working properly again and caught up.
We are in the process of building a new ArtStation index and FurAffinity Index. FA will probably take a few more months (going very slooooow) but if all goes well ArtStation will be searchable in a couple weeks.
Next items on the list are probably restarting a few of the paused/incomplete indexes like Medibang and FAKKU, and fixing holes in the Anime coverage such as Movies and OVAs from the past year or so.
The schedule is pretty much up in the air, and we're open to suggestions on what sites to work on. No guarantees of course though, and remember that we focus on sites which are likely to be sources, or which can be relied on to provide key information for finding the source.
I don't have anything cool to show at the moment, but I have attached a graph of the io load on one of the index servers and of the query load on one of the metadata servers. Might be amusing to someone, who knows~
Edit: And how could I forget, Last Wednesday, the 21st was SauceNAO's 12th Birthday! How the time flies...
stalkerg
2020-11-20 08:43:33 +0000 UTC