After a week or so of tweaking the backend to get it stable and initial buidout of the decoupled API that serves the aggregated content — it’s safe to say that IRCTHULU is production ready.
Not only that, after some research it’s also pretty clear that we’re not just talking about a log aggregator — it’s the world’s largest IRC Log Collection Engine currently.
One thing I’m running into is delay in getting the data from the database due to the size of the tables the logs are stored in.
I may want to set up some jobs that create cached tables periodically to speed that up, but, every piece of action you take to do things like that take away from the realtime nature of the data itself. I’ll have to give it some thought.