So, I’ve got good news.
The way we’ve been maintaining the configuration and doing identity management on the SURRO and SILO servers is outdated and abismal. In fact, someone found an injection exploit in one of our wordpresses.
So, I’ve brought in FreeIPA, a great IDM system to manage the users, and we’re going to use it for everything.
I’ve brought in a CI system that will kick off CM scripts we’ve written to maintain the configuration of everything else.
I’ve brought in a monitoring and alerting system that will monitor all the servers and services and send me annoying emails when stuff goes off.
I also brought in some DR steps that I won’t be disclosing.
Over the weekend you’ll see services pop up and go down as I set these up to be just a tad bit more reliable without breaking the bank.