Alright the downtime was NOT an April Fools joke. Here is what happened.
- At around 4AM EST, our machine crashed. An emergency Xen Hypervisor update was installed on the machine and it was brought online.
- Our VPS never started, and had issues mounting the disk.
- It was determined that the VPS kernel did not properly support the newest version of the Xen Hypervisor, so we downgraded it and the VPS was able to start again.
- Main VPS had kernel updated to the latest stable release.
- MySQL server refused to start, and after viewing the logs, major corruption was responsible for the server being unable to start.
- Quickly restored backups of the MySQL databases, and rebuilt the InnoDB logs, bringing the server back online.
Sorry about the downtime. I promise it wasn't my fault!
Recommended Comments
Please sign in to comment
You will be able to leave a comment after signing in
Sign In Now