« Emergency Reboot HV3 (Resolved)Primary Nameserver Down (Resolved) »

Goliath Offline (Resolved)

August 29, 2012 at 9:55 AM

08/29/2012 @ 09:50 AM CST

We are actively working to resolve an issue with Goliath that is causing the server to be offline.

This post will be updated with more information as soon as it becomes available.

08/29/2012 @ 10:15 AM CST

We are seeing a kernel panic on Goliath. We are resolving the kernel issue at this time and we expect the server to be back online within 20 minutes.

08/29/2012 @ 11:15 AM CST

We are still working to resolve the kernel panic issue on the Goliath server. Websites will still appear offline as we work as quickly as possible to restore service. Our apologies for the inconvenience and you have our thanks for your continued patience.

08/19/2012 @ 12:20 PM CST

The root cause of the issue has been identified and corrected at this time. At this time, service has been restored.

More Details

We apologize for the significant downtime this morning. We have just resolved the issue and the system is coming back online at this time. You can expect your website to be accessible immediately.

We identified the issue initially as a kernel panic. Unfortunately, due to some problems with our debugging tools, our recovery time was delayed significantly versus typical similar situations. Once we were able to begin debugging the issue, it was identified as a filesystem configuration error or malfunction. Ultimately it was determined to be a filesystem configuration error on the primary (root) filesystem and it has now been resolved.

We would like to extend our deepest apologies for the downtime today. This downtime could not have been avoided; however, it could have been reduced significantly had our debug & recovery tools been more thoroughly tested prior to this issue. We are making corrections to our internal processes & recovery methods to eliminate extended downtime issues such as what occurred today.

We will offer SLA credits to all customers on the Goliath server upon request, up to 1 month service credit, per our SLA.

I would like to personally thank you for your continued patronage to our business and for your patience and understanding throughout the service outage today.

Regards,

Matt Eli