Notice of Scheduled Maintenance Window

Service Affected: All VPS Servers

Maintenance Type: Software upgrade

Impact of Work: Minimal downtime, but intermittent slow speeds are likely throughout the maintenance window. Server reboots may be necessary during this maintenance window. Do not plan for the OnApp Control Panel to be available during this maintenance window.

Start Date: 03/30/2014

Start Time: 11:00 PM CDT (GMT -5)

End Date: 03/31/2014

End Time: 04:00 AM CDT (GMT-5) 

We are aware of an issue with OnApp currently that is causing some VM's to be offline and not allowing them to start. The issue is being investigated by OnApp support and ourselves and we hope to have a resolution soon.

We apologize for any inconvenience and I'd like to thank you in advance for your patience.

UPDATE @ 11:34 AM CST

Most of the affected VM's have been migrated to other hypervisors and are back online at this time. The root cause of this issue is still being investigated by the OnApp developers.

UPDATE @ 4:30 PM CST

HV8 is being rebooted at this time.

UPDATE @ 4:41 PM CST

All affected VM's are back online. OnApp is still investigating the root cause of the issue.

We are aware of an issue with the Goliath server. The server is currently experiencing an issue which is preventing the server from booting properly. All users on the Goliath server are experiencing downtime associated with this issue.

At the present time we do not have a definitive ETA for resolution of this issue; however, we are working to resolve the issue as quickly as possible. Thank you for your continued patience.

** Update 9:22PM CDT **

The Goliath server is coming back online at this time. Web access should be restored in 10-15 minutes after all services are brought back online.

We encountered a kernel problem when rebooting the system while it was under a SYN flood attack. The reboot was in attempt to re-gain access so we could filter out the attack. During the reboot, a kernel problem was encountered which we then began to troubleshoot. Ultimately we were led to a problem with the underlying software supporting the LVM partitions. After this was corrected we were able to bring the server back online.

We apologize for the extreme amount of downtime on the Goliath server this month. Unfortunately the DDoS attacks have not been able to be filtered as well as we had hoped with the typical methods we use to do so, and the kernel issue today only added further downtime to an already poor situation. We are working around the clock to reduce the impact of incoming DDoS attacks on this server as well as to pinpoint the targeted site so we can relocate it to a different system.

We are happy to announce a number of improvements for Shared & Reseller clients.

We have phased out usage of PHP 5.2 in favor of PHP 5.3. For 99% of customers this should be a transparent change as we have replicated the configuration between the two very closely. If you do run in to any problems, please feel free to let us know and we will help get any issues resolved. For users on the new Helios server, the primary PHP version is 5.4, with 5.3 available via .htaccess setting.

We have finally managed to work out the quirks with PHP Opcode Caching in our shared hosting environment, and we are excited to be rolling out Zend OpCache support to all servers over the next several days. Atlas is already online with the new Zend OpCache module.

We have also improved server security across the board by enabling CageFS for all current hosting systems. This should not have any negative impact on currently running services.

Titan MySQL is offline for emergency maintenance at this time. Expected restoration of most MySQL services is within 30 minutes. InnoDB data will be recovered from backups and take a bit longer to come back online. We expect all maintenance tasks to be completed within 90 minutes. We apologize for this service interruption and thank you for your patience.

3:50PM CDT Update: MySQL service has been restored for all non-InnoDB databases at this time. InnoDB restoration has begun.

4:50PM CDT Update: MySQL InnoDB tables have been restored as of this time. All MySQL services have been restored.