On May 15th, 2010, between the hours of 4 AM to 6 AM CST, the Los Angeles DC network will be undergoing emergency maintenance to upgrade multiple network switches. We have been informed by the DC to expect two to three outages during the maintenance window, lasting approximately 15-20 minutes each.

This emergency maintenance is aimed at resolving the network issues that have been occurring over the last couple of weeks.

If you have any questions regarding this, please contact us at [email protected].

UPDATE:

This maintenance has been completed.

At approximately 12:30 PM CST the data center in Los Angeles, CA experienced a network and/or power failure. We are aware of this issue and will do everything we can to help resolve this issue as quickly as possible. At the current time we do not have an ETA for service restoration. We will update you as soon as we know more.

If you have any questions, please e-mail us at [email protected].

UPDATE:

Service has been restored at approximately 01:05 PM CST. We are not aware of the cause of today's outage, but we will find out and let you know.

UPDATE:

We've heard back from the data center regarding the cause of the downtime today:

"Todays network issue was related to a faulty switch card which took down one of the vlan routers. Unfortunately the errors in the logs looked to be related to network changes made yesterday and delayed diagnosing the real issue. Once network engineers reversed all changes made yesterday and the network continued having issues the decision was made to swap the card. Once the card initialized and came online traffic began flowing normally again.

In an effort to prevent further issues, we have setup a planed maintenance window for tomorrow morning (Saturday May 14th) between 2AM PST to 4AM PST. During this window there will be two to three service disruptions of 15-20 minutes each as multiple network switches are upgraded."

Greetings fellow geeks!

All servers located in our Chicago, IL data center location will be undergoing a brief maintenance period that will require approximately 15-30 minutes of downtime per server.

The maintenance will consist of moving servers to a different location within the same data center. This move will lay the groundwork for some of our major service enhancements that will begin next month.

We have tentatively scheduled this maintenance period between the dates of 04/28/2010 and 04/30/2010. The move will happen between the hours of 12 AM and 3 AM CST on those dates.

Further updates regarding this maintenance will be posted here.

UPDATE (04/27/2010 @ 11:35 PM CST):

The previously announced maintenance window for the Chicago DC servers has been scheduled between 12:00AM and 3:00AM CST Friday morning (04/30/2010). The downtime per server should be between 15-30 minutes.

We look forward to continuing improvements for our services, stay tuned for many exciting announcements following the server relocation at the Chicago DC!

UPDATE (04/30/2010 @ 02:32 AM CST):

It looks like our initial estimate of 15-30 minutes downtime per server was a little optimistic, at this time we expect service to be restored within 1 hour to all Chicago servers. We apologize for the extended maintenance period and would like to thank everyone for their patience.

UPDATE (04/30/2010 @ 05:50 AM CST):

The maintenance for the Chicago DC servers has completed as of this time, note for users on Node3 you may notice an additional 10-15 minute outage as your quotas are recalculated, we apologize for this inconvenience. Once again we would like to thank everyone for their patience throughout the maintenance this morning.