Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
host02 outage (6/14/2016)
#5
Here's the e-mail we received from the data center for those interested in the reason for the outage.

Quote:We are recovering from a failure related to a lightening strike that damaged the majority of the electrical infrastructure of the building hosting more of our infrastructure. After nearly 72 hours on generator, our UPS powering the A side of our servers, the batteries ran flat, due to a failure in the generator electrical heads. After the last 8 hours, after switching over 100A of 3 phase from battery to gensets, and back due to the generators cycling output as the heads overheated, the decision was made to power down the servers that provide all the Denver infrastructure powering your service, in order to save the data. We are in the process of replacing some gigantic relays, transfer switches, and restoring critical infrastructure. We have managed to get clean utility power to the UPS over the last 4 hours, and after allowing the batteries to charge, we are powering on servers. We hope to recover without any loss of data. When your looking at 1-2TB of cached data, and no clear idea of when the power will be restored, we rather gently lay the beast down, rather than a straight power cut.

Sorry for the problems - We are working to resolve them. Please standby for a more formal announcement, but rest assured, we are doing our best to recover all instances and data without problem. Some of these servers are running already, and we are working out recovering some massive data sets.


Messages In This Thread
host02 outage (6/14/2016) - by KuJoe - 06-14-2016, 06:42 PM
RE: host02 outage (6/14/2016) - by KuJoe - 06-17-2016, 03:21 PM
RE: host02 outage (6/14/2016) - by klvnhng - 06-17-2016, 08:40 PM
RE: host02 outage (6/14/2016) - by ehab - 06-18-2016, 05:45 AM
RE: host02 outage (6/14/2016) - by KuJoe - 06-19-2016, 02:45 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  cPanel service outage KuJoe 1 2,294 04-07-2017, 11:08 PM
Last Post: Dark
  host02 failure KuJoe 2 4,334 07-22-2016, 09:56 AM
Last Post: RockV
  host02 replaced KuJoe 3 4,975 06-29-2016, 06:20 PM
Last Post: Dark
  host02 outage KuJoe 2 4,562 06-14-2016, 06:40 PM
Last Post: KuJoe
  host01 outage (10/17/2015) KuJoe 6 9,708 10-18-2015, 03:27 AM
Last Post: bersy



Users browsing this thread: 1 Guest(s)
Advertisement: