There is a reported cooling issue from the Dallas Data centre which is affecting our US servers. Below are updates from the data centre. We expect services to be restored soon.
At approximately 15:06 pacific time our NOC began to see machines dropping offline in our Dallas, TX location. We are investigating
UPDATE 15:13 pacific time. We are seeing high temperatures on core network devices, we are continuing to investigate.
UPDATE 15:43 pacific time. We are seeing high temperatures across many devices that are still online. We suspect that there is an HVAC issue with the facility, and we have reached out to the facility. We are also ensuring our own on-call technicians are enroute. Further updates will be posted when information is available. All appropriate resources have been engaged.
UPDATE 15:52 pacific time. Facilities personnel have arrived at the datacenter and CRAC units are being re-energized, as well as additional rooftop units. It will take approximately 30 minutes to cool down the facility to levels that are acceptable for servers to power up without damage. Further updates will be posted when information is available.
UPDATE 16:25 pacific time. The facility is cooling off, however still too warm to begin powering equipment back up (currently approximately 89* F on the DC floor). We estimate approximately 15 minutes more until the facility is at acceptable temperatures to begin powering equipment back up.
UPDATE 16:43 pacific time. The facility has reached approximately 80* F, we will begin slowly powering services back up.
