Air conditioning failure

Posté le samedi 29 mars 2014, à 13:29 UTC

Almost everything is down due to hosts shutting down in thermal limit, web service is still running for now. Secondary services (dns and mx2) are up.

Edit 2014-03-29 13:43 UTC: All disks arrays stopped in thermal limit except one which will follow soon.

Edit 2014-03-29 14:10 UTC: Load balancer reached thermal trip shutdown, everything is down.

Edit 2014-03-29 14:30 UTC: Power switched off to prevent further damages.

Edit 2014-03-29 16:45 UTC: Air conditioning is back, power is back, recovering in progress.

Edit 2014-03-29 17:39 UTC: Recovered, everything should be back online.

Network outage

Posté le mardi 18 mars 2014, à 14:09 UTC

Woops, we are running peacefully in our tiny network island, but this isn't great :-)

Anyway, in less the time to understand what is happening and to write this entry, everything is back to normal.