Status update #4 (unittests)

Another update, and the last one. The unittest boxes are back and building right now, that's:

• Linux comm-central check


• Win2k3 comm-central check


• MacOSX 10.4 comm-central check

At this point, Nagios is back to all-green, so everything should be back to normal after this morning exciting failures

Apologies to all those who were affected by this interruption of service

If you still notice something broken, please, hurry up and file a bug about it

Status update #3

Build machines are back in business, not the unittest ones yet. That should include the Lightning build boxes.
Specifically, the following builders are now back and building code:

• cb-sb-win32-tbox:
• tb-linux-tbox
• tbnewref-win32-tbox
• bm-xserve07
• cb-xserve03
• cb-sb-linux-tbox
  

Status update #2

• l10n dashboard is back in business
• l10n buildbot is running and I just forced a re-compare of all 43 locales
  
• buildbot masters are back in business
  

mail-test services are back in business

Status update for users of the mail-test service at mozillamessaging.com.

It's back in business, please don't hesitate to file a bug if you notice anything out of the ordinary.

Houston, we have a problem

There is current some fairly serious and wide-spread outage at the San Jose colo, where our trusty rack is hosted. I am not entirely sure what the extent of the damage is, but one thing is for sure, expect service outages.

On the upside, our website is pretty much the only piece that doesn't seem to be affected, yay! [Update: e-mail @mozillamessaging.com also survived]

On the downside, pretty much everything else was, booo.

I'll post more details as things get themselves sorted out.