Rolling Build Infrastructure Outage

In light of the various bustages/instabilities from last week, I will be performing a few sweeping system-wide changes to the build infrastructure at Mozilla Messaging.

What this means is that today, every single build host will be at least stoped+started, and possibly rebooted too.

This should not induce bustage to the Trees, but it does mean that for a certain time window, various builders will be offline, so they won't be picking up new code pushes. For this reason, it was judged safer to hold the Trees closed while this is hapenning. That's Thunderbird, Thunderbird3.0 and Sunbird.

The work will be tracked in bug 474600, where the progress of the outage will be tracked. If you notice problems with builders during that period and you think it's related to this work, add a comment there.

Also, we'll try and keep tree closure to a minimum.

So Long : See you on January 19th

Just a quick note to point out I'll be heading out on vacation tomorrow morning. I am returning to regular active duty on Monday, January 19th.

If, in the meantime, something breaks needs my attention, here are some simple steps to follow:

1. File a bug
2. Determine if it's an emergency. If so, goto step 3, else STOP
3. Ask in #maildev about that bug, and point out it is an emergency

At that point, somebody in there will determine if it's worth paging me for. In the case it is, some magical incantations will be performed, I will be notified/paged, and your bug should get closed.

In the meantime, please, try and not break the trees please.