Outage today

[Dan Brosemer <odin@svartalfheim.net>]

We had a bad outage today.  Web was down for about an hour, email backed up
(and has come through, we lost nothing there), and all connectivity at the
office.

The cause was a failed router.  Jim responded immediately by getting another
of our machines online to take over, but it was set up under emergency
conditions, so it's not right.  We will need to take it down in a planned
situation later to get things right.  With any luck, this can wait until I
return home.

We had plans to replace this router for a few months, but as it's core
infrastructure and if it's not done right, I lose my ability to remote admin
(and therefore continue setting it up), I decided to wait until returning
home.  We hobbled along on the old router (which was on its last leg) until
today.

I think we have core functionality returned, but it is very much not set up
right.  It's fragile, and it will fall over in a strong wind.  Please join
me in crossing our fingers that it will last "long enough"(tm).  Please let
me know of any strangeness that's occurring.  I may have missed some things.
return home.

I want to thank Josh for stepping up and pointing me in the direction that
got the web site back online while I was too stressed to catch my mistake.
He'll be a huge asset to the organization.

-Dan

-- 
"Burnished gallows set with red
 Caress the fevered, empty mind
 Of man who hangs bloodied and blind
 To reach for wisdom, not for bread."  -- Deoridhe Grimsdaughter