| Author |
Message |
caker
Joined: 15 Apr 2003
Posts: 2392
Location: Galloway, NJ
|
| Posted: Mon May 03, 2004 3:50 pm Post subject: Hurricane Electric Power Loss - 2004-05-03 |
|
|
Looks like HE lost power to everything. I'm still working on bringing the hosts back online. Shouldn't be too long.
I'll post more details when I know more.
-Chris |
|
| Back to top |
|
Quik
Joined: 17 Sep 2003
Posts: 124
|
| Posted: Mon May 03, 2004 4:43 pm Post subject: |
|
|
Quote: The engineers at Hurricane Electric were required to perform an emergency maintenance procedure on their UPS system and a complete loss of power occurred during the maintenance. More than likely the event was directly related to the UPS maintenance...
One step up from knocking power cables out of hosts :( |
|
| Back to top |
|
caker
Joined: 15 Apr 2003
Posts: 2392
Location: Galloway, NJ
|
| Posted: Mon May 03, 2004 5:30 pm Post subject: |
|
|
All of the hosts have been back online for a while now, along with all the Linodes. This is the response I received from Hurricane Electric:
Quote: We were performing routine maint on UPS and we experienced a glitch. We are currently working on the issue
Hopefully, no more power suprises...
On a related note, I took this opportunity to upgrade all of the hosts (not the Linodes) at HE (host9 and up) to 2.6 kernel.
Thanks,
-Chris |
|
| Back to top |
|
marcus
Joined: 03 May 2004
Posts: 4
|
| Posted: Mon May 03, 2004 5:35 pm Post subject: |
|
|
Thanks again, caker for your quick response to this situation.
I especially appreciated how I could go to the forums and immediatly see why my linode was down, and then again when the problem had been corrected.
Great service as always! |
|
| Back to top |
|
mastabog
Joined: 03 Apr 2004
Posts: 64
|
| Posted: Mon May 03, 2004 6:05 pm Post subject: |
|
|
| I second that :) Thanks for the great service. |
|
| Back to top |
|
rfinnie
Joined: 03 May 2004
Posts: 13
|
| Posted: Mon May 03, 2004 6:49 pm Post subject: |
|
|
caker wrote: On a related note, I took this opportunity to upgrade all of the hosts (not the Linodes) at HE (host9 and up) to 2.6 kernel.
I came home about 5 minutes after my linode came back up and 1) noticed my screen session was dead, 2) noticed the uptime of 5 minutes, then 3) looked at /proc/cpuinfo and noticed the host was now on 2.6. Of course my first thought is "damn, why is he doing this in the MIDDLE OF THE DAY?" Then I noticed this thread. Oops. :)
Anyways, thanks for the quick action. |
|
| Back to top |
|
bji
Joined: 27 Aug 2003
Posts: 182
|
| Posted: Mon May 03, 2004 7:15 pm Post subject: |
|
|
caker wrote:
On a related note, I took this opportunity to upgrade all of the hosts (not the Linodes) at HE (host9 and up) to 2.6 kernel.
When do we get to have a power outage at ThePlanet, so that we can get Linux 2.6 on all of the hosts there too???
Just a comment on HE - for a tier 1 provider, they seem to have many more issues (DOS attacks, networking outages, power loss, etc) than ThePlanet, which is listed as a Tier 2 provider ...
Bryan |
|
| Back to top |
|
sweh
Joined: 13 Apr 2004
Posts: 234
|
| Posted: Tue May 04, 2004 5:55 am Post subject: Re: Hurricane Electric Power Loss - 2004-05-03 |
|
|
caker wrote: Looks like HE lost power to everything.
How very odd.... On Saturday Level3 lost power to one of their facilities where I have other hosts co-lo'd. It's a conspiracy, I tell you! They're out to get me!! |
|
| Back to top |
|
caker
Joined: 15 Apr 2003
Posts: 2392
Location: Galloway, NJ
|
| Posted: Wed May 05, 2004 1:21 am Post subject: Re: Hurricane Electric Power Loss - 2004-05-03 |
|
|
sweh wrote: How very odd.... On Saturday Level3 lost power to one of their facilities where I have other hosts co-lo'd. It's a conspiracy, I tell you! They're out to get me!!
I love a good conspiracy. Which Level3 datacenter was it?
-Chris |
|
| Back to top |
|
sweh
Joined: 13 Apr 2004
Posts: 234
|
| Posted: Wed May 05, 2004 6:08 am Post subject: Re: Hurricane Electric Power Loss - 2004-05-03 |
|
|
caker wrote: Which Level3 datacenter was it?
Somewhere in New York. It wasn't actually where my machines are, but it was the site where the ISP's DS3s terminate (for some reason that router was on AC power rather than DC) causing a total outage. |
|
| Back to top |
|
caker
Joined: 15 Apr 2003
Posts: 2392
Location: Galloway, NJ
|
| Posted: Wed May 05, 2004 11:57 pm Post subject: |
|
|
bji wrote: When do we get to have a power outage at ThePlanet, so that we can get Linux 2.6 on all of the hosts there too???
I'm planning on rebooting at least host5 (maybe host3 and host6, too) this coming Monday evening. I'll post the announcement tomorrow...
-Chris |
|
| Back to top |
|
| |
