nanog mailing list archives

Re: FYI Netflix is down


From: Grant Ridder <shortdudey123 () gmail com>
Date: Sat, 30 Jun 2012 01:09:08 -0500

well one would think that they could at least get power redundancy right...

On Sat, Jun 30, 2012 at 1:07 AM, Roy <r.engehausen () gmail com> wrote:

On 6/29/2012 10:38 PM, jamie rishaw wrote:

you know what's happening even more?

..Amazon not learning their lesson.

they just had an outage quite similar.. they "performed a full audit" on
electrical systems worldwide, according to the rfo/post mortem.

looks like they need to perform a "full and we mean it" audit, and like
I've been doing/participating in at dot coms for a decade plus: Actually
Do
Regular Load tests..

Related/equally to blame: companies that rely heavily on one aws zone, or
arguably "one cloud" (period), are asking for it.

Please stop these crappy practices, people.  Do real world DR testing.
 Play "What If This City Dropped Off The Map" games, because tonight,
parts
of VA infact did.

...


I am not a computer science guy but been around a long time.  Data centers
and clouds are like software.  Once they reach a certain size, its
impossible to keep the bugs out.  You can test and test your heart out and
something will slip by.  You can say the same thing about nuclear reactors,
Apollo moon missions, the NorthEast power grid, and most other technology
disasters.






Current thread: