<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>Akami, Google, DoD -they all have had serious bgp outages due to
config mistakes.</p>
<p>IF that's what it was...<br>
</p>
<div class="moz-cite-prefix">On 10/4/21 7:35 PM, <a class="moz-txt-link-abbreviated" href="mailto:steve.b@osfda.org">steve.b@osfda.org</a>
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:324664c1-f961-0d46-5538-47e854a4ad8b@osfda.org">
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<p>CTO recently left.</p>
<p>If it's bgp, happens to all of them...<br>
</p>
<div class="moz-cite-prefix">On 10/4/21 5:28 PM, Warner Losh
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CANCZdfp6SFsSE61R6MX=bxHyFjgg6dYzwS7SuOyFfJJegOg7Xw@mail.gmail.com">
<meta http-equiv="content-type" content="text/html;
charset=UTF-8">
<div dir="ltr">The rumors from my side. I've not verified them
all (some are in the twitter feed). We'll see how reliable
this is...
<div><br>
</div>
<div>But, Facebook does all their own tooling, and it's all
down.
<div>Even internal chat. So they are talking directly via
cell phones (system to lookup cell numbers, also down)</div>
<div>The only way that can provision the bgp routes is via
the console of the routers at this point...</div>
<div>... but the internal system to get credentials is also
down.</div>
<div>They also need to get someone in front of the console
to bring things back online...</div>
<div>Their tools to coordinate and meet to come up with a
plan, also down....<br>
</div>
<div><br>
</div>
<div>
<div>Single point of failure in the extreme.<br>
<br>
</div>
</div>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Mon, Oct 4, 2021 at 3:20
PM Michael W. Lucas <<a
href="mailto:mwlucas@michaelwlucas.com"
moz-do-not-send="true">mwlucas@michaelwlucas.com</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex"><br>
<blink> <blink><br>
<br>
That's it. Twitter is the next to go.<br>
<br>
==ml<br>
<br>
<br>
On Mon, Oct 04, 2021 at 04:15:39PM -0400, George Rosamond
wrote:<br>
> One of the cooler things we can all learn from the
Facebook/Instagram/WA <br>
> outage is some technical innovations most of you
probably missed.<br>
> <br>
> <a
href="https://nitter.eu/briankrebs/status/1445077617426718725"
rel="noreferrer" target="_blank" moz-do-not-send="true">https://nitter.eu/briankrebs/status/1445077617426718725</a><br>
> <br>
> Apparently, there are no RFCs for it, but DNS Global
Routing Tables is <br>
> the place to be. Move over blockchain.<br>
> <br>
> g<br>
> <br>
> _______________________________________________<br>
> talk mailing list<br>
> <a href="mailto:talk@lists.nycbug.org" target="_blank"
moz-do-not-send="true">talk@lists.nycbug.org</a><br>
> <a
href="http://lists.nycbug.org:8080/mailman/listinfo/talk"
rel="noreferrer" target="_blank" moz-do-not-send="true">http://lists.nycbug.org:8080/mailman/listinfo/talk</a><br>
<br>
-- <br>
Michael W. Lucas <a href="https://mwl.io/"
rel="noreferrer" target="_blank" moz-do-not-send="true">https://mwl.io/</a><br>
author of: Absolute OpenBSD, SSH Mastery, git commit murder,<br>
Absolute FreeBSD, Immortal Clay, Prohibition Orcs, etc,
etc, etc...<br>
### New books: TLS Mastery, the Networknomicon, $ git sync
murder ###<br>
<br>
_______________________________________________<br>
talk mailing list<br>
<a href="mailto:talk@lists.nycbug.org" target="_blank"
moz-do-not-send="true">talk@lists.nycbug.org</a><br>
<a href="http://lists.nycbug.org:8080/mailman/listinfo/talk"
rel="noreferrer" target="_blank" moz-do-not-send="true">http://lists.nycbug.org:8080/mailman/listinfo/talk</a><br>
</blockquote>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
talk mailing list
<a class="moz-txt-link-abbreviated" href="mailto:talk@lists.nycbug.org" moz-do-not-send="true">talk@lists.nycbug.org</a>
<a class="moz-txt-link-freetext" href="http://lists.nycbug.org:8080/mailman/listinfo/talk" moz-do-not-send="true">http://lists.nycbug.org:8080/mailman/listinfo/talk</a>
</pre>
</blockquote>
</blockquote>
</body>
</html>