My nontechnical co-workers see the Microsoft 365 outage, the FAA ground stop, and things like this as one interconnected problem. They aren't entirely wrong, but the general fear is hard to dismiss
montagg 22 minutes ago [-]
They are at least interconnected in the sense that we are struggling societally to do big, hard things that we could do a decade ago.
Roman citizen wondering why the aqueduct isn’t working kind of thing.
1270018080 2 minutes ago [-]
The thing done today weren't even computationally possible a decade ago. The bar for competitive software is rising exponentially.
hn_throwaway_99 8 minutes ago [-]
The other issue though is that with 24/7 connectivity, any unplanned downtime can feel like a major outage. 50 years ago there were lots of outages, to, but people didn't care as much, they just went outside.
jeremyjh 7 minutes ago [-]
That isn’t something that has changed in the last 10 years.
bongofizzbuzz 19 minutes ago [-]
[flagged]
rogerrogerr 18 minutes ago [-]
What do people mean when they say this?
GenerocUsername 14 minutes ago [-]
They mean there is a large multi-decade conspiracy theory which ties many world events into one cohesive narrative which culminates in a large scale planned destruction of western power structures wherein that controlled demolition scares the proletariat into being accepting of a new world order in which the global currencies are consolidated to a singular digital currency. This shift basically marks the end of individual freedom since nothing short of a uncontrolled global collapse could ever unseat the hedgimony it would create.
NoidFonsense 9 minutes ago [-]
How could the CBDCs possibly be worse than EMV already is? The world of social credit scores and political debanking exists, unless you are buying coke off the darknet with monero.
But for everything else you need, food water shelter healthcare, you need to submit to europay visa mastercard
monegator 16 minutes ago [-]
ending of fight club?
mathfailure 8 minutes ago [-]
They mean you ass of ayyy to finally default.
convolvatron 16 minutes ago [-]
that's not really a good characterization. we have known this was a house of cards for decades. someone just turned on the fan.
DIE_DIE_DIE 13 minutes ago [-]
[dead]
sigmoid10 54 minutes ago [-]
Well, digital centralisation and interdependency without fault hardening is a big problem. Just because it presents itself in slightly different ways across industries doesn't mean it is not a fundamental issue in our society.
philipallstar 45 minutes ago [-]
I don't see much of a problem with depending on AWS or Google Cloud. It's Microsoft who are particularly flaky. And always will be, because IT people choose them regardless.
pwg 34 minutes ago [-]
You are still "centralizing" on "someone else's computer". Just because those two have not, yet, had a MS365 event does not mean they won't have one at some point. And everyone "centralized" there will have a bad day when that happens.
ghusto 21 minutes ago [-]
AWS has had them, and is passed the growing pains. At this point when/if AWS goes down, it will still have a far higher uptime than others could manage, let alone those going it alone.
Microsoft on the other hand, has proven that it will never be reliable.
corranh 41 minutes ago [-]
One team won’t win the cup every year, the issue here is that everyone has picked their favorite while ignoring the risks of the league.
novaleaf 24 minutes ago [-]
Have you tried using Azure? (I have, it is not good)
paavope 34 minutes ago [-]
It’s a tragedy that much of European industry and public sector are so deeply embedded with Microsoft that they barely even consider other options, even when everything Microsoft touches seems terrible
bijowo1676 27 minutes ago [-]
I feel like on-prem Microsoft stack is a very well known and controllable beast.
Its pros/cons are known and gaps can be addressed with 3p software. You just keep on old outdated, but proven version of software and keep the perimeter locked tightly.
its the azure cloud that is the wildcard.
murphyslaw 19 minutes ago [-]
GP isn't talking about on-prem I believe. Small/medium businesses in Europe are much more dependent on MS than their US counterparts. Alternatives are mostly out-of-scope from their point of view.
Don't forget that MS has the advantage of non-English languages support that many alternatives lack.
throwaway7356 22 minutes ago [-]
> I feel like on-prem Microsoft stack is a very well known and controllable beast.
I feel like it is very unknown, there is no documentation and everyone relies on comments on random forums that are now 21 years old which tells to set undocumented registry keys to undocumented values.
esseph 31 minutes ago [-]
> It’s a tragedy that much of European industry and public sector are so deeply embedded with Microsoft
It's not just Europe! :(
zdragnar 38 minutes ago [-]
How quickly we seem to have forgotten how often aws us east went down.
jimbob45 7 minutes ago [-]
They’re expensive and centralized. I always thought the general wisdom was to bootstrap your business with serverless infrastructure and then eventually work your way back to an on-prem-first philosophy. I guess a lot of companies skipped that last step to…save…something?
rsoto2 29 minutes ago [-]
Yeah the FAA didn't see a problem with a single point of failure either look how that went. It's not flaky until it is.
Legend2440 28 minutes ago [-]
>They aren't entirely wrong,
They are entirely wrong.
None of these outages, as far as we know, have a common cause. They just happened by coincidence inside the same news cycle.
Nor is there any evidence to blame them on AI, or tech layoffs, or hackers from Iran. It's more likely something boring and technical that doesn't fit into anyone's narrative.
GoToRO 12 minutes ago [-]
My guess is a total disrespect for actually qualified people. You know, the ones that specialized in one thing, for their whole life. Every company tries to see how few people they can have and still run fine. And move fast. And no trainings. And no recognition for the people that could actually train other people. I think all these come together at some point and you get multiple catastrophic events in multiple industries.
omgwtfbyobbq 10 minutes ago [-]
It could be some people rushing to get code into prod before the holiday freeze, or just a coincidence.
Either way, now that AI is more capable, you can really mess stuff up at scale.
werdnapk 7 minutes ago [-]
Is this how the "AI will lead to the end of the world" type stuff I've been hearing about starts?
14u2c 13 minutes ago [-]
What evidence do you have that staff reduction is not at the root of some of this?
mh- 2 minutes ago [-]
Sorry, are you asking them to prove a negative? They said there was no evidence it was.
tcdent 6 minutes ago [-]
Not trying to be that guy, but they do have a common cause: networked compute.
There are many more systems in the world outside of it, even if it is relatively ubiquitous at this point.
mkjs 3 minutes ago [-]
For years people have been wondering how long companies can continue to cut staff before the wheels start to fall off. Maybe we're starting to find out.
Yours is an easy position to defend though, because it's the kind of thing there will never be any concrete evidence for.
MrGilbert 6 minutes ago [-]
The boring news is that laying off 100th of thousands of IT workers because of a newly promised, never-seen-before technology, does indeed cause trouble. Who'd thought that these people did in fact create value?
mym1990 18 minutes ago [-]
I am assuming you don't have a direct line to each of these outages, and you have no proof that there is no common cause. A common cause could also be something like "poor production deployment practices" or "reliance on AI built software", in which case...maybe they aren't entirely not wrong.
Legend2440 9 minutes ago [-]
It's not my job to prove they aren't related. That's the default; most events are not related.
It's your job to provide evidence they are related, and you have nothing except speculation.
vonneumannstan 5 minutes ago [-]
AI has been finding new critical 0 days at an increasing rate so it's actually not unreasonable to think these might be related.
beambot 18 minutes ago [-]
Where there's smoke...
"As far as we know" just indicates a lack of data, not evidence that they're not related. This is especially relevant for a political administration whose response to COVID was to bury their head in the sand by hiding data. Also: A public comment of "AI is hacking all our shit" wouldn't exactly calm the public.
It's fine to say, "I'll wait until we know more", but in the meantime AI progress continues and the sheer volume of cyber vulnerabilities it's uncovering is undeniable. It's not surprising that some state-sponsored bad actors would be use this as an opportunity to infiltrate too...
Legend2440 13 minutes ago [-]
You also don't have any evidence that they are related.
In the absence of data, you are assigning blame to things you already hate, like AI or the administration. Motivated reasoning is highly prone to error, and it's a form of stupid-brained thinking.
beambot 2 minutes ago [-]
No blame or hate. Just hypotheses with conditional probabilities that will be updated in response to more data...
adrithmetiqa 5 minutes ago [-]
It’s natural to turn to AI based development as one of the causes of the increase in large scale outages.
I prefer to ask a different question. Will all this AI development delivering us amazing new software? Are we just going to get 1000 free clones of Adobe Photoshop or can we expect some really exciting groundbreaking new tools?
Perhaps all the really clever use of AI development is in the pursuit of better AI and if that’s the case, why?
jessyco 27 minutes ago [-]
As a technical person, I tend to find it hard to dismiss as well. What's easier to explain. Someone said it in a comment, someone keeps pushing for the cheaper solution cloud infra was cheaper and now we see the cost of that.
mrtksn 6 minutes ago [-]
I swear nothing works fine anymore, the world feels broken. Maybe those particular incidents are not interconnected directly but they are connected in the ether in the sense that everything is incredibly complicated and precarious.
da_chicken 6 minutes ago [-]
It is an interconnected problem, but it's the problem we're all already aware of. All these businesses and the FAA have gutted their operations teams. There's too much to do, and AI doesn't take less time.
zzzeek 41 minutes ago [-]
they're interconnected in that we're all getting really overloaded by the workload created by AI, and even though we can use AI to get through the workload as well, we humans still have to be aware of everything flying by, and I think things are falling through the cracks more often. These days I work on ten or twenty issues at a time. it's a little nuts
philip1209 29 minutes ago [-]
Internetworking
hparadiz 34 minutes ago [-]
Overall uptime is better than pre internet 9-5. It's so typical to become so used to technology that any disruption seems bad.
hackyhacky 11 minutes ago [-]
Yes, we should all stop complaining about unexplained technical interruptions in our infrastructure and go back to being grateful for every minute that my bank's website is open on the weekend.
/s
TZubiri 55 minutes ago [-]
software quality is going down in general
not sure if vibecoding is a cause or consequence, but it’s related, it requires as an axiom to stop caring about internals. And it seems to require disregard for quality too.
kevin_thibedeau 38 minutes ago [-]
Basic competency is going down. Everything is outsourced such that no one knows how their critical systems work.
elxr 26 minutes ago [-]
Competency going down, timelines being rushed, project managers and CTOs forcing new tools at breakneck speeds.
i'm all for experimentation and adding new tools when they're shown to actually help, but it seems like large software companies (especially banks and e-commerce) just don't care about quality anymore.
LPisGood 18 minutes ago [-]
I think quality of most products is seemingly going down. To me it is a likely consequence consequence of increased financialization and money being expensive.
saghm 39 minutes ago [-]
I worry that this isn't the right metric for diagnosing whether there's a problem. I'd argue that we've had instances in the past where a massive increase in how accessible programming is ended up being a net gain in the long run for software even if the average quality went down (e.g., having computers move from giant room-sized mainframes that only companies and governments could afford to sitting in the living room on a table probably reduced the average quality because untrained amateurs could start write software even if they weren't skilled enough to be employed). I could potentially be convinced that this isn't the same and that it will end up being worse for software in the long run with a stronger argument, but "software quality is going down in general" isn't convincing enough evidence for me.
All of this is also downstream of what I think is even more important, which is what's better for society in general. Obviously low quality software is not better for society than high quality in a vaccuum, but I also don't think there's a single obvious objective answer for whether the influence of software on society is a net positive or negative today compared to, for example, when computers were all mainframes and all software was produced by people paid to write it. There are a lot of differences in society today compared to back then, and software certainly has some role in how we ended up here, but trying to attribute exactly what and how much is not an exact science.
This is a lot of words to basically say: if you're confident that this is a problem, I think it's important to state exactly why, since I think the interest parts of the discussion are in how you've concluded that.
freecodeio 30 minutes ago [-]
considering how the experience with most SaaS products right now is insufferable with broken states and UI, I imagine the same broken behavior is leaking in every other area of product development, so I agree
That's more like the rise of Google (which may or may not be correlated to software quality), as "something went wrong" is an error message popularized by them.
fidotron 45 minutes ago [-]
Software quality peaked between XP SP2 and the victory in the market of node.
nswizzle31 45 minutes ago [-]
Source = trust me bro. What’s that bias where things are so rare that when they happen it makes news, so you think they’re very common (eg plane crashes?).
Uptime and quality of software is about 10000x better than it was 10 years ago. Things just work all the time now.
sph 44 minutes ago [-]
> Uptime and quality of software is about 10000x better than it was 10 years ago
Extraordinary claims require extraordinary evidence. You're being the 'trust me bro' in this situation.
saghm 37 minutes ago [-]
I'd argue that just illustrates the point that it's impossible to have an interesting discussion without a stronger claim from the parent comment. If I say something that's too vague to falsify, and you can just as plausibly claim the opposite, you're not at fault for failing to turn my claim into a more rigorous one.
hugeBirb 39 minutes ago [-]
Also, source = trust me bro? How can you make the opposite claim without backing it up either
cainxinth 47 minutes ago [-]
My dad is a doctor. He keeps asking me similar questions.
I told him it's just like how he keeps telling his patients to watch what they eat, drink and smoke less, and get some exercise, but they don't, and then they have a heart attack and wonder why.
Alex3917 50 minutes ago [-]
If an unfriendly foreign power were attempting to impose on America the insecure and unstable vibe-coded digital infrastructure we’re building today, we’d probably view it as an act of war.
jsLavaGoat 37 minutes ago [-]
Everything you said has been true for a long time, vibe coded or not. How much of the Internet proved to be exposed to a supply chain attack on node? That wasn't AI, that was just how things worked out.
nsoam 42 minutes ago [-]
Or the H-1Bs
porphyra 24 minutes ago [-]
Maybe Jensen was what was keeping all of the nation's infrastructure running
skeeter2020 46 minutes ago [-]
Same with my parents, until I told them if FAA comms ran on teams and outlook we would have been boned a long time ago!
DIE_DIE_DIE 31 minutes ago [-]
This is the obvious consequence of (failing to) replace software developers with AI slop. Despite the protests of the Antrhopic shareholders who dominate this site's comments, LLMs are hideously poor at designing software.
bparsons 55 minutes ago [-]
Three massive outages in three business days in a row does seem like a pattern.
ignore 33 minutes ago [-]
[dead]
ForHackernews 19 minutes ago [-]
One might argue that lazy sloppy work and the generally pathetic state of IT maintenance is the common cause.
arisAlexis 53 minutes ago [-]
Any reason why it isn't the case?
sosodev 51 minutes ago [-]
Because there’s not one, shared cause between the outages. The lay person claims it must be AI, but that’s a bit meaningless.
bobson381 47 minutes ago [-]
The reason I say not entirely, is because there is kind of a shared cause. One way of looking at is is that the root cause is complexity, optimized for efficiency and speed rather than robustness. It's a feature of the economic superorganism we are operating as part of. See Joseph Tainter on Collapse of Complex Societies, the work of Nate Hagens, Schmachtenberger & Liv Boree talking about Moloch, etc.
saltcured 17 minutes ago [-]
Or put a bit more cynically, it is a symptom of a society-wide drift towards lower accountability and duty of care. It's a type of tragedy of the commons. Selfishness and externalized cost/risk means nobody optimizes for systemic reliability.
People "vibing" everything is just another component of this, not the root cause. Using AI tooling is just the new technique for what used to be called phoning it in, or going through the motions, or faking it until you make it.
Unfortunately, it's nearly always been an effective tactic for a selfish few. It's problematic when we don't have an equilibrium that keeps it in the minority...
skybrian 32 minutes ago [-]
Yes, that's how you take separate causes and transmorgify them into one omnicause, by muddying the waters until you can't see the differences anymore. Don't do that! It just adds confusion.
(The same thing happened with separate company's problems becoming "Big Tech." It didn't help.)
xboxnolifes 23 minutes ago [-]
Once you give separate things a shared name they become the same thing. We could call those in the claim to be "race to the bottom effect" or "incentives against resiliance". The water is no longer muddled, its now a slushie.
AnimalMuppet 17 minutes ago [-]
You could call it "category theory" or something.
Snarky, but there's a point: Abstraction leads to viewing different things as the same thing. They are - at one level of abstraction. And they aren't at other levels of abstraction. It's not a problem to have both viewpoints.
The trick is that, when someone blends things together, to not lose the fact that they are also separate (at other levels of abstraction).
So I have no problem saying that "optimizing for efficiency and speed" is the common cause of all of these problems, and saying that they all have different (immediate) causes. Both can be true.
skybrian 11 minutes ago [-]
Sometimes these abstractions are useful for design or analysis, but maybe not for explaining them to others? A library or programming language will probably be more usable if its users don't need to know any category theory.
I'm not sure "optimizing for speed and efficiency" can count as a common cause, though, because it's not a single event. It's more like a set of events that have something in common.
vintermann 39 minutes ago [-]
What does the "pro" person claim? That it's Iran?
coldpie 20 minutes ago [-]
That there has never been an incentive to build quality software. As a result we spent 50 years building our society on top of poor quality software. We're paying for it now and will continue paying for it until the incentives change and quality becomes a focus.
UncleOxidant 30 minutes ago [-]
I suspect there are incentives for Iran not to be identified as the culprit right now whether they are or not. If it is indeed Iran that would show they have the capability to do this and maybe the administration doesn't want that to get widely circulated. (and if it is a state actor it doesn't have to only be Iran - could be a coordinated effort - NK just did the big Binance heist and Russia can do this kind of stuff too)
Jach 17 minutes ago [-]
NK's heist was against Binance, not Coinbase.
The main incentive for any nation state to avoid attribution to direct and material harm to many Americans is that they risk awakening American bloodlust. Americans are unhappy about the current Iran situation and wish it didn't start and that it would end already, but sufficient Iranian escalation would turn that around real quick and suddenly there are boots on the ground among other things.
sosodev 35 minutes ago [-]
That it’s a nuanced mess of factors. Like reality always is.
Waterluvian 40 minutes ago [-]
Imagine a tree of relationships branching up to the very top labelled, "Because the Universe Exists" as being the root issue that relates everything.
Saying it's not related applies an assumption of what level of specificity you are thinking about. And that's how you quickly de-sync with other people, especially "lay people" who look at you funny when you claim there's just no way these things are related when it's hard to believe that based on experience alone.
As other comments suggest, it probably is related to an extent. Related by complexity of our Internet-based systems, related by age, related maybe even by enshittification of expertise, etc.
The further up the tree you find these relationships, the less specifically actionable they are (you cannot CVE enshittification), and the more they are about "what are the overall social/cultural/human issues we're grappling with in this era?"
mlyle 24 minutes ago [-]
Aviation got a whole lot safer when we started looking at the systems causes instead of the specific ways individual people, airlines, manufacturers screwed up. Ditto for anesthesiology, cars, etc.
Sure, focusing on individual small causes is helpful too, and it's a lot harder to do the higher and higher level system stuff. But, it can be done.
edit, P.S.: It's worth keeping a bare level of suspicions that there could be a common lower level cause, whether through inadvertent dependencies added or through hostile action.
cyberax 40 minutes ago [-]
Is there?
Apparently the FAA outage was caused by the pressure to do things quickly, fueled by the AI urgency.
It feels like all the IT industry is feeling this pressure.
PhunkyPhil 50 minutes ago [-]
To be fair, have there been post-mortems for any of them? Besides vague tweets or press statements?
That's the preliminary post mortem from Microsoft.
I don't think we'll ever get anything honest out of the administration for the FAA outage unless Congress really wants to dig into it and make the results public.
cyberax 25 minutes ago [-]
Oh wow. Time for a "latent bug" drinking game?
Muromec 38 minutes ago [-]
> The lay person claims it must be AI, but that’s a bit meaningless.
Must be the water then
aaroninsf 39 minutes ago [-]
a) this is not known, there is no reliable data on either the FAA or new bank issue; and the information forthcoming from Microsoft may obscure primary causation
b) there is also a risk of sophistry and language games obscuring common sense truth
In the world where a state actor is engaging in active sabotage as part of a cyberwarfare effort, there is one shared cause.
Which exploits are responsible in each case may differ. Still one cause.
Do I think it's Iran?
No idea.
But the point is, none of us here have any idea at present.
doctor_radium 23 minutes ago [-]
It's true that we don't really know, and my first instincts lean toward hacking by a foreign government, but then I start thinking about media reports of shark attacks every summer. Shark attacks aren't unknown, but certain media channels like to pounce on them for ratings, and after a while to the average person it might seem like Sharknado. Stuff goes down all the time, but in this moment we're just extraordinary conscious of it.
Fr0styMatt88 43 minutes ago [-]
I can see why people think it. I don’t think I remember a 7-day stretch like this…. ever?
- Massive Microsoft outage
- FAA ground stop
- Now this outage
Definitely a black swan at least? It’s not even the number of failures, it’s the scale.
TheAtomic 27 minutes ago [-]
Also last week, a hack of Nat'l Weather services web site (but not affecting services) and a minor outage at some Amtrak services on the East Coast.
joering2 25 minutes ago [-]
Because they are. Trump just said that deranged democrat/antifa was cutting cables everywhere.
rsoto2 29 minutes ago [-]
It is interconnected. Everyone bought the "cloud is up 24hrs" bullshit. My company had physical servers and we had 99% uptime because we had competent people. Profits are driving unsafe transitions, such is capitalism. Look at our crumbling old infrastructure and ask yourself why the "digital highway" would be any safer.
neural_thing 27 minutes ago [-]
Banks, the FAA, Microsoft all have significantly higher uptime than 99%
ChromeUltron 16 minutes ago [-]
hahahahhahaha .. no
saghm 52 minutes ago [-]
Honestly, I can't help but hope that ends up leading to enough popular support for more regulation for AI that something gets implemented. On the other hand, there's also ample historical precedent for hoping that a mass movement heading in the right direction ends up stopping at the point that feels reasonable and then being surprised when the momentum continues and people like me looking foolish for thinking that it wouldn't, so I might just be overly optimistic.
swatcoder 22 minutes ago [-]
AI is not the cause of this kind of problem and it's regulation won't make it go away. Maybe it needs regulation, maybe it doesn't, but you're missing what's happening if you think that's what these widespread failures and vulnerabilities are about.
AI is acting as a sudden precipitator for problems that have been latent and growing for at least 15-20 years.
In pursuit of maximally rapid innovation and reduced capital expenditure, the software industry adopted a "move fast and break things" mentality and homogenized code and service infrastructure over a few winning cloud vendors, SaaS providers, and code solutions/frameworks/packages/etc.
The pitch was that you could rely on downstream experts to do better work than you could, that the biggest vendors and publishers had the best experts, that have them invest the capital would look better on your accounts, and that their scale would give you the best value for your investment.
The caveat is that effectively all technology products have serious faults lurking in them, even with the finest expertise working on them (not that most actually had that), and that when everybody homogenizes over the same providers and solution the industry shifts from a bubbling froth of localized bugs to a heavily correlated house of cards where widely correlated failures manifest in widespread collapse and catastrophe.
Whoops.
AI is acting as a breeze against the house of cards, but lots of things could have and would have and did, especially as it continued to inflate year over year.
SoftTalker 48 minutes ago [-]
What's actually more likley are power grabs executed while the chaos is attracting all the attention. That's how we ended up with DHS.
canibalrex 38 minutes ago [-]
I don't really see how regulation for AI helps. Companies were on this crash course of trusting Microsoft (or pick your other dependency that cant be eliminated as it is a monopoly or the minimum) to provide more and more of surrounding infrastructure. Until they had AI to run simulations of outside.competence there wasn't a snowball's chance in hell they were competent enough at IT to run someone else's infrastructure.
danso 19 minutes ago [-]
Why do people assume that this crash is the result of AI vibe coding (i.e. these companies rolling out buggy production code) versus AI-empowered vulnerability seekers? Seems more likely that a group is trying to swarm and exploit a possible vulnerability common to these banks' operations, than it is that Bank of America, Chase, and U.S. Bank all happened to roll out bad vibe code on Monday.
itishappy 2 minutes ago [-]
I'd assume that whatever happened affected a single centralized service that these banks all relied upon.
Aperocky 7 minutes ago [-]
The initial postmortums are out already for the 2 previous event, and they appear to have nothing to do with vulnerability.
werdnapk 5 minutes ago [-]
Do you really believe a guy doing some wiring caused an air traffic shutdown last week?
fedpost 10 minutes ago [-]
I don't think the average person cares tbh.
It's caused my AI, it doesn't really matter who's fault it is
superfrank 8 minutes ago [-]
Because there’s a lot of anti-ai sentiment going around right now. Blaming it on AI slop code supports pre-existing beliefs that AI is useless. If it’s AI hackers then that not only means AI is actually good at something, it’s potentially an argument for why we need increased spending and that there really is a race dynamic at play that we need to win.
Basically, blaming AI slop supports a lot of pre-existing beliefs, while blaming AI hackers does not.
Ancalagon 10 minutes ago [-]
Little hispanic girl voice: "Por que no los dos?"
sunbum 15 minutes ago [-]
Hanlons razor. “Never attribute to malice that which is adequately explained by stupidity.”
password54321 9 minutes ago [-]
Heuristics are not proof and this is probably one of the more flawed/lazy ones.
DownDetector's methodology is fine, it's just noisy. The way to use it is to look at the top-reported failing sites in the ranked list on their homepage, which has been the correct root cause for every major outage I've seen. Ignore the lower ranked ones.
By top-reported I mean the top two, maybe up to four. It's not high-fidelity.
I still think it's useful, especially since in 2026 the art of building a status page not dependent on the infrastructure it monitors has been lost.
ceejayoz 39 minutes ago [-]
> By top-reported I mean the top two, maybe up to four.
As the Rick & Morty quote goes, "that just sounds like horrible methodology with extra steps".
paxy 4 minutes ago [-]
Also happened last week during the Outlook outage. It showed the entire internet down for some reason.
creatonez 18 minutes ago [-]
How do you know some of these aren't experiencing a partial outage? Responding instantly to partial outages that never get reported on status pages seems to be one of DownDetector's biggest strength.
ceejayoz 18 minutes ago [-]
> How do you know some of these aren't experiencing a partial outage?
Is there any other sign they are? That Google, AWS, Steam, Amex, Visa, etc. are all simultaneously having significant outages right now?
> Responding instantly to partial outages that never get reported on status pages seems to be one of DownDetector's biggest strength.
I've predicted all fifty of the last one recessions.
I mean, if Visa/Amex transactions are not working because their bank is down, end users don't know the difference. Card says "Visa" on it, card is not working, end user blames Visa.
Steam/AWS, I got nothing.
Mogzol 49 minutes ago [-]
Isn't it just based on user reports? What explains the spike in user reported issues in those services recently?
ceejayoz 49 minutes ago [-]
> Isn't it just based on user reports?
DownDetector considers someone looking up "is Visa down?" a report, even if it isn't.
Click my links and it contributes to those "reports".
One provider has a major issue, and people go there and click into non-down companies, which is seen as a spike.
dubcanada 43 minutes ago [-]
Is there a problem with that? Do normal people google "is Visa down?" if they don't think Visa is down?
On the other side, does a user google "is Visa down?" going to a website and clicking "yes I think visa is down" any better?
ceejayoz 42 minutes ago [-]
> Do normal people google "is Visa down?"
Normal people Google "is Chase down?", find DownDetector, and click it. (Note that the article has a Chase rep quoted saying they do indeed have an outage, and none from other companies.)
Some of them then click into the DownDetector home page and browse around. Suddenly everything is spiking.
Every time I've seen any one major company with issues, DownDetector has spiked across the board. As it is now. Google and Amazon are apparently down.
akersten 33 minutes ago [-]
> DownDetector considers someone looking up "is Visa down?" a report, even if it isn't. Click my links and it contributes to those "reports".
Really? It seems to me you have to click a specific aspect of the service to report as down once you land on that page to report an outage.
danso 22 minutes ago [-]
I assume their methodology weights active reports higher than the implicit ones.
In that case, it was a Google Cloud outage. Something similar (database outage) could be the culprit here.
graemep 1 hours ago [-]
Lots of banks have been down at various times, but its a lot more of a problem when multiple major banks are down at the same time.
krunck 58 minutes ago [-]
I've got my cash stash.
maerF0x0 19 minutes ago [-]
That will work for the first week to month of a disaster. Once people realize it's bigger then dollars will rapidly lose value compared to direct barter for useful things.
sailfast 54 minutes ago [-]
I don’t think cash is gonna help if the entire monetary system stops working - gold maybe?
hbcdbff 38 minutes ago [-]
If the “entire monetary system” stops working, then things are fucked enough already that gold is essentially the same in terms of utility as cash would be, in that its only immediate value is its scarcity.
Things like food, water, basic sanitary items, would be bartered for.
jsLavaGoat 36 minutes ago [-]
Diesel. And .223 and 9mm. And the addresses of the 10 nearest preppers.
delichon 32 minutes ago [-]
Careful, the preppers I know think your 9mm is adorable.
segfaultex 19 minutes ago [-]
9mm is the most common sidearm cartridge on the market. Works fine for the guys in Delta and DEVGRU.
ndesaulniers 22 minutes ago [-]
That's all right. We'll let this .38 special do the talking.
ceejayoz 23 minutes ago [-]
Those preppers couldn't even handle two weeks staying home during COVID.
All hat, no cattle.
islandfox100 18 minutes ago [-]
"it matters not whether a bullet is 9mm or .50, as long as it hits enemy soft tissue"
-Deng Xiaoping (paraphrased)
francisofascii 27 minutes ago [-]
It is pretty common to for credit card systems to go offline temporarily at grocery stores and restaurants. Always a good idea to have cash.
dontwannahearit 41 minutes ago [-]
Bullets and shotgun shells.
ImPostingOnHN 38 minutes ago [-]
lead maybe
triceratops 34 minutes ago [-]
I prefer ammo, canned goods, solar panels, and a well. And maybe a doctor or nurse practitioner friend.
You can't send a single cent of your cash over the internet to someone else who is also experiencing this outage. FedNow is likely not working either.
On the other hand stablecoins such as USDC can be sent over the internet on blockchains such as Tempo, Solana, XRP and Stellar worldwide, 24/7 in less than 5 mins and with extremely low fees.
999900000999 30 minutes ago [-]
Across all of tech QA is the first thing you cut. When you’re doing your job right no one cares.
techmunky 33 minutes ago [-]
West Coast, 3 out of 5 of these load for me no problem (I only use 3 of these services, cant check the others). Might be an east coast AWS thing? Can't seem to open a WireGuard tunnel into my home network on the east coast though, which is unusual. o_O
marinmania 27 minutes ago [-]
BOA and Chase both work for me on East Coast.
It's really hard for me to get a sense of how much outages are on the rise - versus every minor issue getting a lot of attention.
CodingJeebus 29 minutes ago [-]
Are you actually authenticating or just landing on main sites? The more public/marketing type pages are often hosted separately from the account platforms.
techmunky 18 minutes ago [-]
Signed in via mobile app.
sega_sai 1 hours ago [-]
Presumably this must be the "best" time for phishing/fraud ?
giwook 28 minutes ago [-]
You forgot to add "asking for a friend"
rz2k 49 minutes ago [-]
Is Zelle the commonality for this outage? All of those banks work for me, but I have been careful to never enable Zelle on any accounts.
john01dav 46 minutes ago [-]
Why do you avoid Zelle? I often find it to be useful, so if it has some non obvious issues I prefer to know.
kccqzy 3 minutes ago [-]
I avoid Zelle because Zelle shows my legal name rather than a nickname to any random stranger I transact with. At least with Venmo you can provide a pseudonym to the other person. The only use case I have involved buying / selling secondhand items on Craigslist and Facebook marketplace.
fc417fc802 18 minutes ago [-]
Not OP but isn't zelle yet another commercially motivated third party that will aggregate and mine user data for profit? If nothing else they're an additional point at which data could leak.
My bank used to let me send checks via online banking (either electronic or mailed out physically by the bank depending on the recipient) until they adopted zelle and discontinued that service. My credit union still offers the check thing for free. That's an easy choice at least for me.
piperswe 2 minutes ago [-]
It's only sort-of a third party; Zelle is owned by the banks
> Zelle (/zɛl/) is an American digital payments network run by a private financial services company owned by Bank of America, Truist, Capital One, JPMorgan Chase, PNC Bank, U.S. Bank, and Wells Fargo.
It's a bit like Bitcoin, in that money can disappear from your account permanently in seconds with little recourse.
sam1714 26 minutes ago [-]
Not exactly. Zelle allows chargebacks against unauthorized origination, i.e. your account gets hacked.
Banks only allow a couple $k of transfers per day anyway. The company behind Zelle, Early Warning, is a bank-owned centralized fraud detection network as the name suggests.
The ability to send wires from your account is riskier... I wired the down payment on my house in one go.
ceejayoz 23 minutes ago [-]
> Not exactly. Zelle allows chargebacks against unauthorized origination, i.e. your account gets hacked.
"Banks draw a distinction between what they consider scams — when a customer is tricked into sending money to a thief — and fraud, when an unauthorized person gains access to a consumer’s account and siphons off cash."
If you're drunk at a bar and someone unlocks your phone with your face and sends themselves your money, that's gonna be authorized from their standpoint.
sam1714 17 minutes ago [-]
There's no consumer protection for any payment method that's not a credit/debit card or PayPal, Cash App, etc. which chain off credit/debit You pay for that in transaction fees; up to couple of percent.
Cash, check, wires, ACH, money orders are no different from Zelle in that respect.
ceejayoz 12 minutes ago [-]
Yes. And that's why I carry a tiny bit of cash, a few credit cards, and none of the rest in my day-to-day life.
lurking_swe 5 minutes ago [-]
not quite? it's more like a bank wire. except bank wires can _sometimes_ be reversed.
stogot 38 minutes ago [-]
So can cash if you pay someone and they walk away?
ceejayoz 38 minutes ago [-]
Yes, and most people don't carry their entire savings account worth of cash on them for that very reason.
lurking_swe 2 minutes ago [-]
And most people don't store their life savings in a single checking account?
not sure what you're trying to say. I can be stupid with cash AND in my digital life, the choice is mine.
Liuser 8 minutes ago [-]
There are strict limits on Zelle compared to wire transfers, or in this case your insistence on relating this to bitcoin.
You can’t drain your entire savings through Zelle in a single day (unless your entire savings is $3k).
ceejayoz 5 minutes ago [-]
That's a life-ruining amount to a whole bunch of people living paycheck to paycheck.
cloudc0de 57 minutes ago [-]
Logged into my account at all four of those banks just fine, even submitted payments.
samk3nny 2 hours ago [-]
From Microsoft to the FAA to Chase.
marginalia_nu 1 hours ago [-]
The MTBF singularity is the one I'm concerned about.
nyc_data_geek 58 minutes ago [-]
Yeah, this is getting way past the point where coincidence seems a viable explaination.
SoftTalker 51 minutes ago [-]
Randomness is not evenly distributed.
esseph 39 minutes ago [-]
I thought you were a data geek?
CrzyLngPwd 1 hours ago [-]
What did MS say caused the Office 365 downtime?
vinyl7 1 hours ago [-]
There was a thread contention bug in one if their backend services in an update that was pushed out in July and didn't happen until the system was under normal loads across all their services.
cube00 45 minutes ago [-]
And only on newer hardware with more cores that only exists in production
SubiculumCode 1 hours ago [-]
To see what's next, let's turn to prediction markets!
1-6 32 minutes ago [-]
It's never a bad idea to carry a few dollars in case of a payment processing problem.
enjoyyourlife 59 minutes ago [-]
Have been getting some core.finicity.shared.noAccountAvailable.instruction errors with Capital One when trying to connect back accounts
vegnus 49 minutes ago [-]
Im having GCP problems. Anyone else?
MostlyStable 16 minutes ago [-]
USAA also appears to be down, at least for me.
mococa 14 minutes ago [-]
America is melting
testtestmetest 5 minutes ago [-]
I kinda expected things like this to happen the week of the Anthropic IP0. EA sees everything as a trolley problem anf tries to create them wherever they can. Thwy will mess with critical infra to get themselves the regulation they want.
vondur 57 minutes ago [-]
Just checked with my Chase account. It's fine. Was able to login via the mobile and web app.
bijowo1676 29 minutes ago [-]
companies relying on a single cloud (Azure) for mission critical workloads is a big problem
starkeeper 15 minutes ago [-]
We are under attack and the enemy is incompetence or actual terrorists.
They would/will never admit it is AI breaking everything either.
aleqs 1 hours ago [-]
The degradation in software quality across the board (Spotify, Google Maps, GitHub, YouTube - to name a few) has been very noticeable for me, and I suspect AI has a lot to do with this.
The thing is - I also think AI can be used to build very high quality software. The problem, I think, is that the typical big tech/VC tech/MBA tech type company (who control most proprietary software at this point) have very little incentive to actually care about quality, and that was quite obvious even before AI.
sakopov 39 minutes ago [-]
I think majority of companies don't know how to build safely with AI. It's just kind of handed off to engineering and mostly used as one-off chat interaction to get stuff done. Very few are building any kind of harnesses around SDLC that focus on architecture, testing, security and etc. I think we'll get there at some point, but in my experience the smaller tech players are just now on-boarding to use AI in general in any kind of capacity. We're not talking about best practices yet.
DIE_DIE_DIE 20 minutes ago [-]
> I also think AI can be used to build very high quality software.
I don't, and I think your comment is rhetorically useless because you've been bullied into making this ridiculous concession.
pkulak 59 minutes ago [-]
I remember before I started using AI (I was pretty late to the game), I assumed all the bugs and instability were because people were writing software with AI. Now that I've seen how good the code that AI writes can be (CAN be), I'm moving more to the thinking that it's from AI being used to find vulnerabilities.
SoftTalker 36 minutes ago [-]
I've never had AI one-shot even a 10 line script that I didn't manually revise. To be fair, it usually produces something that works, but after seeing it I'll realize that my prompt was too vague or I left out some edge case. So it's the old problem with software "it does what was asked for but not what was needed."
So I speculate that a lot of problems with AI code are just that it is accepted uncritically because it builds and doesn't have any syntax errors.
skydhash 16 minutes ago [-]
There’s a pressure to deliver more and faster from management. So instead of using LLM to reduce the coding time and allocate more time for review, everything is scaled down and there’s even less time for review. And you’re responsible for more as teams are also scaled down.
Not really a great recipe for good code.
antupis 39 minutes ago [-]
It’s more that management pushes more output and with AI it’s very easy to achieve but that will create slop.
lotharcable 47 minutes ago [-]
It isn't a software or tool problem.
It is a C-level executive problem. With the FAA it is the agency directorship problem. Same issue.
These people, very literally, are trying to run the world with power point presentations and executive summaries drafted by sycophants. 70 years ago these people had actual experience doing actual work and trying to grow businesses and doing stuff at the ground level. Now they are given their positions through a combination of credentials, connections, and political maneuvering. None of which actually relates to how well they can or cannot run a organization.
When reality disagrees with what they get in their emails and presentations then it reality that is wrong. It is the messengers that are the problem, not their competency.
This is nothing new. But the failures in leadership compound over time, like interest to a unpaid debt. They start off with healthy growing companies and thanks to government protections and bailouts it takes decades to for these organizations to decay into total dysfunction. In the past these sorts of people would be removed and their assets reallocated to competent management through bankruptcy and competition. However that natural process is not allowed anymore.
All AI is doing is handing them more foot-guns.
They think they can do better/faster/stronger/cheaper with AI and if AI causes problems then it can just be fixed by paying for better AI. Which they assume is just right around the corner, always.
Just wait until they start to realize that it is
gtowey 51 minutes ago [-]
IMHO the only way to build good things is to pay attention to the details. And coding agents, while greatly increasing the appearance of productivity, they are causing people to pay less attention to what they're actually producing. This is the inevitable and obvious result.
Agentic coding could be a world-changing benefit, but the current way it's being sold and used as as a cost cutting measure -- produce software faster than ever before with fewer software engineers! Get rid of those pesky experts!
pwillia7 29 minutes ago [-]
We're in the v1 machines screws stage where everything is worse but with a clear path to get better .... I hope
dmitrygr 60 minutes ago [-]
Part of being sane is accepting that some tools, while being very powerful, are too easily misused to be widely distributed to those lacking proper training. This is why you cannot just go and buy 5 kilos of azithromycin
aleqs 53 minutes ago [-]
Ehh I don't really buy that. Who decides what tools are distributed to who and how?
Don't want to get into a political debate here but I'll say that I think that open AI models and access to them is a benefit to society, while closed, proprietary models, controlled by tech billionaires are probably net bad for society.
gilrain 33 minutes ago [-]
> Who decides what tools are distributed to who and how?
The same people we already delegate such responsibilities to: the government; ideally, a representative one.
Ylpertnodi 18 minutes ago [-]
> some tools, while being very powerful, are too easily misused to be widely distributed to those lacking proper training.
Could you define 'proper training'?
I've endured plenty of fucked-up shit from so-called 'professionals/ experts/ trained people' over the last 30 years or so.
I'm currently assisting a couple of vibe-coders improve their 'too easily misused...[and] widely distributed' (available on their sites, or github) tools - I mean slop - that benefit me in ways traditional companies have no interest in.
And the updates are fast (daily, mostly) and accurate because, unlike jeremy with a pretty CS degree and a nice job, these people actually give a crap' and don't have a manager to say 'you can't do that'.
Also part of being sane is accepting that the cat is out of the bag and big $oftware/ tool manufacturer better get a move on.
Disclosure: my interests are not critical to anything; quite the opposite, but people are learning faster and faster with Ai learning faster and faster.
Who needs azithromycin if a series 1's and 0's can accomplish so much more?
For good or bad.
jsisto 1 hours ago [-]
I was able to login and check my account balance
fragmede 37 minutes ago [-]
Went into a branch and they couldn't help me!
Chance-Device 3 minutes ago [-]
I love how trusting everyone is after three major outages on consecutive business days, hot on the heels of months of warnings and demonstrations of AI enabled attacks, that these aren’t attacks, solely because people incentivised to say that everything is normal are saying everything is normal.
matt123456789 29 minutes ago [-]
I asked Claude to log in to everyone's accounts and check on them. Don't worry, it had no trouble getting in and it says everything is fine.
Kapura 60 minutes ago [-]
Yes, it's sad these systems are going down all the time, but if we wanted them to stay up we'd have to pay the people who maintain them, which means less money for the stockholders. So you see, our hands are tied.
wnevets 29 minutes ago [-]
I'm a little surprised I didn't learn about this outage from Flavor Flav [1]
They, too, didn't need programmers any longer and let AI take the wheel?
The thing is, even if true, they'll never admit it. People who make these kinds of mistakes (if this is what it is) are also not very prone to honest bouts of introspection either.
cdrnsf 28 minutes ago [-]
All of the project managers running large-scale production systems with Claude Code are having a rough go of it lately.
thewillowcat 38 minutes ago [-]
So glad that coding has been solved.
1 hours ago [-]
swozey 49 minutes ago [-]
There's going to be a big swing to get off the cloud methinks, hopefully it benefits my career
cube00 42 minutes ago [-]
I doubt it, c-suite will never approve the spike capital expenditure for buying hardware now they're under a nice smooth subscription curve which doesn't harm their profits as dramatically.
chrismustcode 44 minutes ago [-]
Hows the cloud responsible for the outages in a way that is mitigated by self hosting in recent outages and this one?
cube00 40 minutes ago [-]
Not needing to run at big tech scale makes self hosting easier.
You also have full control of downtime and recovery rather the refreshing the MSFT status page.
ultrarunner 37 minutes ago [-]
Presumably a central provider takes down your dependent services with no local ability to navigate around the outage. Removing the dependency obviates the outage risk. It introduces its own downsides as well, but that's a different discussion.
24 minutes ago [-]
k0morebi 1 hours ago [-]
Aw man just begrudgingly switched to them
bob1029 1 hours ago [-]
I'm curious the reason.
fcarraldo 54 minutes ago [-]
To who, banks?
sph 22 minutes ago [-]
They probably got tired of carrying coffers full of gold coins everywhere. Bad timing.
rvz 34 minutes ago [-]
Crypto blockchains such as Solana, Tempo and XRP are still up and running while the banks are down and you have no choice but to wait for them.
What a disaster.
Aboutplants 29 minutes ago [-]
Great, now where can I buy groceries with these garbage coins!
rvz 22 minutes ago [-]
Doordash accepts stablecoins such as USDC so you can buy your groceries from there. [0] [1]
Queue the "It's Biden's fault" excuse in 3,2,1 ...
remusrm 38 minutes ago [-]
[dead]
ahmedketata 52 minutes ago [-]
[dead]
anigbrowl 1 hours ago [-]
[dead]
rumburak 1 hours ago [-]
[dead]
gibsonf1 1 hours ago [-]
Its so much easier to generate code with genAI though.
dccoolgai 58 minutes ago [-]
It's so fast. You can also put "make no mistakes" in the prompt.
sedan_baklazhan 55 minutes ago [-]
And we can fire so many programmers now
vinyl7 1 hours ago [-]
Software is solved!
enjoyyourlife 59 minutes ago [-]
Software is solved but not software engineering
DIE_DIE_DIE 21 minutes ago [-]
[flagged]
toraora 17 minutes ago [-]
incredibly misinformed take - llms are undoubtedly performing real work. it's true that the rate of production of bad quality code has skyrocketed, but there are certainly teams that are increasingly productive and systems that are increasingly more secure because of them
DIE_DIE_DIE 16 minutes ago [-]
> but there are certainly teams that are increasingly productive and systems that are increasingly more secure because of them
I don't take your assertion of certainty seriously. In my opinion, you are not qualified to evaluate the quality or security of code. You are looking at a series of related disasters and shouting that nothing is wrong. Please forgive me for not taking your perspective seriously.
jjice 14 minutes ago [-]
It's a tired discussion. LLM generated code can be awful, but it can also be very good. If you think all LLM generated code is bad, you haven't used any in the last year.
Company process and how LMS are treated in the development process is actually of interest. Are they YOLO shipping code or are they reviewing it and using LLMs as a tool, instead of a replacement for an engineer? That is where LLMs bring danger.
LPisGood 15 minutes ago [-]
I think they’re pretty clearly not designed by idiots. A lot of smart people work there.
Rendered at 20:20:10 GMT+0000 (Coordinated Universal Time) with Vercel.
Roman citizen wondering why the aqueduct isn’t working kind of thing.
But for everything else you need, food water shelter healthcare, you need to submit to europay visa mastercard
Microsoft on the other hand, has proven that it will never be reliable.
Its pros/cons are known and gaps can be addressed with 3p software. You just keep on old outdated, but proven version of software and keep the perimeter locked tightly.
its the azure cloud that is the wildcard.
Don't forget that MS has the advantage of non-English languages support that many alternatives lack.
I feel like it is very unknown, there is no documentation and everyone relies on comments on random forums that are now 21 years old which tells to set undocumented registry keys to undocumented values.
It's not just Europe! :(
They are entirely wrong.
None of these outages, as far as we know, have a common cause. They just happened by coincidence inside the same news cycle.
Nor is there any evidence to blame them on AI, or tech layoffs, or hackers from Iran. It's more likely something boring and technical that doesn't fit into anyone's narrative.
Either way, now that AI is more capable, you can really mess stuff up at scale.
There are many more systems in the world outside of it, even if it is relatively ubiquitous at this point.
Yours is an easy position to defend though, because it's the kind of thing there will never be any concrete evidence for.
It's your job to provide evidence they are related, and you have nothing except speculation.
"As far as we know" just indicates a lack of data, not evidence that they're not related. This is especially relevant for a political administration whose response to COVID was to bury their head in the sand by hiding data. Also: A public comment of "AI is hacking all our shit" wouldn't exactly calm the public.
It's fine to say, "I'll wait until we know more", but in the meantime AI progress continues and the sheer volume of cyber vulnerabilities it's uncovering is undeniable. It's not surprising that some state-sponsored bad actors would be use this as an opportunity to infiltrate too...
In the absence of data, you are assigning blame to things you already hate, like AI or the administration. Motivated reasoning is highly prone to error, and it's a form of stupid-brained thinking.
I prefer to ask a different question. Will all this AI development delivering us amazing new software? Are we just going to get 1000 free clones of Adobe Photoshop or can we expect some really exciting groundbreaking new tools? Perhaps all the really clever use of AI development is in the pursuit of better AI and if that’s the case, why?
/s
not sure if vibecoding is a cause or consequence, but it’s related, it requires as an axiom to stop caring about internals. And it seems to require disregard for quality too.
i'm all for experimentation and adding new tools when they're shown to actually help, but it seems like large software companies (especially banks and e-commerce) just don't care about quality anymore.
All of this is also downstream of what I think is even more important, which is what's better for society in general. Obviously low quality software is not better for society than high quality in a vaccuum, but I also don't think there's a single obvious objective answer for whether the influence of software on society is a net positive or negative today compared to, for example, when computers were all mainframes and all software was produced by people paid to write it. There are a lot of differences in society today compared to back then, and software certainly has some role in how we ended up here, but trying to attribute exactly what and how much is not an exact science.
This is a lot of words to basically say: if you're confident that this is a problem, I think it's important to state exactly why, since I think the interest parts of the discussion are in how you've concluded that.
Uptime and quality of software is about 10000x better than it was 10 years ago. Things just work all the time now.
Extraordinary claims require extraordinary evidence. You're being the 'trust me bro' in this situation.
I told him it's just like how he keeps telling his patients to watch what they eat, drink and smoke less, and get some exercise, but they don't, and then they have a heart attack and wonder why.
People "vibing" everything is just another component of this, not the root cause. Using AI tooling is just the new technique for what used to be called phoning it in, or going through the motions, or faking it until you make it.
Unfortunately, it's nearly always been an effective tactic for a selfish few. It's problematic when we don't have an equilibrium that keeps it in the minority...
(The same thing happened with separate company's problems becoming "Big Tech." It didn't help.)
Snarky, but there's a point: Abstraction leads to viewing different things as the same thing. They are - at one level of abstraction. And they aren't at other levels of abstraction. It's not a problem to have both viewpoints.
The trick is that, when someone blends things together, to not lose the fact that they are also separate (at other levels of abstraction).
So I have no problem saying that "optimizing for efficiency and speed" is the common cause of all of these problems, and saying that they all have different (immediate) causes. Both can be true.
I'm not sure "optimizing for speed and efficiency" can count as a common cause, though, because it's not a single event. It's more like a set of events that have something in common.
The main incentive for any nation state to avoid attribution to direct and material harm to many Americans is that they risk awakening American bloodlust. Americans are unhappy about the current Iran situation and wish it didn't start and that it would end already, but sufficient Iranian escalation would turn that around real quick and suddenly there are boots on the ground among other things.
Saying it's not related applies an assumption of what level of specificity you are thinking about. And that's how you quickly de-sync with other people, especially "lay people" who look at you funny when you claim there's just no way these things are related when it's hard to believe that based on experience alone.
As other comments suggest, it probably is related to an extent. Related by complexity of our Internet-based systems, related by age, related maybe even by enshittification of expertise, etc.
The further up the tree you find these relationships, the less specifically actionable they are (you cannot CVE enshittification), and the more they are about "what are the overall social/cultural/human issues we're grappling with in this era?"
Sure, focusing on individual small causes is helpful too, and it's a lot harder to do the higher and higher level system stuff. But, it can be done.
edit, P.S.: It's worth keeping a bare level of suspicions that there could be a common lower level cause, whether through inadvertent dependencies added or through hostile action.
Apparently the FAA outage was caused by the pressure to do things quickly, fueled by the AI urgency.
It feels like all the IT industry is feeling this pressure.
That's the preliminary post mortem from Microsoft.
I don't think we'll ever get anything honest out of the administration for the FAA outage unless Congress really wants to dig into it and make the results public.
Must be the water then
b) there is also a risk of sophistry and language games obscuring common sense truth
In the world where a state actor is engaging in active sabotage as part of a cyberwarfare effort, there is one shared cause.
Which exploits are responsible in each case may differ. Still one cause.
Do I think it's Iran?
No idea.
But the point is, none of us here have any idea at present.
- Massive Microsoft outage - FAA ground stop - Now this outage
Definitely a black swan at least? It’s not even the number of failures, it’s the scale.
AI is acting as a sudden precipitator for problems that have been latent and growing for at least 15-20 years.
In pursuit of maximally rapid innovation and reduced capital expenditure, the software industry adopted a "move fast and break things" mentality and homogenized code and service infrastructure over a few winning cloud vendors, SaaS providers, and code solutions/frameworks/packages/etc.
The pitch was that you could rely on downstream experts to do better work than you could, that the biggest vendors and publishers had the best experts, that have them invest the capital would look better on your accounts, and that their scale would give you the best value for your investment.
The caveat is that effectively all technology products have serious faults lurking in them, even with the finest expertise working on them (not that most actually had that), and that when everybody homogenizes over the same providers and solution the industry shifts from a bubbling froth of localized bugs to a heavily correlated house of cards where widely correlated failures manifest in widespread collapse and catastrophe.
Whoops.
AI is acting as a breeze against the house of cards, but lots of things could have and would have and did, especially as it continued to inflate year over year.
It's caused my AI, it doesn't really matter who's fault it is
Basically, blaming AI slop supports a lot of pre-existing beliefs, while blaming AI hackers does not.
Ugh. DownDetector's methodology is… not great.
Steam isn't down: https://downdetector.com/status/steam/
Amex isn't down: https://downdetector.com/status/americanexpress/
Visa isn't down: https://downdetector.com/status/visa/
AWS isn't down: https://downdetector.com/status/aws-amazon-web-services/
But each has a huge corresponding spike there.
"User reports show problems with Google"
https://downdetector.com/status/google/
As the Rick & Morty quote goes, "that just sounds like horrible methodology with extra steps".
Is there any other sign they are? That Google, AWS, Steam, Amex, Visa, etc. are all simultaneously having significant outages right now?
> Responding instantly to partial outages that never get reported on status pages seems to be one of DownDetector's biggest strength.
I've predicted all fifty of the last one recessions.
Steam/AWS, I got nothing.
DownDetector considers someone looking up "is Visa down?" a report, even if it isn't.
Click my links and it contributes to those "reports".
One provider has a major issue, and people go there and click into non-down companies, which is seen as a spike.
On the other side, does a user google "is Visa down?" going to a website and clicking "yes I think visa is down" any better?
Normal people Google "is Chase down?", find DownDetector, and click it. (Note that the article has a Chase rep quoted saying they do indeed have an outage, and none from other companies.)
Some of them then click into the DownDetector home page and browse around. Suddenly everything is spiking.
Every time I've seen any one major company with issues, DownDetector has spiked across the board. As it is now. Google and Amazon are apparently down.
Really? It seems to me you have to click a specific aspect of the service to report as down once you land on that page to report an outage.
> We process tens of millions of problem reports each month and cover over 36,000 services in 72 countries.
Ask a few normies if they know what it is, let alone have filed a report.
https://downdetector.com/about-us/
> Downdetector collects reports from users and monitors other online sources for service issues.
Or look at the comments on any of the pages. "My card declined"; "18yr femboy down for DM".
- Physical branches closed or unresponsive.
- Online banking down.
This exact same thing happened in Europe with Revolut late last month. It was resolved in about 12 hours: https://www.revolut.com/blog/post/20octoutagetechnicalovervi...
In that case, it was a Google Cloud outage. Something similar (database outage) could be the culprit here.
Things like food, water, basic sanitary items, would be bartered for.
All hat, no cattle.
-Deng Xiaoping (paraphrased)
On the other hand stablecoins such as USDC can be sent over the internet on blockchains such as Tempo, Solana, XRP and Stellar worldwide, 24/7 in less than 5 mins and with extremely low fees.
It's really hard for me to get a sense of how much outages are on the rise - versus every minor issue getting a lot of attention.
My bank used to let me send checks via online banking (either electronic or mailed out physically by the bank depending on the recipient) until they adopted zelle and discontinued that service. My credit union still offers the check thing for free. That's an easy choice at least for me.
> Zelle (/zɛl/) is an American digital payments network run by a private financial services company owned by Bank of America, Truist, Capital One, JPMorgan Chase, PNC Bank, U.S. Bank, and Wells Fargo.
https://en.wikipedia.org/wiki/Zelle
Banks only allow a couple $k of transfers per day anyway. The company behind Zelle, Early Warning, is a bank-owned centralized fraud detection network as the name suggests.
The ability to send wires from your account is riskier... I wired the down payment on my house in one go.
And your bank will always say it was authorized.
https://www.nytimes.com/2022/10/03/business/zelle-fraud-warr...
"Banks draw a distinction between what they consider scams — when a customer is tricked into sending money to a thief — and fraud, when an unauthorized person gains access to a consumer’s account and siphons off cash."
If you're drunk at a bar and someone unlocks your phone with your face and sends themselves your money, that's gonna be authorized from their standpoint.
Cash, check, wires, ACH, money orders are no different from Zelle in that respect.
not sure what you're trying to say. I can be stupid with cash AND in my digital life, the choice is mine.
You can’t drain your entire savings through Zelle in a single day (unless your entire savings is $3k).
They would/will never admit it is AI breaking everything either.
The thing is - I also think AI can be used to build very high quality software. The problem, I think, is that the typical big tech/VC tech/MBA tech type company (who control most proprietary software at this point) have very little incentive to actually care about quality, and that was quite obvious even before AI.
I don't, and I think your comment is rhetorically useless because you've been bullied into making this ridiculous concession.
So I speculate that a lot of problems with AI code are just that it is accepted uncritically because it builds and doesn't have any syntax errors.
Not really a great recipe for good code.
It is a C-level executive problem. With the FAA it is the agency directorship problem. Same issue.
These people, very literally, are trying to run the world with power point presentations and executive summaries drafted by sycophants. 70 years ago these people had actual experience doing actual work and trying to grow businesses and doing stuff at the ground level. Now they are given their positions through a combination of credentials, connections, and political maneuvering. None of which actually relates to how well they can or cannot run a organization.
When reality disagrees with what they get in their emails and presentations then it reality that is wrong. It is the messengers that are the problem, not their competency.
This is nothing new. But the failures in leadership compound over time, like interest to a unpaid debt. They start off with healthy growing companies and thanks to government protections and bailouts it takes decades to for these organizations to decay into total dysfunction. In the past these sorts of people would be removed and their assets reallocated to competent management through bankruptcy and competition. However that natural process is not allowed anymore.
All AI is doing is handing them more foot-guns.
They think they can do better/faster/stronger/cheaper with AI and if AI causes problems then it can just be fixed by paying for better AI. Which they assume is just right around the corner, always.
Just wait until they start to realize that it is
Agentic coding could be a world-changing benefit, but the current way it's being sold and used as as a cost cutting measure -- produce software faster than ever before with fewer software engineers! Get rid of those pesky experts!
Don't want to get into a political debate here but I'll say that I think that open AI models and access to them is a benefit to society, while closed, proprietary models, controlled by tech billionaires are probably net bad for society.
The same people we already delegate such responsibilities to: the government; ideally, a representative one.
Could you define 'proper training'? I've endured plenty of fucked-up shit from so-called 'professionals/ experts/ trained people' over the last 30 years or so.
I'm currently assisting a couple of vibe-coders improve their 'too easily misused...[and] widely distributed' (available on their sites, or github) tools - I mean slop - that benefit me in ways traditional companies have no interest in. And the updates are fast (daily, mostly) and accurate because, unlike jeremy with a pretty CS degree and a nice job, these people actually give a crap' and don't have a manager to say 'you can't do that'. Also part of being sane is accepting that the cat is out of the bag and big $oftware/ tool manufacturer better get a move on. Disclosure: my interests are not critical to anything; quite the opposite, but people are learning faster and faster with Ai learning faster and faster. Who needs azithromycin if a series 1's and 0's can accomplish so much more? For good or bad.
[1] https://www.mediaite.com/media/weird/flavor-flav-more-than-o...
The thing is, even if true, they'll never admit it. People who make these kinds of mistakes (if this is what it is) are also not very prone to honest bouts of introspection either.
You also have full control of downtime and recovery rather the refreshing the MSFT status page.
What a disaster.
No excuses.
[0] https://cointelegraph.com/news/doordash-stablecoin-payments-...
[1] https://tempo.xyz/customer-stories/doordash/
I don't take your assertion of certainty seriously. In my opinion, you are not qualified to evaluate the quality or security of code. You are looking at a series of related disasters and shouting that nothing is wrong. Please forgive me for not taking your perspective seriously.
Company process and how LMS are treated in the development process is actually of interest. Are they YOLO shipping code or are they reviewing it and using LLMs as a tool, instead of a replacement for an engineer? That is where LLMs bring danger.