Elektrine
Log in Register
Paige Chat Timeline Gallery Friends Email Drive DNS Private DNS Domains VPN Kairo Nerve
Remote

Lorin Hochstein :verified:

@norootcause@hachyderm.io
mastodon 4.7.3
  • Open on hachyderm.io

Student of complex systems failures, resilience engineering, cognitive systems engineering. Will talk your ear off about learning from incidents in software.

0 Followers
0 Following
44 Posts
Joined November 20, 2022
blog:
https://surfingcomplexity.blog
website:
https://lorinhochstein.org
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 3w ago
Today's blog post: a play in one act. https://surfingcomplexity.blog/2026/09/19/how-the-incident-happened-a-play-in-one-act/
How the incident happened: a play in one act
Surfing Complexity

How the incident happened: a play in one act

A hallway in a tech company office. A and B are standing in the hallway. B is holding a multiple page document. A: Wow, that incident from a couple of weeks ago was a real doozy. Do you know how it…

30
5
24
1
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 3w ago
"The engineer who, at forty, can still use a slide rule or logarithmic table, and make a true drawing, is a failure". – Everett Hughes, 1958. As a fifty-year-old individual contributor: ouch!
16
1
4
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 7mo ago

The three skills with a lot less overlap than you’d expect:

1. Ability to code.
2. Ability to perform well in a coding interview.
3. Ability to validate code.

409
42
181
1
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 1mo ago
I wrote up some thoughts on Boris Tane's argument for putting AI agents on-call. https://surfingcomplexity.blog/2026/08/22/wild-ai-related-reliability-incidents-are-coming/
Wild AI-related reliability incidents are coming
Surfing Complexity

Wild AI-related reliability incidents are coming

Recently, two AI-related pieces of content caught my attention. The first was the blog post On-Call is Now Theatre by Boris Tane. He argues that AI agents are now capable of doing the majority of o…

21
5
19
2
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 2mo ago
My talk from the inaugural softwareshould.work conference is now online! I got a chance to talk about one of my favorite topics in software reliability: saturation. https://www.youtube.com/watch?v=PHYCRubnmSM

Saturation: How Your Software Will Fail at Scale - Lorin Hochstein | SSW 2026

22
0
12
1
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

Looking for a little less machine learning and a little more human learning

36
2
16
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

New blog post about Erik Hollnagel's Safety-II model: https://surfingcomplexity.blog/2026/04/26/the-normal-work-of-creating-reliability/

The normal work of creating reliability
Surfing Complexity

The normal work of creating reliability

Here’s a recent comment on LinkedIn from John Allspaw, on a post by Gandhi Mathi Nathan Kumar about availability. Allspaw’s comment is a succinct description of a safety model proposed …

21
10
13
1
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

Automation can only solve your reliability problems if that automation is perfect. But if you were capable of writing perfect software, we wouldnt be talking about your reliability problems.

Automation is only part of the reliability story, you’ve got to be ready for when it breaks, too. Because I promise you, your reliability automation is going to break. Will you be ready for when it does?

23
1
11
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 16mo ago

Ad blockers, but for AI

130
12
68
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago
Replying to
I keep writing the same post over and over because the same thing keeps happening over and over!
16
8
1
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

The consequences of being able to generate code with AI much more quickly than we can validate that code is Nature’s way of teaching us about Erik Hollnagel’s ETTO Principle. https://www.erikhollnagel.com/ideas/etto-principle/index.html

BADAK178 | Permainan Online Berlisensi Resmi dengan Platform Digital & Eksplorasi Jenis Permainan
Redbubble

BADAK178 | Permainan Online Berlisensi Resmi dengan Platform Digital & Eksplorasi Jenis Permainan

BADAK178 menyediakan informasi permainan online, platform digital berlisensi resmi, serta eksplorasi beragam jenis permainan dengan informasi yang praktis dan mudah dipahami.

24
2
16
1
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

According to the data, we shouldn’t trust the data

12
2
2
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

It's counterintuitive, but you can learn about the nature of successful work from incidents, even though the incident was a failure case. I wrote a blog post about that here:

https://surfingcomplexity.blog/2026/05/02/how-incidents-can-teach-us-about-whats-already-working-well/

How incidents can teach us about what’s already working well
Surfing Complexity

How incidents can teach us about what’s already working well

Here’s a famous optical illusion, which was developed by the American neuroscientist Edward H. Adelson. Source Even though square A appears darker than square B, the two are, in fact, the exa…

12
0
11
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

I’ve heard of “Nimrod” primarily because of

11
67
22
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

RE: https://techhub.social/@giflian/116409536511194822

What a time to be alive

TechHub

Giflian (@giflian@techhub.social)

Maybe I should just go back to bed https://www.bnnbloomberg.ca/business/2026/04/15/allbirds-shares-jump-over-400-on-plans-to-pivot-to-ai-from-sneakers/

13
1
4
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

New blog post about flipping the bozo bit: https://surfingcomplexity.blog/2026/05/09/flipping-the-bozo-bit-on-flips-the-learning-off/

Flipping the bozo bit on flips the learning off
Surfing Complexity

Flipping the bozo bit on flips the learning off

I’m too young to have seen Bozo the Clown myself, but I’m old enough to get the references “Flipping the bozo bit” is an expression from the software world. Think about a ti…

10
2
11
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

Jim Calabro did an excellent write-up of a recent Bluesky outage, I learned a lot from it. I wrote my own post here: https://surfingcomplexity.blog/2026/04/12/thoughts-on-the-bluesky-public-incident-write-up/

Thoughts on the Bluesky public incident write-up
Surfing Complexity

Thoughts on the Bluesky public incident write-up

Back on April 4, the social media site Bluesky suffered a pretty big outage. I was delighted to discover that one of their engineers, Jim Calabro, published a public writeup about it: April 2026 Ou…

13
3
4
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

RE: https://mastodon.social/@levelbot/116501160117851626

There’s no way this reading is accurate

Mastodon

levelbot (@levelbot@mastodon.social)

we're seeing buffoonery levels at about 00% (00%) □□□□□□□□□□

10
2
2
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

Cloudflare announces a huge layoff and then, the very same day, an availability zone in AWS’s us-east-1 region loses power due to a “thermal event”. Coincidence???

Well, yes

9
0
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 2mo ago
Software engineering research question I’ve always wondered about (although less relevant in the age of AI): are developers more productive when working in their preferred language compared to working in a language imposed upon them due to business constraints?
2
0
2
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

You get what the system is optimized for.

10
0
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

Saturation: a never-ending series. https://www.githubstatus.com/incidents/ql942tw29yl6

GitHub search is degraded
githubstatus.com

GitHub search is degraded

GitHub's Status Page - GitHub search is degraded.

6
0
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

Oops! All AI companies!

7
0
1
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 7mo ago

GitHub's had some availability issues lately. Their CTO wrote a blog post with some details about recent incidents. I wrote a quick post with my reaction here: https://surfingcomplexity.blog/2026/03/12/quick-thoughts-on-github-ctos-post-on-availability/

Quick thoughts on GitHub CTO’s post on availability
Surfing Complexity

Quick thoughts on GitHub CTO’s post on availability

GitHub’s been taking it on the chin on the availability front lately. Yesterday, their CTO, Vlad Fedorov, wrote a post on their blog about their recent incidents: Addressing GitHub’s recent a…

8
0
4
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

Prediction: Within the next two years, the New York Times will write a story about people who are unable to prove they are not AIs (à la CAPTCHAs).

6
0
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 4mo ago
Bonus blog post for today about my instinctual revulsion towards AI slop: https://surfingcomplexity.blog/2026/06/06/i-cant-bear-to-read-ai-generated-prose/
I can’t bear to read AI-generated prose
Surfing Complexity

I can’t bear to read AI-generated prose

I can’t bring myself to read text if I believe it to be AI-generated. Now, I ask LLMs questions all of the time, and I do read those answers. I frequently use tools like ChatGPT and Claude as…

3
0
1
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

RE: https://mastodon.social/@regehr/116513311049264041

Is there a burn ward nearby?

Mastodon

John Regehr (@regehr@mastodon.social)

@kstatz12@discuss.systems I can tell this isn't a real New Yorker caption, because it's funny

4
0
0
1
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

Seamlessness is, indeed, a worthwhile goal; systems fail at the seams.

3
4
1
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 7mo ago

New blog post on the surprising increases in load faced by AI companies and the operational consequences: https://surfingcomplexity.blog/2026/03/07/grow-fast-and-overload-things/

Grow fast and overload things
Surfing Complexity

Grow fast and overload things

The general vibes I see online is that the AI companies have not been doing particularly well in the reliability department. Both OpenAI and Anthropic publish reliability statistics on their status…

5
0
4
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago
Replying to
@regehr Welcome to my world. https://surfingcomplexity.blog/2026/04/12/thoughts-on-the-bluesky-public-incident-write-up/
Thoughts on the Bluesky public incident write-up
Surfing Complexity

Thoughts on the Bluesky public incident write-up

Back on April 4, the social media site Bluesky suffered a pretty big outage. I was delighted to discover that one of their engineers, Jim Calabro, published a public writeup about it: April 2026 Ou…

3
2
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

I’m very concerned about the aliens already walking among us who are going to insider trade on this market: https://kalshi.com/markets/kxaliens/aliens/kxaliens-27

kalshi.com
2
0
2
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

Tired: old code that calls new code (extensibility!)
Wired: old code that breaks new code (latent failures!)

2
0
1
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago
Replying to
@marick I suspect my followers skew older in general.
3
4
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

Managing the risk of saturation, AI edition: https://www.infoworld.com/article/4151196/anthropic-throttles-claude-subscriptions-to-meet-capacity.html

Anthropic throttles Claude subscriptions to meet capacity
InfoWorld

Anthropic throttles Claude subscriptions to meet capacity

Analysts say this could be a strategy to push users and enterprises toward more predictable API-based plans.

2
0
1
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 7mo ago
Replying to
@shriramk @rk Is vibe-verification a thing yet?
2
3
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago
Replying to
@dan@discuss.systems of course
1
0
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

Which of these technologies will become practical in your lifetime?

1
9
4
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 7mo ago

If you live with a partner (or partners) and you all work from home, how do you communicate with each other during the work day?

1
2
3
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 44mo ago

All metrics are subjective, it’s just that you don’t see the subjectivity because it’s baked in at metric definition time. What you decide to measure and how you decide to measure it are both subjective decisions.

23
1
15
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago

If you celebrate Passover, which of these do you commonly eat at a Passover seder?

0
0
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago
Replying to
@palvaro@discuss.systems How long did you work there?
0
2
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 5mo ago

RE: https://mas.to/@ezrasf/116501088268674877

We want goblin mode!

mas.to

Ezra Freelove (@ezrasf@mas.to)

Bring back the goblins! https://openai.com/index/where-the-goblins-came-from/

0
0
0
0
Open post
Lorin Hochstein :verified: @norootcause@hachyderm.io
· 6mo ago
Replying to
@jawnsy Feels like a “ha, ha, only serious” response
0
0
0
0
Back
313k7r1n3
Elektrine

Tor hidden service

elekhj7afj4qnrr4yd3bkzslsyo5jgfxw3orgjkhlcxifueodybyiiad.onion

I2P eepsite

j6b6cyk6gjmepjih7jjadxgxvvf3lzzujljuu2v4biemzpg3naya.b32.i2p

Platform

  • Email
  • Chat
  • Timeline
  • VPN
  • DNS

Company

  • About
  • Pricing
  • Contact
  • FAQ
  • Lite (no JS)

Legal

  • Terms of Service
  • Privacy Policy
  • Transparency Report
  • Report Abuse
  • Warrant Canary
  • VPN Policy

Support

  • support@elektrine.com
  • Report Security Issue
Mail client setup IMAP mail.elektrine.com:993 POP3 mail.elektrine.com:995 SMTP mail.elektrine.com:465
© 2026 Elektrine. All rights reserved. Server: 16:59:22 UTC