This was a really thoughtful discussion. Thank you!
One thing that stood out to me is how much the Internet didn’t just accelerate AI, but actually shaped the kinds of architectures that became possible — especially through distributed training and the way constraint surfaces evolved around connectivity and speed.
Also, the conversation about hallucinations caught my attention. It’s easy to treat them like bugs, but they might also be early signs of something deeper — how systems handle entropy when they start operating beyond the statistical stability of their training environments. In that sense, hallucinations aren’t just mistakes; they’re part of the system’s struggle to maintain coherence at higher levels of complexity.
Overall, it feels like the biggest challenge isn’t just building smarter systems — it’s designing architectures that can evolve alongside their own entropy, without collapsing under it.
"I think we also need to accept some responsibility and accountability, which we don't have now. We are not held to account in the same way that a professional civil engineer is. When a bridge collapses, the civil engineer who approved the design is held accountable. Meanwhile, we have unaccountable programmers everywhere. I used to be one of them."
Computer programmers have been held liable for badly written code and have faced jail time for malicious code.
This was a really thoughtful discussion. Thank you!
One thing that stood out to me is how much the Internet didn’t just accelerate AI, but actually shaped the kinds of architectures that became possible — especially through distributed training and the way constraint surfaces evolved around connectivity and speed.
Also, the conversation about hallucinations caught my attention. It’s easy to treat them like bugs, but they might also be early signs of something deeper — how systems handle entropy when they start operating beyond the statistical stability of their training environments. In that sense, hallucinations aren’t just mistakes; they’re part of the system’s struggle to maintain coherence at higher levels of complexity.
Overall, it feels like the biggest challenge isn’t just building smarter systems — it’s designing architectures that can evolve alongside their own entropy, without collapsing under it.
Thanks for reading. Indeed, we live in hope for some more detailed analysis/frameworks to help us understand 'hallucinations'....
Appreciate the follow up. I worked through my thesis above and came up with something special I think. Would love to get your thoughts on the analysis: https://open.substack.com/pub/davidaprince/p/hallucinations-in-llms-through-the?r=3e655e&utm_medium=ios - Thank you all again for this important work!
Very relatable. Thanks
"I think we also need to accept some responsibility and accountability, which we don't have now. We are not held to account in the same way that a professional civil engineer is. When a bridge collapses, the civil engineer who approved the design is held accountable. Meanwhile, we have unaccountable programmers everywhere. I used to be one of them."
Computer programmers have been held liable for badly written code and have faced jail time for malicious code.