Anthropic’s Chief on A.I.: ‘We Don’t Know if the Models Are Conscious’ Dario Amodei shares his utopian — and dystopian — predictions in the near term for artificial intelligence.

From the article 

Are the lords of artificial intelligence on the side of the human race? That’s the core question I had for this week’s guest. Dario Amodei is the chief executive of Anthropic, one of the fastest growing AI companies. He’s something of a utopian when it comes to the potential benefits of the technology that he’s unleashing on the world. But he also sees grave dangers ahead and inevitable disruption

It seems like a lot of these companies want to or need to make money so instead of curing your depression so you go out and live your best life they infect you with a mental illness that leads you to continue to interact with the platform in a way that is optimized for the company’s financial gain.

We are obsessed with scaling ‘iron’—hoarding DDR5 and Gigawatts—expecting consciousness to simply ’emerge’ from brute force. But we’re ignoring a fundamental reality of scale: A single gram of sourdough starter possesses more computational complexity and parallel processing states than our most advanced data centers.
​While a data center manages exabytes of static bits, that gram of dough orchestrates billions of autonomous biological ‘processors’ (cells), each running a 12-million-base-pair OS (DNA) with real-time, fuzzy-logic responses to the environment.
​Maybe Amodei can’t find a ‘consciousness-meter’ because he’s looking for it in the desert of binary logic. The real ‘Singularity’ won’t be a massive explosion of server power, but a quiet shift toward the elegant, non-numerical resonance of a ‘matchbox’ logic. We don’t need a bigger Golem; we need a better word on its forehead.”