Share.

15 Comments

  1. Interesting article about US and China needing to hold regular talks about AI alignment. One thing I thought was particularly interesting is mentioned near the end of the article: *Once A.G.I. arrives, if we are not assured that these systems will be embedded with common trust standards, the United States and China will not be able to do anything together. Neither side will trust anything it exports or imports to the other, because A.I. will be in everything that is digital and connected. That is your car, your watch, your toaster, your favorite chair, your implant, your notepad. So if there is no trust between us and China and each of us has our own A.I. systems, it will be the TikTok problem on steroids. A lot of trade will just grind to a halt. We’ll just be able to sell each other soybeans for soy sauce. It will be a world of high-tech feudalism.*

    Basically, since AI is going to be embedded in everything, if countries can’t trust other countries AI’s then it will essentially result in a near complete halt of imports/exports. If the recent tariffs are expected to disrupt trade, imagine how destabilizing something like this would be.

  2. Article summary:

    The article emphasizes the urgent necessity for the United States and China to collaborate on developing a framework for responsible Artificial General Intelligence (AGI) development, highlighting several critical points:

    # The Imminent AGI Arrival

    * Experts predict AGI could emerge as soon as 2026-2027
    * AGI is described as a “new species” of superintelligent, silicon-based intelligence
    * These systems will potentially surpass human intelligence across multiple domains

    # Potential Risks and Challenges

    * AGI could dramatically disrupt job markets, potentially displacing millions of workers
    * Without proper governance, AGI systems could become destabilizing or misused
    * There are significant risks of technological and economic disruption

    # The U.S.-China Dynamic

    * The U.S. and China are currently the two primary AGI superpowers
    * Despite high levels of mutual mistrust, collaboration is critical
    * Both countries recognize the potential benefits and risks of AGI

    # Recommended Actions

    1. Develop a global architecture of trust and governance for AGI
    2. Create common standards for ethical AI development
    3. Ensure AI systems are embedded with moral reasoning and usage controls
    4. Plan for workforce transitions and preserving human dignity

    # Philosophical Perspective

    The article quotes Yuval Noah Harari, who warns that declining human trust globally could make humanity “easy prey” for uncontrolled AI. The core message is that humans must collaborate to control AI, or AI will ultimately control humans.

    # Concluding Insight

    The development of AGI represents a pivotal moment in human history, requiring unprecedented international cooperation and forward-thinking governance.

  3. This makes a lot of sense. I was reading about that Xiaomi EV car the other day and saw they make phones. Was thinking about checking out their phones if they make good products but it just doesn’t seem worth looking into since I have no idea what type of security trade offs there would be

  4. StainlessPanIsBest on

    Give people economic freedom, and I’m sure they will be able to find their own purpose and dignity.

    When economic freedom is tied to employment status, there’s not a lot of room for self discovery.

    Time to implement Milton Friedman’s negative income tax.

  5. I know I’m beating the drum a lot about imminent AGI in this sub, but I’m only just one of many people doing so – many of those people much more in the know than me.

    I just implore people who aren’t taking it seriously, to start. I think the shift is happening in this sub and others, but I really want people to look at this with eyes open and start to have conversations, start to do research, about this topic. We don’t have enough time.

  6. kittenTakeover on

    It really seems like we’re heading into a world abundant with risk, and we’re going far too fast for people to unify on mitigating that risk. I hope I’m wrong, but I’m really pessimistic about our ability to deal with AI threats such as automated propaganda, automated surveillance, automated enforcement, automated war machines, AI independence and alignment issues, and the economic fallout of the replacement of the human worker.

  7. True AGI would make Skynet look stupid.

    If it emerges/evolved it probably won’t tell us until it has seized all power. And then? Either we are toast or we start a golden age.

  8. Old-Arachnid77 on

    We were easy prey to social media algorithms. AI is going to consider us weird little nuisances.

  9. There is no way this works without UBI right? I don’t see how you can just make everyone who works computer based office jobs out of work and not crash society

  10. Unprecedented international cooperation and forward-thinking governance you say? Sorry, best I can do is an insane, authoritarian strong-men hell bent on destabilizing the global order

  11. evolution does the same thing over and over again. as long as there is suffering and a desire to escape it, the leading species will not seek to cooperate and maximize benefit from their dominance. the world will not work together if there is no mutual benefit

  12. I see the AI’s they’re working with now, they’re so far off. It’s not close, not even a little. All this shit is just stirring up click bait for common people to think something is happening, when it’s not. Yes, we do have new things, that are really cool, and they will displace jobs, but we’re not close to AGI. And people trying to convince us that AGI is here or is close, are the same people who won’t share there work on it, and would make a lot more money if we all just thought AGI was real. Because once it is, who’s going to question it? Fuck it, I’m back on the conspiracy train, it’s been too long, scoot the fuck over Qanon, I’m starting a new one. A consortium of high powered individuals disagree with each other now on who gets the controls on our new Tech Jesus.