Is lack of open source AI currently a civilizational existential threat? No. Could it be if current trends continue? Potentially. Things could get pretty dystopian if only the mega rich control tools with ultra-intelligence.
“Could”, “potentially,” what-ifs. CEOs and actual cult leaders like Eli Yudkowsky have spoonfed the narrative to gullible journalists and politicians.
Yeah, it’s in AI companies interest to hype how all powerful their product is. I’m not necessarily talking about that.
When I say potentially, I’m not a doomer, so not trying to say there’s no hope, I do think we can make the world better than it is.
That said, one example of dystopian future: one of my clients makes networked security cameras. I saw a presentation where they were showing off their AI search capability. They had a static shot of an expressway, with hours of footage, and they said “I want to find a person in a bus wearing a brown shirt” and just like that pulled up the relevant moment. Not something you want an authoritarian to have. They’re going to get it anyways. But would love to have similar power available to the people.
Likewise when you think about accumulation of capital, which is shorthand for accumulation of power. AI will allow elites to accelerate that accumulation and have less use for people. “Who cares if you go on strike? I don’t need you.”
Having open source AI can turn the tables: “Who cares if you raised the price? I’ll make it myself.”
Ah, the fear of the potential thing as described by the ultra-rich.
Why do you trust them to be the ones who shape your fears?
I don’t think you’re engaging with what I’m saying sincerely, and I’m trying to do that with you.
I was responding directly to this.
“Could”, “potentially,” what-ifs. CEOs and actual cult leaders like Eli Yudkowsky have spoonfed the narrative to gullible journalists and politicians.
Why do you trust them?
Yeah, it’s in AI companies interest to hype how all powerful their product is. I’m not necessarily talking about that.
When I say potentially, I’m not a doomer, so not trying to say there’s no hope, I do think we can make the world better than it is.
That said, one example of dystopian future: one of my clients makes networked security cameras. I saw a presentation where they were showing off their AI search capability. They had a static shot of an expressway, with hours of footage, and they said “I want to find a person in a bus wearing a brown shirt” and just like that pulled up the relevant moment. Not something you want an authoritarian to have. They’re going to get it anyways. But would love to have similar power available to the people.
Likewise when you think about accumulation of capital, which is shorthand for accumulation of power. AI will allow elites to accelerate that accumulation and have less use for people. “Who cares if you go on strike? I don’t need you.”
Having open source AI can turn the tables: “Who cares if you raised the price? I’ll make it myself.”