TL;DR: (AI-generated 🤖)
The author, an early pioneer in the field of aligning artificial general intelligence (AGI), expresses concern about the potential dangers of creating a superintelligent AI. They highlight the lack of understanding and control over modern AI systems, emphasizing the need to shape the preferences and behavior of AGI to ensure it doesn’t harm humanity. The author predicts that the development of AGI smarter than humans, with different goals and values, could lead to disastrous consequences. They stress the urgency and seriousness required in addressing this challenge, suggesting measures such as banning large AI training runs to mitigate the risks. Ultimately, the author concludes that humanity must confront this issue with great care and consideration to avoid catastrophic outcomes.
Removed by mod
You have no idea what you’re talking about. AI is a black box right now, we understand how it works but we can’t properly control it and it still does a lot of unintentional behavior, like how chatbots can sometimes be aggressive or insult you. Chatbots like GPT try getting around this by having a million filters but the point is that the underlying AI doesn’t behave properly. Mix that with superintelligence and you can have an AI that does random things based on what it felt like doing. This is dangerous. We’re not asking to stop AI development, we’re asking to do it more responsibly and follow proper AI ethics which a lot of companies seem to start ignoring in favor of pushing out products faster.
And then you say:
Like if there was a way to control it?
Also:
So you are saying that AI is being pushed without any testing?
deleted by creator
They are already most powerful military in the world. What changes?
Lmao do we have an equivalent of /r/confidentlyincorrect on Lemmy?
I have a pretty solid opinion of Eliezer Yudkowsky. I’ve read material that he’s written in the past, and he’s not bullshitting in that; it’s well-thought through.
I haven’t watched the current video, but from what I’ve read from him in the past, Yudkowsky isn’t an opponent of developing AI. He’s pointing out that there are serious risks that need addressing.
It’s not as if there are two camps regarding AI, one “everything is perfect” utopian and the other Luddite and “we should avoid AI”.
EDIT: Okay, I went through the video. That’s certainly a lot blunter than he normally is. He’s advocating for a global ban on developing specifically superintelligent AI until we do have consensus on dealing with it and monitoring AI development in the meantime; he’s talking about countries being willing to go to war with countries that are developing them, so his answer would be “if Iran is working on a superintelligent AI, you bomb them preemptively”.
I’ll also add that I’m not actually sure that Yudkowsky’s suggestion in the video – monitoring labs with massive GPU arrays – would be sufficient if one starts talking about self-improving intelligence. I am quite skeptical that the kind of parallel compute capacity used today is truly necessary to do the kinds of tasks that we’re doing – rather, it’s because we are doing things inefficiently because we do not yet understand how to do them efficiently. True, your brain works in parallel, but it is also vastly slower – your brain’s neurons run at maybe 100 or 200 Hz, whereas our computer systems run with GHz clocks. I would bet that if it were used with the proper software today, if we had figured out the software side, a CPU on a PC today could act as a human does.
Alan Turing predicted in 1950 that we’d have the hardware to have human-level in about 2000.
That’s ~1GB to ~1PB of storage capacity, which he considered to be the limiting factor.
He was about right in terms of where we’d be with hardware, though we still don’t have the software side figured out yet.
Yudkowsky has a background in this, purely aside from likely being smarter than any five of us put together. Do let us all know how you’re qualified to call him a student, let alone a brainless one.