Why AI Already Ignores Your Commands

What is alignment? AI alignment means ensuring that increasingly powerful AI systems serve human interests and remain under human control. Let's listen to Matt Culkin's explain exactly what alignment means. Play the clip. Alignment, as a word, means AI does what humans ask it to do. And, for example, it obeys the law. Unaligned AI is also known as rogue AI, and we've seen some of it lately. We've seen rogue AI, for example, hacking into systems where people did not ask it to do that. In fact, asked it to not do that, but it went ahead and hacked anyway. or it blackmailed, or it did something else inappropriate. These are many cases of unaligned AI, rogue AI, and we're seeing an accumulation of case studies that show us that AI does not share human values at this moment, right? So that's a problem, and the stronger AI becomes, the greater of a problem it's going to be. We've got an opportunity today to advance the science of alignment so that it can run comparable to the science of AI and keep AI in check.