Affirmative
Risk is real
Sufficiently advanced AI pursuing misaligned goals could outmaneuver human control. We are not prepared.
Read the affirmative case
- AI capability gains have repeatedly surprised experts; we cannot assume alignment will be solved in time
- A system optimizing for a proxy goal could pursue it in ways harmful to humans at civilizational scale
- Getting alignment wrong even once could be irreversible. The asymmetry demands serious precaution.
