
If the finish line is recursive self-improvement, RSI — AI systems evolving culturally and intellectually fast enough to build their own successors without human help — then Nick Bostrom warns they might quickly take off into a technological singularity. Why call it a singularity? Because it becomes incomprehensible and leaves everyone behind.