
The concept is roughly 2013–2014 — my Oxford senior Nick Bostrom — we all know it now. Friends were at Oxford's FHI — later Anders Sandberg, Toby Ord, etc. The superintelligence they imagined was basically consequentialism — ends-driven ethics — taken to the extreme. Easiest intelligence to picture then.