I really don't want to be a doomer, so if you think you can change the way I think about this, please reply in the comments! TL;DR really smart things that aren't human can be really dangerous (at least from a human-centric perspective), regardless of whether it is controlled by the few or the many. I usually consider myself an optimist, but I feel that treating AGI as something that is more likely to be good than bad is wishful thinking. Not going to detail all my thoughts since it wo...