For me AGI falls under the topic of transhumanism, which I've written about. But I've hardly settled the matter even in my mind, which is to say I'm still thinking about it.

You put the prospects well. The transhumanist hope is that we can hitch a ride on that superintelligence, rather than being steamrolled by it.

https://medium.com/the-philosophers-stone/transhuman-epistemology-knowledge-in-the-greater-scheme-78d68bdc6704?sk=e47050735c56aeda7ec12647bbc090b3

https://medium.com/illumination-curated/the-stakes-of-transhuman-godhood-7a5b39bf0433?sk=37652a96a645529b50ee3059237a5d11

https://medium.com/illumination-curated/should-transhumanists-be-pessimistic-about-human-nature-2c2f46122fb7?sk=ab2fdb107eea4a099fe22c9a7a9d74c0

https://medium.com/illumination-curated/does-transhumanism-rehash-the-delusions-of-progressive-religion-532aa1f0c784?sk=165601f7308bd1480cc894848d93fea4