Wouldn't an unaligned AGI leave humanity alone and spread to the stars?
An artificial superintelligence wouldn’t have to choose between harvesting the earth for raw materials and advancing to the stars; it could easily do both at the same time. The raw materials in the earth are readily available, and could be used as fuel and materials more quickly than raw materials elsewhere.
Human civilization is not enough of a concern to a misaligned superintelligence to warrant passing up on the planet we stand on.