>>12595429>brains limited capacityIf AI has to be trained with data sets that are ultimately rooted in information provided by humans, then it would eventually have to face the same kind of challenges humans do when it comes to optimally using physical resources, or even what the limits of them are. Sure, we could probably build spaceships and arcologies, but it's not like we'll have unlimited fuel, steel, glass, stone, or anything else. Even just to transport enough steel to build a small station from one planet to another, we'd still have to use ridiculous amounts of energy.
Even if a computer could make a guess on what a possible alternative fuel source or building material could be, it wouldn't necessarily be any more right than the most informed person in the world's guess.