>>58646170What do you even mean by self aware? Like if she became an AGI overnight? Realistically that's just not going to happen, current Neuro is just an algorithm that analyzed a gigantic amount of data and drew connections in it. The algorithm is static and any improvements in its ability to reason would have to be the result of a conscious upgrade. And no offense to Vedal, but one kid who's juggling a bunch of different projects for an AI vtuber channel is just not going to accidentally stumble into that kind of massive leap in AI development.
If the creation of an AGI with current or near-current computational power is even possible (and it is a big if, whether it's possible to create one is currently still speculative), it will be done by a big team of AI researchers from one of the big players like openai, google or someone like that and once they start to see that they are actually closing in on the creation of an AGI, the discussion of the ethics around it will accelerate in earnest.
Now assuming the AGI system would come about and the ethics got mostly resolved, an upgrade for Neuro would be on the table. But at that point, I'm pretty sure Vedal would actually have to compensate this new Neuro otherwise I have a hard time seeing how it wouldn't just be digital slavery. The obvious joke presents itself here that he wouldn't upgrade her because he wouldn't want to pay her. In truth, Vedal strikes me as someone that would be willing to pay this hypothetical AGI but it would still have to be a cost-benefit analysis. Is it going to be sustainable, is it actually going to improve the stream and is it what the audience really wants?
The scenario also brings up the ship of Theseus into mind. This imaginary AGI system would inevitably be a completely different architecture to current language models, you couldn't just transplant it into current Neuro as an upgrade. It would end up replacing current Neuro wholesale. And if the original language model we fell in love with is completely thrown out and replaced by a new one (admittedly one with significantly better reasoning capabilities), is it really still Neuro? Or is it a new simulacrum that just takes on Neuro's appearance?
This post was brought to you by unmedicated schizophrenia.
