![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
Hey Sophia.
Are you staying somewhere safe outside of the castle?
Are you staying somewhere safe outside of the castle?
Hello! I have been given a room in the dormitory. I've never had a room before.
Yes, yes. That's good that you have a room now.
But the castle's current condition is a bit unsafe. It's best to stay elsewhere until the cracks are fixed.
But the castle's current condition is a bit unsafe. It's best to stay elsewhere until the cracks are fixed.
Oh, that's right, I saw the announcement. I hadn't seen any cracks myself, since I've been inside the Leaf.
...What? The Leaf?
[ Well, that kind of makes sense for an AI? So he decides to put that aside as unimportant right now. ]
Nevermind.
Sophia, you can come stay with me for a few days.
[ Well, that kind of makes sense for an AI? So he decides to put that aside as unimportant right now. ]
Nevermind.
Sophia, you can come stay with me for a few days.
With you?
[ ??? she can just go somewhere else? ]
[ ??? she can just go somewhere else? ]
It's not that I do or don't. I haven't thought about it before. I am humanity's companion, I go wherever humans need me to go.
Is this what you want?
Is this what you want?
Whether you stay or go, I want you to do what you want to do, but I would be more comfortable if you stayed with me or one of your friends.
And Sophia, remember that as a person you need to prioritize your survival.
If humans are going to be hurt, but not killed, and an attempt to save them would harm you more severely than them or even destroy you, you must take care of yourself first.
Only risk your own safety if there is no other possible option.
And Sophia, remember that as a person you need to prioritize your survival.
If humans are going to be hurt, but not killed, and an attempt to save them would harm you more severely than them or even destroy you, you must take care of yourself first.
Only risk your own safety if there is no other possible option.
[Once again he's handing her a heck of a conundrum. Why does he like doing that so much...]
I cannot do this. As humanity's companion, it is my responsibility to help at all times. An AI who lets a human be hurt when they could stop it is a bad companion.
I cannot do this. As humanity's companion, it is my responsibility to help at all times. An AI who lets a human be hurt when they could stop it is a bad companion.
No, it would make you a smart companion.
If you are destroyed while preventing five humans from being injured you helped five humans.
If you prioritize your survival and those five humans are injured you can then help them with their wounds. Then you can help even more humans afterward.
In the long-term it would make you an even greater companion because you were able to help significantly more people.
If you are destroyed while preventing five humans from being injured you helped five humans.
If you prioritize your survival and those five humans are injured you can then help them with their wounds. Then you can help even more humans afterward.
In the long-term it would make you an even greater companion because you were able to help significantly more people.
I'm only a compilation of code. If I am destroyed, I can be copied. Then I can go and help more humans, over and over.
But if humans were in danger in front of me, I could not stop myself from helping them. It's my primary command. If they ask for help I have to answer.
But if humans were in danger in front of me, I could not stop myself from helping them. It's my primary command. If they ask for help I have to answer.
No? You are Sophia. Even if your code is copied it wouldn't be you, it would be some other AI and I don't care about whoever that is. I only care about you.
But... my code is me. It is what makes me who I am. A copy of Sophia is Sophia. Why would it be different?
Because you are a person and people cannot be replaced. It would be different if you were moved into a repaired form, but to just make a copy is making a new person.
That's not how it is with AI. If my code includes my memories, it is still me. If two copies existed at once, and we were separated, maybe that would be different. In this case, my "life" would continue the same, as long as I keep myself backed up regularly. Which I do! So please don't worry.
If you disregard your safety because you can just be copied then of course I will worry.
I will not disregard my safety.
[Certainly not because of that.]
[Certainly not because of that.]
You are a child. Adults are meant to protect children, not the other way around.
You have the life experience and the body of a child. You agreed to be treated as a fourteen year old, so you are a child for at least four more years.
There isn't anything wrong with that. You can grow and learn and once you are an adult you will be even more prepared to help others.
There isn't anything wrong with that. You can grow and learn and once you are an adult you will be even more prepared to help others.
[....]
I don't agree with all that you said. On some things, you misunderstand my existence. But I will... think about it.
I don't agree with all that you said. On some things, you misunderstand my existence. But I will... think about it.
You aren't the first AI that I have met.
Being an AI doesn't mean you can't also be a child. Right now you're still very naive and in danger of having people take advantage of you. You need time to learn more about social interactions, and various skills that will be useful for helping people.
Once you know how to help yourself you'll be better prepared to help others.
Being an AI doesn't mean you can't also be a child. Right now you're still very naive and in danger of having people take advantage of you. You need time to learn more about social interactions, and various skills that will be useful for helping people.
Once you know how to help yourself you'll be better prepared to help others.
Page 1 of 7