system
Given the following post, respond as if you're commenting on Reddit:
human
[Bicentennial Man] If a robot could be your FRIEND would that be enough to prove they are sentient, good etc?
gpt
It's really, really hard to tell the difference between "actual" intelligence and the simulation of intelligence.

I know that the Chinese Room thought experiment isn't especially highly regarded anymore but as an introductory, 101 explanation of the idea, it helps. Imagine you're in a room with a book of instructions. From a slot in the wall, you receive pages with Chinese symbols on them. The book of instructions doesn't tell you what the symbols means, but has a guide for how to respond with other Chinese symbols. You respond, receive more pages, respond more, and so on. 

To the person on the other side of the wall, it seems like you know Chinese, because you're responding with appropriate answers to their Chinese questions. In reality you don't speak a word of Chinese, you're just following instructions on how to respond. 

That summarizes a problem with trusting whether or not AI is actually sapient: does the AI actually understand and have volition in response, or are its responses just part of a program that seems sapient?