This imaginary scenario is called "The Turing Test."But wait! You probably just said. How can the ability to fool someone into thinking that a machine is a person prove the machine can think? Well, Turing suggested, isn't that the same criterion we apply to each other every day? You don't really know anything about what's inside someone else. All you know is how they respond.
What Turing really wanted to do with this scenario was suggest that the question "Can machines think?" is much too vague to be useful. Perhaps we should just ask: "Can machines act like humans?" It may be the same thing.
Does this make you uncomfortable? Many psychologists, philosophers and computer researchers aren't convinced by Turing's argument -- but some are. Whether he was right or wrong, the "Turing Test" is a useful mind-game because it gets us to question many of the things we think we know...about thinking.