The Chinese room argument

In 1981, American philosopher John Searle proposed the “Chinese room” argument, a powerful rejoinder (a quick reply to a question or remark - especially a witty or critical one) to the idea that the Turing test can show that a machine could think. Suppose a human who knows no Chinese is locked in a room with a large set of Chinese characters and a manual that shows how to match questions in Chinese with appropriate responses from the set of Chinese characters. The room has a slot through which Chinese speakers can insert questions in Chinese and another slot through which the human can push out the appropriate responses from the manual. To the Chinese speakers outside, the room has passed the Turing test. However, since the human does not know Chinese and is just following the manual, no actual thinking is happening.

https://www.britannica.com/technology/Turing-test