Universal psychometrics encompasses

psychometrics Psychometrics is a field of study within psychology concerned with the theory and technique of measurement. Psychometrics generally covers specialized fields within psychology and education devoted to testing, measurement, assessment, and rela ...

instruments that could measure the

psychological Psychology is the scientific study of mind and behavior. Its subject matter includes the behavior of humans and nonhumans, both consciousness, conscious and Unconscious mind, unconscious phenomena, and mental processes such as thoughts, feel ...

properties of any

intelligent agent In artificial intelligence, an intelligent agent is an entity that Machine perception, perceives its environment, takes actions autonomously to achieve goals, and may improve its performance through machine learning or by acquiring knowledge r ...

. Up until the early 21st century, psychometrics relied heavily on

psychological tests Psychological testing refers to the administration of psychological tests. Psychological tests are administered or scored by trained evaluators. A person's responses are evaluated according to carefully prescribed guidelines. Scores are thought t ...

that require the subject to cooperate and answer questions, the most famous example being an

intelligence test An intelligence quotient (IQ) is a total score derived from a set of standardized tests or subtests designed to assess human intelligence. Originally, IQ was a score obtained by dividing a person's mental age score, obtained by administering ...

. Such methods are only applicable to the measurement of human psychological properties. As a result, some researchers have proposed the idea of universal psychometrics - they suggest developing testing methods that allow for the measurement of non-human entities' psychological properties.Hernández-Orallo, J., Dowe, D. L., & Hernández-Lloreda, M. V. (2014)
Universal psychometrics: Measuring cognitive abilities in the machine kingdom
''Cognitive Systems Research'', 27, 50-74. For example, it has been suggested that the

Turing test The Turing test, originally called the imitation game by Alan Turing in 1949,. Turing wrote about the ‘imitation game’ centrally and extensively throughout his 1950 text, but apparently retired the term thereafter. He referred to ‘ iste ...

is a form of universal psychometrics. This test involves having testers (without any foreknowledge) attempt to distinguish a

human Humans (''Homo sapiens'') or modern humans are the most common and widespread species of primate, and the last surviving species of the genus ''Homo''. They are Hominidae, great apes characterized by their Prehistory of nakedness and clothing ...

from a

machine A machine is a physical system that uses power to apply forces and control movement to perform an action. The term is commonly applied to artificial devices, such as those employing engines or motors, but also to natural biological macromol ...

by interacting with both (while not being to see either individuals). It is supposed that if the machine is equally intelligent to a human, the testers will not be able to distinguish between the two, i.e., their guesses will not be better than chance. Thus, Turing test could measure the

intelligence Intelligence has been defined in many ways: the capacity for abstraction, logic, understanding, self-awareness, learning, emotional knowledge, reasoning, planning, creativity, critical thinking, and problem-solving. It can be described as t ...

(a psychological variable) of an AI.Saygin, A. P., Cicekli, I., & Akman, V. (2000). Turing test: 50 years later. ''Minds and machines'', 10(4), 463-518. Other instruments proposed for universal psychometrics include

reinforcement learning Reinforcement learning (RL) is an interdisciplinary area of machine learning and optimal control concerned with how an intelligent agent should take actions in a dynamic environment in order to maximize a reward signal. Reinforcement learnin ...

and measuring the ability to predict

complexity Complexity characterizes the behavior of a system or model whose components interact in multiple ways and follow local rules, leading to non-linearity, randomness, collective dynamics, hierarchy, and emergence. The term is generally used to c ...

.Hernandez-Orallo, J. (2000)
Beyond the Turing test
(PDF). ''Journal of Logic, Language and Information'', 9(4), 447-466.

References

Articles

*Hernández-Orallo, J. (2015). ''Universal Psychometrics Tasks: difficulty, composition and decomposition''. arXiv preprint arXiv:1503.07587. *Hernández-Orallo, J. (2017). ''The Measure of All Minds. Evaluating Natural and Artificial Intelligence''. Cambridge University Press. Psychometrics Artificial intelligence {{compu-ai-stub