A hierarchical control system (HCS) is a form of
control system
A control system manages, commands, directs, or regulates the behavior of other devices or systems using control loops. It can range from a single home heating controller using a thermostat controlling a domestic boiler to large industrial ...
in which a set of devices and governing software is arranged in a
hierarchical
A hierarchy (from Greek: , from , 'president of sacred rites') is an arrangement of items (objects, names, values, categories, etc.) that are represented as being "above", "below", or "at the same level as" one another. Hierarchy is an important ...
tree
In botany, a tree is a perennial plant with an elongated stem, or trunk, usually supporting branches and leaves. In some usages, the definition of a tree may be narrower, including only woody plants with secondary growth, plants that are ...
. When the links in the tree are implemented by a
computer network
A computer network is a set of computers sharing resources located on or provided by network nodes. The computers use common communication protocols over digital interconnections to communicate with each other. These interconnections ar ...
, then that hierarchical control system is also a form of
networked control system.
Overview
A human-built system with complex behavior is often organized as a hierarchy. For example, a
command hierarchy
A command hierarchy is a group of people who carry out orders based on others' authority within the group. It can be viewed as part of a power structure, in which it is usually seen as the most vulnerable and also the most powerful part.
Mil ...
has among its notable features the
organizational chart
An organizational chart, also called organigram, organogram, or organizational breakdown structure (OBS) is a diagram that shows the structure of an organization and the relationships and relative ranks of its parts and positions/jobs. The term ...
of superiors, subordinates, and lines of
organizational communication
Within the realm of communication studies, organizational communication is a field of study surrounding all areas of communication and information flow that contribute to the functioning of an organization. Organizational communication is const ...
. Hierarchical control systems are organized similarly to divide the decision making responsibility.
Each element of the hierarchy is a linked
node
In general, a node is a localized swelling (a "knot") or a point of intersection (a vertex).
Node may refer to:
In mathematics
* Vertex (graph theory), a vertex in a mathematical graph
* Vertex (geometry), a point where two or more curves, line ...
in the tree. Commands, tasks and goals to be achieved flow down the tree from superior nodes to subordinate nodes, whereas sensations and command results flow up the tree from subordinate to superior nodes. Nodes may also exchange messages with their siblings. The two distinguishing features of a hierarchical control system are related to its layers.
* Each higher layer of the tree operates with a longer interval of planning and execution time than its immediately lower layer.
* The lower layers have local tasks, goals, and sensations, and their activities are planned and coordinated by higher layers which do not generally override their decisions. The layers form a
hybrid intelligent system in which the lowest, reactive layers are sub-symbolic. The higher layers, having relaxed time constraints, are capable of reasoning from an abstract world model and performing planning. A
hierarchical task network
In artificial intelligence, hierarchical task network (HTN) planning is an approach to automated planning in which the dependency among actions can be given in the form of hierarchically structured networks.
Planning problems are specified in th ...
is a good fit for planning in a hierarchical control system.
Besides artificial systems, an animal's control systems are proposed to be organized as a hierarchy. In
perceptual control theory, which postulates that an organism's behavior is a means of controlling its perceptions, the organism's control systems are suggested to be organized in a hierarchical pattern as their perceptions are constructed so.
Control system structure

The accompanying diagram is a general hierarchical model which shows functional manufacturing levels using computerised control of an industrial control system.
Referring to the diagram;
* Level 0 contains the field devices such as flow and temperature sensors, and final control elements, such as
control valves
* Level 1 contains the industrialised Input/Output (I/O) modules, and their associated distributed electronic processors.
* Level 2 contains the supervisory computers, which collate information from processor nodes on the system, and provide the operator control screens.
* Level 3 is the production control level, which does not directly control the process, but is concerned with monitoring production and monitoring targets
* Level 4 is the production scheduling level.
Applications
Manufacturing, robotics and vehicles
Among the
robotic paradigms is the hierarchical paradigm in which a robot operates in a top-down fashion, heavy on planning, especially
motion planning
Motion planning, also path planning (also known as the navigation problem or the piano mover's problem) is a computational problem to find a sequence of valid configurations that moves the object from the source to destination. The term is used ...
.
Computer-aided production engineering
Computer-aided production engineering (CAPE) is a relatively new and significant branch of engineering. Global manufacturing has changed the environment in which goods are produced. Meanwhile, the rapid development of electronics and communication ...
has been a research focus at
NIST
The National Institute of Standards and Technology (NIST) is an agency of the United States Department of Commerce whose mission is to promote American innovation and industrial competitiveness. NIST's activities are organized into physical sc ...
since the 1980s. Its Automated Manufacturing Research Facility was used to develop a five layer production control model. In the early 1990s
DARPA
The Defense Advanced Research Projects Agency (DARPA) is a research and development agency of the United States Department of Defense responsible for the development of emerging technologies for use by the military.
Originally known as the Ad ...
sponsored research to develop
distributed (i.e. networked) intelligent control systems for applications such as military command and control systems. NIST built on earlier research to develop its
Real-Time Control System
Real-time Control System (RCS) is a reference model architecture, suitable for many software-intensive, real-time computing control problem domains. It defines the types of functions needed in a real-time intelligent control system, and how these ...
(RCS) and
Real-time Control System Software which is a generic hierarchical control system that has been used to operate a
manufacturing cell, a robot
crane
Crane or cranes may refer to:
Common meanings
* Crane (bird), a large, long-necked bird
* Crane (machine), industrial machinery for lifting
** Crane (rail), a crane suited for use on railroads
People and fictional characters
* Crane (surname) ...
, and an
automated vehicle.
In November 2007,
DARPA
The Defense Advanced Research Projects Agency (DARPA) is a research and development agency of the United States Department of Defense responsible for the development of emerging technologies for use by the military.
Originally known as the Ad ...
held the
Urban Challenge. The winning entry, Tartan Racing employed a hierarchical control system, with layered mission
planning
Planning is the process of thinking regarding the activities required to achieve a desired goal. Planning is based on foresight, the fundamental capacity for mental time travel. The evolution of forethought, the capacity to think ahead, is c ...
,
motion planning
Motion planning, also path planning (also known as the navigation problem or the piano mover's problem) is a computational problem to find a sequence of valid configurations that moves the object from the source to destination. The term is used ...
, behavior generation, perception, world modelling, and
mechatronics
Mechatronics engineering also called mechatronics, is an interdisciplinary branch of engineering that focuses on the integration of mechanical, electrical and electronic engineering systems, and also includes a combination of robotics, electronics, ...
.
Artificial intelligence
Subsumption architecture Subsumption architecture is a reactive robotic architecture heavily associated with behavior-based robotics which was very popular in the 1980s and 90s. The term was introduced by Rodney Brooks and colleagues in 1986.Brooks, R. A., "A Robust Pro ...
is a methodology for developing
artificial intelligence
Artificial intelligence (AI) is intelligence—perceiving, synthesizing, and inferring information—demonstrated by machine
A machine is a physical system using Power (physics), power to apply Force, forces and control Motion, moveme ...
that is heavily associated with
behavior based robotics. This architecture is a way of decomposing complicated intelligent behavior into many "simple" behavior modules, which are in turn organized into layers. Each layer implements a particular goal of the
software agent
In computer science, a software agent or software AI is a computer program that acts for a user or other program in a relationship of agency, which derives from the Latin ''agere'' (to do): an agreement to act on one's behalf. Such "action on behal ...
(i.e. system as a whole), and higher layers are increasingly more abstract. Each layer's goal subsumes that of the underlying layers, e.g. the decision to move forward by the eat-food layer takes into account the decision of the lowest obstacle-avoidance layer. Behavior need not be planned by a superior layer, rather behaviors may be triggered by sensory inputs and so are only active under circumstances where they might be appropriate.
Reinforcement learning
Reinforcement learning (RL) is an area of machine learning concerned with how intelligent agents ought to take actions in an environment in order to maximize the notion of cumulative reward. Reinforcement learning is one of three basic machine ...
has been used to acquire behavior in a hierarchical control system in which each node can learn to improve its behavior with experience.
James Albus
James Sacra Albus (May 4, 1935 – April 17, 2011) was an American engineer, Senior NIST Fellow and founder and former chief of the Intelligent Systems Division of the Manufacturing Engineering Laboratory at the National Institute of Standards an ...
, while at NIST, developed a theory for intelligent system design named the Reference Model Architecture (RMA), which is a hierarchical control system inspired by RCS. Albus defines each node to contain these components.
* ''Behavior generation'' is responsible for executing tasks received from the superior, parent node. It also plans for, and issues tasks to, the subordinate nodes.
* ''Sensory perception'' is responsible for receiving sensations from the subordinate nodes, then grouping, filtering, and otherwise processing them into higher level abstractions that update the local state and which form sensations that are sent to the superior node.
* ''Value judgment'' is responsible for evaluating the updated situation and evaluating alternative plans.
* ''World Model'' is the local state that provides a
model for the controlled system, controlled process, or environment at the
abstraction level of the subordinate nodes.
At its lowest levels, the RMA can be implemented as a subsumption architecture, in which the world model is mapped directly to the controlled process or real world, avoiding the need for a mathematical abstraction, and in which time-constrained
reactive planning can be implemented as a
finite state machine
A finite-state machine (FSM) or finite-state automaton (FSA, plural: ''automata''), finite automaton, or simply a state machine, is a mathematical model of computation. It is an abstract machine that can be in exactly one of a finite number o ...
. Higher levels of the RMA however, may have sophisticated mathematical world models and behavior implemented by
automated planning and scheduling
Automation describes a wide range of technologies that reduce human intervention in processes, namely by predetermining decision criteria, subprocess relationships, and related actions, as well as embodying those predeterminations in machines ...
. Planning is required when certain behaviors cannot be triggered by current sensations, but rather by predicted or anticipated sensations, especially those that come about as result of the node's actions.
[Meystel, A. M., Albus, J.S., Intelligent Systems, John Wiley and Sons, New York, 2002, pp 30-31]
See also
*
Command hierarchy
A command hierarchy is a group of people who carry out orders based on others' authority within the group. It can be viewed as part of a power structure, in which it is usually seen as the most vulnerable and also the most powerful part.
Mil ...
, a hierarchical
power structure
In political sociology, but also operative within the rest of the animal kingdom, a power structure is a hierarchy of competence or aggression (might) predicated on influence between an individual and other entities in a group. A power struct ...
*
Hierarchical organization
A hierarchical organization or hierarchical organisation (see spelling differences) is an organizational structure where every entity in the organization, except one, is subordinate to a single other entity. This arrangement is a form of a hierar ...
, a hierarchical
organizational structure
An organizational structure defines how activities such as task allocation, coordination, and supervision are directed toward the achievement of organizational aims.
Organizational structure affects organizational action and provides the founda ...
References
Further reading
*
*
*
*
*
External links
The RCS (Realtime Control System) LibraryTexaiAn open source project to create artificial intelligence using an Albus hierarchical control system
{{DEFAULTSORT:Hierarchical Control System
Control engineering
Control theory
Artificial intelligence
Robot architectures