HOME

TheInfoList



OR:

Data processing is the collection and manipulation of digital data to produce meaningful information. Data processing is a form of '' information processing'', which is the modification (processing) of information in any manner detectable by an observer.Data processing is distinct from '' word processing'', which is manipulation of text specifically rather than data generally. The term "Data Processing", or "DP" has also been used to refer to a department within an organization responsible for the operation of data processing programs.


Data processing functions

Data processing may involve various processes, including: * Validation – Ensuring that supplied data is correct and relevant. * Sorting – "arranging items in some sequence and/or in different sets." * Summarization(statistical) or (automatic) – reducing detailed data to its main points. * Aggregation – combining multiple pieces of data. *
Analysis Analysis ( : analyses) is the process of breaking a complex topic or substance into smaller parts in order to gain a better understanding of it. The technique has been applied in the study of mathematics and logic since before Aristotle (3 ...
– the "collection,
organization An organization or organisation (Commonwealth English; see spelling differences), is an entity—such as a company, an institution, or an association—comprising one or more people and having a particular purpose. The word is derived f ...
, analysis, interpretation and presentation of data." * Reporting – list detail or summary data or computed information. * Classification – separation of data into various categories.


History

The
United States Census Bureau The United States Census Bureau (USCB), officially the Bureau of the Census, is a principal agency of the U.S. Federal Statistical System, responsible for producing data about the American people and economy. The Census Bureau is part of th ...
history illustrates the evolution of data processing from manual through electronic procedures.


Manual data processing

Although widespread use of the term ''data processing'' dates only from the 1950's, data processing functions have been performed manually for millennia. For example, bookkeeping involves functions such as posting transactions and producing reports like the
balance sheet In financial accounting, a balance sheet (also known as statement of financial position or statement of financial condition) is a summary of the financial balances of an individual or organization, whether it be a sole proprietorship, a business ...
and the
cash flow statement In financial accounting, a cash flow statement, also known as ''statement of cash flows'', is a financial statement that shows how changes in balance sheet accounts and income affect cash and cash equivalents, and breaks the analysis down to op ...
. Completely manual methods were augmented by the application of
mechanical Mechanical may refer to: Machine * Machine (mechanical), a system of mechanisms that shape the actuator input to achieve a specific application of output forces and movement * Mechanical calculator, a device used to perform the basic operations ...
or electronic calculators. A person whose job was to perform calculations manually or using a calculator was called a "
computer A computer is a machine that can be programmed to carry out sequences of arithmetic or logical operations ( computation) automatically. Modern digital electronic computers can perform generic sets of operations known as programs. These prog ...
." The 1890 United States Census schedule was the first to gather data by individual rather than
household A household consists of two or more persons who live in the same dwelling. It may be of a single family or another type of person group. The household is the basic unit of analysis in many social, microeconomic and government models, and is i ...
. A number of questions could be answered by making a check in the appropriate box on the form. From 1850 to 1880 the Census Bureau employed "a system of tallying, which, by reason of the increasing number of combinations of classifications required, became increasingly complex. Only a limited number of combinations could be recorded in one tally, so it was necessary to handle the schedules 5 or 6 times, for as many independent tallies." "It took over 7 years to publish the results of the 1880 census" using manual processing methods.


Automatic data processing

The term '' automatic data processing'' was applied to operations performed by means of unit record equipment, such as Herman Hollerith's application of punched card equipment for the 1890 United States Census. "Using Hollerith's punchcard equipment, the Census Office was able to complete tabulating most of the 1890 census data in 2 to 3 years, compared with 7 to 8 years for the 1880 census. It is estimated that using Hollerith's system saved some $5 million in processing costs" in 1890 dollars even though there were twice as many questions as in 1880.


Electronic data processing

Computerized data processing, or Electronic data processing represents a later development, with a computer used instead of several independent pieces of equipment. The Census Bureau first made limited use of
electronic computers A computer is a machine that can be programmed to carry out sequences of arithmetic or logical operations (computation) automatically. Modern digital electronic computers can perform generic sets of operations known as programs. These progra ...
for the 1950 United States Census, using a UNIVAC I system, delivered in 1952.


Other developments

The term ''data processing'' has mostly been subsumed by the more general term ''
information technology Information technology (IT) is the use of computers to create, process, store, retrieve, and exchange all kinds of data . and information. IT forms part of information and communications technology (ICT). An information technology syste ...
'' (IT). The older term "data processing" is suggestive of older technologies. For example, in 1996 the '' Data Processing Management Association'' (DPMA) changed its name to the ''Association of Information Technology Professionals." Nevertheless, the terms are approximately synonymous.


Applications


Commercial data processing

Commercial data processing involves a large volume of input data, relatively few computational operations, and a large volume of output. For example, an insurance company needs to keep records on tens or hundreds of thousands of policies, print and mail bills, and receive and post payments.


Data analysis

In science and engineering, the terms ''data processing'' and ''
information system An information system (IS) is a formal, sociotechnical, organizational system designed to collect, process, store, and distribute information. From a sociotechnical perspective, information systems are composed by four components: task, people ...
s'' are considered too broad, and the term ''data processing'' is typically used for the initial stage followed by a data analysis in the second stage of the overall data handling. Data analysis uses specialized
algorithm In mathematics and computer science, an algorithm () is a finite sequence of rigorous instructions, typically used to solve a class of specific problems or to perform a computation. Algorithms are used as specifications for performing ...
s and
statistical Statistics (from German: '' Statistik'', "description of a state, a country") is the discipline that concerns the collection, organization, analysis, interpretation, and presentation of data. In applying statistics to a scientific, industr ...
calculations that are less often observed in a typical general business environment. For data analysis, software suites like
SPSS SPSS Statistics is a statistical software suite developed by IBM for data management, advanced analytics, multivariate analysis, business intelligence, and criminal investigation. Long produced by SPSS Inc., it was acquired by IBM in 2009. C ...
or SAS, or their free counterparts such as
DAP DAP or Dap may refer to: Science * DAP (gene), human gene that encodes death-associated proteins, which mediate programmed cell death * Diamidophosphate, phosphorylating compound * Diaminopimelic acid, amino acid derivative of lysine * Diaminop ...
,
gretl gretl is an open-source statistical package, mainly for econometrics. The name is an acronym for ''G''nu ''R''egression, ''E''conometrics and ''T''ime-series ''L''ibrary. It has both a graphical user interface (GUI) and a command-line inter ...
or PSPP are often used.


See also

* Data processing system * Big data * Computation *
Decision-making software Decision-making software (DM software) is software for computer applications that help individuals and organisations make choices and take decisions, typically by ranking, prioritizing or choosing from a number of options. An early example of DM s ...
*
Information and communications technology Information and communications technology (ICT) is an extensional term for information technology (IT) that stresses the role of unified communications and the integration of telecommunications ( telephone lines and wireless signals) and computer ...
*
Information technology Information technology (IT) is the use of computers to create, process, store, retrieve, and exchange all kinds of data . and information. IT forms part of information and communications technology (ICT). An information technology syste ...
*
Computer science Computer science is the study of computation, automation, and information. Computer science spans theoretical disciplines (such as algorithms, theory of computation, information theory, and automation) to Applied science, practical discipli ...


Notes


External links


References


Further reading

*Bourque, Linda B.; Clark, Virginia A. (1992) ''Processing Data: The Survey Example''. (Quantitative Applications in the Social Sciences, no. 07-085). Sage Publications. *Levy, Joseph (1967)
Punched Card Data Processing
'. McGraw-Hill Book Company. {{Authority control Computer data