In
natural
Nature, in the broadest sense, is the physical world or universe. "Nature" can refer to the phenomena of the physical world, and also to life in general. The study of nature is a large, if not the only, part of science. Although humans are ...
and
social science
Social science is one of the branches of science, devoted to the study of societies and the relationships among individuals within those societies. The term was formerly used to refer to the field of sociology, the original "science of soc ...
research, a protocol is most commonly a predefined
procedural method in the design and implementation of an
experiment
An experiment is a procedure carried out to support or refute a hypothesis, or determine the efficacy or likelihood of something previously untried. Experiments provide insight into cause-and-effect by demonstrating what outcome occurs wh ...
. Protocols are written whenever it is desirable to standardize a laboratory method to ensure successful
replication
Replication may refer to:
Science
* Replication (scientific method), one of the main principles of the scientific method, a.k.a. reproducibility
** Replication (statistics), the repetition of a test or complete experiment
** Replication crisi ...
of results by others in the same laboratory or by other laboratories.
Additionally, and by extension, protocols have the advantage of facilitating the assessment of experimental results through
peer review
Peer review is the evaluation of work by one or more people with similar competencies as the producers of the work ( peers). It functions as a form of self-regulation by qualified members of a profession within the relevant field. Peer revie ...
.
In addition to detailed procedures, equipment, and instruments, protocols will also contain study objectives, reasoning for experimental design, reasoning for chosen sample sizes, safety precautions, and how results were calculated and reported, including statistical analysis and any rules for predefining and documenting excluded data to avoid bias.
Similarly, a protocol may refer to the procedural methods of health organizations, commercial laboratories, manufacturing plants, etc. to ensure their activities (e.g.,
blood test
A blood test is a laboratory analysis performed on a blood sample that is usually extracted from a vein in the arm using a hypodermic needle, or via fingerprick. Multiple tests for specific blood components, such as a glucose test or a ch ...
ing at a hospital, testing of
certified reference materials
Certified reference materials (CRMs) are 'controls' or standards used to check the quality and metrological traceability of products, to validate analytical measurement methods, or for the calibration of instruments. A certified reference materi ...
at a calibration laboratory, and manufacturing of
transmission
Transmission may refer to:
Medicine, science and technology
* Power transmission
** Electric power transmission
** Propulsion transmission, technology allowing controlled application of power
*** Automatic transmission
*** Manual transmission
** ...
gears at a facility) are consistent to a specific standard, encouraging safe use and accurate results.
Finally, in the field of social science, a protocol may also refer to a "descriptive record" of observed events
or a "sequence of behavior"
of one or more organisms, recorded during or immediately after an activity (e.g., how an infant reacts to certain stimuli or how gorillas behave in natural habitat) to better identify "consistent patterns and cause-effect relationships."
These protocols may take the form of hand-written journals or electronically documented media, including video and audio capture.
Experiment and study protocol
Various fields of science, such as environmental science and clinical research, require the coordinated, standardized work of many participants. Additionally, any associated laboratory testing and experiment must be done in a way that is both ethically sound and results can be replicated by others using the same methods and equipment. As such, rigorous and vetted testing and experimental protocols are required. In fact, such predefined protocols are an essential component of
Good Laboratory Practice
In the experimental (non-clinical) research arena, good laboratory practice or GLP is a quality system of management controls for research laboratories and organizations to ensure the uniformity, consistency, reliability, reproducibility, qualit ...
(GLP)
and
Good Clinical Practice (GCP)
regulations. Protocols written for use by a specific laboratory may incorporate or reference
standard operating procedure
A standard operating procedure (SOP) is a set of step-by-step instructions compiled by an organization to help workers carry out routine operations. SOPs aim to achieve efficiency, quality output, and uniformity of performance, while reducing misc ...
s (SOP) governing general practices required by the laboratory. A protocol may also reference applicable laws and regulations that are applicable to the procedures described. Formal protocols typically require approval by one or more individuals—including for example a laboratory directory, study director,
and/or independent ethics committee
—before they are implemented for general use. Clearly defined protocols are also required by research funded by the
National Institutes of Health
The National Institutes of Health, commonly referred to as NIH (with each letter pronounced individually), is the primary agency of the United States government
The federal government of the United States (U.S. federal government or U ...
.
In a
clinical trial
Clinical trials are prospective biomedical or behavioral research studies on human subject research, human participants designed to answer specific questions about biomedical or behavioral interventions, including new treatments (such as novel v ...
, the protocol is carefully designed to safeguard the health of the participants as well as answer specific research questions. A protocol describes what types of people may participate in the trial; the schedule of tests, procedures, medications, and dosages; and the length of the study. While in a clinical trial, participants following a protocol are seen regularly by research staff to monitor their health and to determine the safety and effectiveness of their treatment.
Since 1996, clinical trials conducted are widely expected to conform to and report the information called for in the
CONSORT __NOTOC__
Consort may refer to:
Music
* "The Consort" (Rufus Wainwright song), from the 2000 album ''Poses''
* Consort of instruments, term for instrumental ensembles
* Consort song (musical), a characteristic English song form, late 16th–earl ...
Statement, which provides a framework for designing and reporting protocols.
Though tailored to health and medicine, ideas in the CONSORT statement are broadly applicable to other fields where experimental research is used.
Protocols will often address:
* ''safety'': Safety precautions are a valuable addition to a protocol, and can range from requiring goggles to provisions for containment of microbes, environmental hazards, toxic substances, and volatile solvents. Procedural contingencies in the event of an accident may be included in a protocol or in a referenced
SOP.
* ''procedures'': Procedural information may include not only safety procedures but also procedures for avoiding contamination, calibration of equipment, equipment testing, documentation, and all other relevant issues. These procedural protocols can be used by skeptics to invalidate any claimed results if flaws are found.
* ''equipment used'': Equipment testing and documentation includes all necessary specifications, calibrations, operating ranges, etc. Environmental factors such as temperature, humidity, barometric pressure, and other factors can often have effects on results. Documenting these factors should be a part of any good procedure.
* ''reporting'': A protocol may specify reporting requirements. Reporting requirements would include all elements of the experiments design and protocols and any environmental factors or mechanical limitations that might affect the validity of the results.
* ''calculations and statistics'': Protocols for methods that produce numerical results generally include detailed formulas for calculation of results. A formula may also be included for preparation of reagents and other solutions required for the work. Methods of
statistical analysis
Statistical inference is the process of using data analysis to infer properties of an underlying distribution of probability.Upton, G., Cook, I. (2008) ''Oxford Dictionary of Statistics'', OUP. . Inferential statistical analysis infers propertie ...
may be included to guide interpretation of the data.
* ''bias'': Many protocols include provisions for avoiding bias in the interpretation of results.
Approximation error
The approximation error in a data value is the discrepancy between an exact value and some ''approximation'' to it. This error can be expressed as an absolute error (the numerical amount of the discrepancy) or as a relative error (the absolute er ...
is common to all measurements. These errors can be absolute errors from limitations of the equipment or propagation errors from approximate numbers used in calculations.
Sample bias
In statistics, sampling bias is a bias in which a sample is collected in such a way that some members of the intended population have a lower or higher sampling probability than others. It results in a biased sample of a population (or non-human f ...
is the most common and sometimes the hardest bias to quantify. Statisticians often go to great lengths to ensure that the
sample used is representative. For instance political polls are best when restricted to likely voters and this is one of the reasons why web polls cannot be considered scientific. The
sample size
Sample size determination is the act of choosing the number of observations or replicates to include in a statistical sample. The sample size is an important feature of any empirical study in which the goal is to make inferences about a populatio ...
is another important concept and can lead to biased data simply due to an unlikely event. A sample size of 10, i.e., polling 10 people, will seldom give valid polling results.
Standard deviation and
variance
In probability theory and statistics, variance is the expectation of the squared deviation of a random variable from its population mean or sample mean. Variance is a measure of dispersion, meaning it is a measure of how far a set of number ...
are concepts used to quantify the likely relevance of a given
sample size
Sample size determination is the act of choosing the number of observations or replicates to include in a statistical sample. The sample size is an important feature of any empirical study in which the goal is to make inferences about a populatio ...
. The
placebo effect
A placebo ( ) is a substance or treatment which is designed to have no therapeutic value. Common placebos include inert tablets (like sugar pills), inert injections (like saline), sham surgery, and other procedures.
In general, placebos can aff ...
and
observer bias Observer bias is one of the types of detection bias and is defined as any kind of systematic divergence from accurate facts during observation and the recording of data and information in studies. The definition can be further expanded upon to inclu ...
often require the blinding of patients and researchers as well as a
control group
In the design of experiments, hypotheses are applied to experimental units in a treatment group.
In comparative experiments, members of a control group receive a standard treatment, a placebo, or no treatment at all. There may be more than one t ...
.
Best practice recommends publishing the protocol of the review before initiating it to reduce the risk of unplanned research duplication and to enable transparency, and consistency between methodology and protocol.
Blinded protocols
A protocol may require blinding to avoid bias.
A blind can be imposed on any participant of an experiment, including subjects, researchers, technicians, data analysts, and evaluators. In some cases, while blinding would be useful, it is impossible or unethical. A good clinical protocol ensures that blinding is as effective as possible within ethical and practical constrains.
During the course of an experiment, a participant becomes
unblinded if they deduce or otherwise obtain information that has been masked to them. Unblinding that occurs before the conclusion of a study is a source of experimental error, as the bias that was eliminated by blinding is re-introduced. Unblinding is common in blind experiments, and must be measured and reported.
Reporting guidelines Reporting may refer to
* any activity that leads to reports
* in particular business reporting
*Data reporting
*Sustainability reporting
*Financial reporting
* international reporting of financial information for tax purposes under the OECD's Commo ...
recommend that all studies assess and report unblinding. In practice, very few studies assess unblinding.
An experimenter may have latitude defining procedures for blinding and controls but may be required to justify those choices if the results are published or submitted to a regulatory agency. When it is known during the experiment which data was negative there are often reasons to rationalize why that data shouldn't be included. Positive data are rarely rationalized the same way.
See also
References
{{reflist
Design of experiments
Good practice
Research
Scientific method