In
regression analysis
In statistical modeling, regression analysis is a set of statistical processes for estimating the relationships between a dependent variable (often called the 'outcome' or 'response' variable, or a 'label' in machine learning parlance) and one ...
, partial leverage (PL) is a measure of the contribution of the individual
independent variable
Dependent and independent variables are variables in mathematical modeling, statistical modeling and experimental sciences. Dependent variables receive this name because, in an experiment, their values are studied under the supposition or deman ...
s to the
total leverage of each observation. That is, if ''h''
''i'' is the ''i''
th element of the diagonal of the
hat matrix, PL is a measure of how ''h''
''i'' changes as a variable is added to the regression model. It is computed as:
:
where
:''j'' = index of independent variable
:''i'' = index of observation
:''X''
''j''· 'j''/sub> = residuals from regressing ''X''''j'' against the remaining independent variables
Note that the partial leverage is the leverage of the ''i''th point in the partial regression plot In applied statistics, a partial regression plot attempts to show the effect of adding another variable to a model that already has one or more independent variables. Partial regression plots are also referred to as added variable plots, adjusted va ...
for the ''j''th variable. Data points with large partial leverage for an independent variable can exert undue influence on the selection of that variable in automatic regression model building procedures.
See also
* Leverage
* Partial residual plot
* Partial regression plot In applied statistics, a partial regression plot attempts to show the effect of adding another variable to a model that already has one or more independent variables. Partial regression plots are also referred to as added variable plots, adjusted va ...
* Variance inflation factor for a multi-linear fit
References
*
*
*
*
*
*
External links
Partial Leverage Plot
Dataplot
Dataplot is a public domain software system for scientific visualization and statistical analysis. It was developed and is being maintained at the National Institute of Standards and Technology. Dataplot's source code
In computing, source cod ...
manual, Statistical Engineering Division, National Institute of Standards and Technology
The National Institute of Standards and Technology (NIST) is an agency of the United States Department of Commerce whose mission is to promote American innovation and industrial competitiveness. NIST's activities are organized into Outline of p ...
{{NIST-PD
Regression diagnostics