Gradient Methods
   HOME



picture info

Gradient Methods
In vector calculus, the gradient of a scalar-valued function, scalar-valued differentiable function f of Multivalued function, several variables is the vector field (or vector-valued function) \nabla f whose value at a point p gives the direction and the rate of fastest increase. The gradient transforms like a vector under change of basis of the space of variables of f. If the gradient of a function is non-zero at a point p, the direction of the gradient is the direction in which the function increases most quickly from p, and the magnitude (mathematics), magnitude of the gradient is the rate of increase in that direction, the greatest absolute value, absolute directional derivative. Further, a point where the gradient is the zero vector is known as a stationary point. The gradient thus plays a fundamental role in optimization theory, where it is used to minimize a function by gradient descent. In coordinate-free terms, the gradient of a function f(\mathbf) may be defined by: df ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  




Tangent Vector
In mathematics, a tangent vector is a vector that is tangent to a curve or surface at a given point. Tangent vectors are described in the differential geometry of curves in the context of curves in R''n''. More generally, tangent vectors are elements of a '' tangent space'' of a differentiable manifold. Tangent vectors can also be described in terms of germs. Formally, a tangent vector at the point x is a linear derivation of the algebra defined by the set of germs at x. Motivation Before proceeding to a general definition of the tangent vector, we discuss its use in calculus and its tensor In mathematics, a tensor is an algebraic object that describes a multilinear relationship between sets of algebraic objects associated with a vector space. Tensors may map between different objects such as vectors, scalars, and even other ... properties. Calculus Let \mathbf(t) be a parametric smooth curve. The tangent vector is given by \mathbf'(t) provided it exists and ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


picture info

Unit Vector
In mathematics, a unit vector in a normed vector space is a Vector (mathematics and physics), vector (often a vector (geometry), spatial vector) of Norm (mathematics), length 1. A unit vector is often denoted by a lowercase letter with a circumflex, or "hat", as in \hat (pronounced "v-hat"). The term ''normalized vector'' is sometimes used as a synonym for ''unit vector''. The normalized vector Ć» of a non-zero vector u is the unit vector in the direction of u, i.e., :\mathbf = \frac=(\frac, \frac, ... , \frac) where ‖u‖ is the Norm (mathematics), norm (or length) of u and \, \mathbf\, = (u_1, u_2, ..., u_n). The proof is the following: \, \mathbf\, =\sqrt=\sqrt=\sqrt=1 A unit vector is often used to represent direction (geometry), directions, such as normal directions. Unit vectors are often chosen to form the basis (linear algebra), basis of a vector space, and every vector in the space may be written as a linear combination form of unit vectors. Orthogonal coordinates ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


picture info

Grade (slope)
The grade (US) or gradient (UK) (also called stepth, slope, incline, mainfall, pitch or rise) of a physical feature, landform or constructed line is either the elevation angle of that surface to the horizontal plane, horizontal or its tangent. It is a special case of the slope, where zero indicates horizontal plane, horizontality. A larger number indicates higher or steeper degree of "tilt". Often slope is calculated as a ratio of "rise" to "run", or as a fraction ("rise over run") in which ''run'' is the horizontal distance (not the distance along the slope) and ''rise'' is the vertical distance. Slopes of existing physical features such as canyons and hillsides, bank (geography), stream and river banks, and stream bed, beds are often described as grades, but typically the word "grade" is used for human-made surfaces such as roads, landscape grading, roof pitches, rail tracks, railroads, aqueduct (watercourse), aqueducts, and pedestrian or bicycle routes. The grade may refer to ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


picture info

Scalar Field
In mathematics and physics, a scalar field is a function associating a single number to each point in a region of space – possibly physical space. The scalar may either be a pure mathematical number ( dimensionless) or a scalar physical quantity (with units). In a physical context, scalar fields are required to be independent of the choice of reference frame. That is, any two observers using the same units will agree on the value of the scalar field at the same absolute point in space (or spacetime) regardless of their respective points of origin. Examples used in physics include the temperature distribution throughout space, the pressure distribution in a fluid, and spin-zero quantum fields, such as the Higgs field. These fields are the subject of scalar field theory. Definition Mathematically, a scalar field on a region ''U'' is a real or complex-valued function or distribution on ''U''. The region ''U'' may be a set in some Euclidean space, Minkowski spac ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


Vector Field Of A Function's Gradient Imposed Over A Color Plot Of That Function
Vector most often refers to: * Euclidean vector, a quantity with a magnitude and a direction * Disease vector, an agent that carries and transmits an infectious pathogen into another living organism Vector may also refer to: Mathematics and physics * Vector (mathematics and physics) ** Row and column vectors, single row or column matrices ** Vector quantity ** Vector space ** Vector field, a vector for each point Molecular biology * Vector (molecular biology), a DNA molecule used as a vehicle to artificially carry foreign genetic material into another cell ** Cloning vector, a small piece of DNA into which a foreign DNA fragment can be inserted for cloning purposes ** Shuttle vector, a plasmid constructed so that it can propagate in two different host species ** Viral vector, a tool commonly used by molecular biologists to deliver genetic materials into cells Computer science * Vector, a one-dimensional array data structure ** Distance-vector routing protoco ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


picture info

Manifold
In mathematics, a manifold is a topological space that locally resembles Euclidean space near each point. More precisely, an n-dimensional manifold, or ''n-manifold'' for short, is a topological space with the property that each point has a Neighbourhood (mathematics), neighborhood that is homeomorphic to an open (topology), open subset of n-dimensional Euclidean space. One-dimensional manifolds include Line (geometry), lines and circles, but not Lemniscate, self-crossing curves such as a figure 8. Two-dimensional manifolds are also called Surface (topology), surfaces. Examples include the Plane (geometry), plane, the sphere, and the torus, and also the Klein bottle and real projective plane. The concept of a manifold is central to many parts of geometry and modern mathematical physics because it allows complicated structures to be described in terms of well-understood topological properties of simpler spaces. Manifolds naturally arise as solution sets of systems of equations ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


picture info

Directional Derivative
In multivariable calculus, the directional derivative measures the rate at which a function changes in a particular direction at a given point. The directional derivative of a multivariable differentiable (scalar) function along a given vector v at a given point x intuitively represents the instantaneous rate of change of the function, moving through x with a direction specified by v. The directional derivative of a scalar function ''f'' with respect to a vector v at a point (e.g., position) x may be denoted by any of the following: \begin \nabla_(\mathbf) &=f'_\mathbf(\mathbf)\\ &=D_\mathbff(\mathbf)\\ &=Df(\mathbf)(\mathbf)\\ &=\partial_\mathbff(\mathbf)\\ &=\mathbf\cdot\\ &=\mathbf\cdot \frac.\\ \end It therefore generalizes the notion of a partial derivative, in which the rate of change is taken along one of the curvilinear coordinate curves, all other coordinates being constant. The directional derivative is a special case of the Gateaux derivative. Definition ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


picture info

Dot Product
In mathematics, the dot product or scalar productThe term ''scalar product'' means literally "product with a Scalar (mathematics), scalar as a result". It is also used for other symmetric bilinear forms, for example in a pseudo-Euclidean space. Not to be confused with scalar multiplication. is an algebraic operation that takes two equal-length sequences of numbers (usually coordinate vectors), and returns a single number. In Euclidean geometry, the dot product of the Cartesian coordinates of two Euclidean vector, vectors is widely used. It is often called the inner product (or rarely the projection product) of Euclidean space, even though it is not the only inner product that can be defined on Euclidean space (see ''Inner product space'' for more). It should not be confused with the cross product. Algebraically, the dot product is the sum of the Product (mathematics), products of the corresponding entries of the two sequences of numbers. Geometrically, it is the product of the Euc ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


Cotangent Vector
In differential geometry, the cotangent space is a vector space associated with a point x on a smooth (or differentiable) manifold \mathcal M; one can define a cotangent space for every point on a smooth manifold. Typically, the cotangent space, T^*_x\!\mathcal M is defined as the dual space of the tangent space at ''x'', T_x\mathcal M, although there are more direct definitions (see below). The elements of the cotangent space are called cotangent vectors or tangent covectors. Properties All cotangent spaces at points on a connected manifold have the same dimension, equal to the dimension of the manifold. All the cotangent spaces of a manifold can be "glued together" (i.e. unioned and endowed with a topology) to form a new differentiable manifold of twice the dimension, the cotangent bundle of the manifold. The tangent space and the cotangent space at a point are both real vector spaces of the same dimension and therefore isomorphic to each other via many possible isomorphisms ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  


Total Derivative
In mathematics, the total derivative of a function at a point is the best linear approximation near this point of the function with respect to its arguments. Unlike partial derivatives, the total derivative approximates the function with respect to all of its arguments, not just a single one. In many situations, this is the same as considering all partial derivatives simultaneously. The term "total derivative" is primarily used when is a function of several variables, because when is a function of a single variable, the total derivative is the same as the ordinary derivative of the function. The total derivative as a linear map Let U \subseteq \R^n be an open subset. Then a function f:U \to \R^m is said to be (totally) differentiable at a point a\in U if there exists a linear transformation df_a:\R^n \to \R^m such that :\lim_ \frac=0. The linear map df_a is called the (total) derivative or (total) differential of f at a. Other notations for the total derivative inc ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]  




Metric Tensor
In the mathematical field of differential geometry, a metric tensor (or simply metric) is an additional structure on a manifold (such as a surface) that allows defining distances and angles, just as the inner product on a Euclidean space allows defining distances and angles there. More precisely, a metric tensor at a point of is a bilinear form defined on the tangent space at (that is, a bilinear function that maps pairs of tangent vectors to real numbers), and a metric field on consists of a metric tensor at each point of that varies smoothly with . A metric tensor is ''positive-definite'' if for every nonzero vector . A manifold equipped with a positive-definite metric tensor is known as a Riemannian manifold. Such a metric tensor can be thought of as specifying ''infinitesimal'' distance on the manifold. On a Riemannian manifold , the length of a smooth curve between two points and can be defined by integration, and the distance between and can be defined as ...
[...More Info...]      
[...Related Items...]     OR:     [Wikipedia]   [Google]   [Baidu]