Chebyshev center

Summary

In geometry, the Chebyshev center of a bounded set having non-empty interior is the center of the minimal-radius ball enclosing the entire set , or alternatively (and non-equivalently) the center of largest inscribed ball of .[1]

In the field of parameter estimation, the Chebyshev center approach tries to find an estimator for given the feasibility set , such that minimizes the worst possible estimation error for x (e.g. best worst case).

Mathematical representation edit

There exist several alternative representations for the Chebyshev center. Consider the set   and denote its Chebyshev center by  .   can be computed by solving:

 

with respect to the Euclidean norm  , or alternatively by solving:

 [1]

Despite these properties, finding the Chebyshev center may be a hard numerical optimization problem. For example, in the second representation above, the inner maximization is non-convex if the set Q is not convex.

Properties edit

In inner product spaces and two-dimensional spaces, if   is closed, bounded and convex, then the Chebyshev center is in  . In other words, the search for the Chebyshev center can be conducted inside   without loss of generality.[2]

In other spaces, the Chebyshev center may not be in  , even if   is convex. For instance, if   is the tetrahedron formed by the convex hull of the points (1,1,1), (-1,1,1), (1,-1,1) and (1,1,-1), then computing the Chebyshev center using the   norm yields[3]

 

Relaxed Chebyshev center edit

Consider the case in which the set   can be represented as the intersection of   ellipsoids.

 

with

 

By introducing an additional matrix variable  , we can write the inner maximization problem of the Chebyshev center as:

 

where   is the trace operator and

 
 

Relaxing our demand on   by demanding  , i.e.   where   is the set of positive semi-definite matrices, and changing the order of the min max to max min (see the references for more details), the optimization problem can be formulated as:

 

with

 

This last convex optimization problem is known as the relaxed Chebyshev center (RCC). The RCC has the following important properties:

  • The RCC is an upper bound for the exact Chebyshev center.
  • The RCC is unique.
  • The RCC is feasible.

Constrained least squares edit

It can be shown that the well-known constrained least squares (CLS) problem is a relaxed version of the Chebyshev center.[citation needed]

The original CLS problem can be formulated as:

 

with

 
 

It can be shown that this problem is equivalent to the following optimization problem:

 

with

 

One can see that this problem is a relaxation of the Chebyshev center (though different than the RCC described above).

RCC vs. CLS edit

A solution set   for the RCC is also a solution for the CLS, and thus  . This means that the CLS estimate is the solution of a looser relaxation than that of the RCC. Hence the CLS is an upper bound for the RCC, which is an upper bound for the real Chebyshev center.

Modeling constraints edit

Since both the RCC and CLS are based upon relaxation of the real feasibility set  , the form in which   is defined affects its relaxed versions. This of course affects the quality of the RCC and CLS estimators. As a simple example consider the linear box constraints:

 

which can alternatively be written as

 

It turns out that the first representation results with an upper bound estimator for the second one, hence using it may dramatically decrease the quality of the calculated estimator.

This simple example shows us that great care should be given to the formulation of constraints when relaxation of the feasibility region is used.

Linear programming problem edit

This problem can be formulated as a linear programming problem, provided that the region Q is an intersection of finitely many hyperplanes.[4] Given a polytope, Q, defined as follows then it can be solved via the following linear program.

 
 

See also edit

References edit

  1. ^ a b Boyd, Stephen P.; Vandenberghe, Lieven (2004). Convex Optimization (PDF). Cambridge University Press. ISBN 978-0-521-83378-3. Retrieved October 15, 2011.
  2. ^ Amir, Dan (1984). "Best Simultaneous Approximation (Chebyshev Centers)". International Series of Numerical Mathematics / Internationale Schriftenreihe zur Numerischen Mathematik / Série internationale d'Analyse numérique. Birkhäuser. pp. 19–35. ISBN 9783034862530.
  3. ^ Dabbene, Fabrizio; Sznaier, Mario; Tempo, Roberto (August 2014). "Probabilistic Optimal Estimation With Uniformly Distributed Noise". IEEE Transactions on Automatic Control. 59 (8): 2113–2127. doi:10.1109/tac.2014.2318092. S2CID 17857976.
  4. ^ "Archived copy" (PDF). Archived from the original (PDF) on 2014-09-12. Retrieved 2014-09-12.{{cite web}}: CS1 maint: archived copy as title (link)
  • Y. C. Eldar, A. Beck, and M. Teboulle, "A Minimax Chebyshev Estimator for Bounded Error Estimation," IEEE Trans. Signal Process., 56(4): 1388–1397 (2007).
  • A. Beck and Y. C. Eldar, "Regularization in Regression with Bounded Noise: A Chebyshev Center Approach," SIAM J. Matrix Anal. Appl. 29 (2): 606–625 (2007).