Scalarization

From WFM Labs


Scalarization (also scalarisation) is a family of techniques in multi-objective optimization that reduce a problem with several conflicting objectives to one or more single-objective problems, each of which can be solved by ordinary single-objective methods.[1] A scalarizing function aggregates the objective vector into a single real-valued objective, typically using weights and sometimes a reference point; by varying these parameters, a solver traces out different points of the Pareto-optimal set.[2] Scalarization is one of the most widely used strategies for generating trade-off surfaces because it lets practitioners reuse mature single-objective algorithms, but the choice of scalarizing function determines which parts of the Pareto front are reachable at all.[1][3]

Background

A multi-objective optimization problem seeks to minimize (or maximize) a vector of objective functions f(x)=(f1(x),,fk(x)) over a feasible set. Because the objectives generally conflict, there is usually no single point that optimizes all of them simultaneously; instead one seeks Pareto-optimal (or efficient) solutions, for which no objective can be improved without worsening another.[2] The image of the Pareto-optimal set in objective space is called the Pareto front. A point is termed supported if it lies on the boundary of the convex hull of the attainable objective set, and unsupported otherwise; this distinction is central to understanding which scalarizations can recover which points.[2] Scalarization turns the problem of characterizing this front into a sequence of scalar minimizations, each parameterized differently, so that solving many scalarized problems approximates the whole front.[1]

Weighted-sum scalarization

The simplest scalarization is the weighted sum, which minimizes i=1kwifi(x) for nonnegative weights wi that sum to one.[1] For any strictly positive weight vector, the optimum of the weighted sum is Pareto-optimal, so sweeping the weights produces a set of efficient points.[2] The method is attractive because it preserves convexity and linearity: if the underlying problem is a linear or convex program, the weighted-sum problem is one too, and it can be solved with standard solvers.[1] For convex problems, every Pareto-optimal point can in principle be obtained as the solution of some weighted-sum problem.[1]

Why weighted sums miss concave regions

The weighted sum has two well-documented limitations. First, it can only recover Pareto-optimal points that lie on the convex hull of the attainable objective set—the supported points—so any point in a concave (nonconvex) portion of the front is unreachable no matter how the weights are chosen.[3][2] Geometrically, minimizing a weighted sum is equivalent to sliding a hyperplane with fixed slope until it first touches the attainable set; on a concave stretch of the front the hyperplane jumps past the interior points and touches only the endpoints.[3] Second, even where the front is convex, an evenly spaced set of weights does not generally yield an evenly spaced set of Pareto points, so the front can be sampled very unevenly.[3] These drawbacks motivated alternative scalarizations that do not rely on convexity.[3][1]

Weighted Chebyshev (achievement) scalarization

The weighted Chebyshev method (also weighted Tchebycheff) minimizes the weighted L distance to a reference point, typically an ideal or utopia point z that lower-bounds each objective: it minimizes maxiwi|fi(x)zi|.[1] Unlike the weighted sum, the Chebyshev scalarization can reach every Pareto-optimal point—including those in concave regions—by an appropriate choice of weights, a property that holds for both convex and nonconvex problems.[1][4] Intuitively, the level sets of the weighted Chebyshev norm are right-angled contours whose corner can be steered into a concavity, so the touching point can fall on an unsupported part of the front where a flat hyperplane could not.[4]

The pure Chebyshev function has a technical drawback: its optimum is guaranteed only to be weakly Pareto-optimal, and some optima may be weakly efficient but dominated. To exclude these, an augmented weighted Chebyshev function adds a small weighted-sum term, maxiwi|fi(x)zi|+ρi(fi(x)zi) with a small ρ>0, which restores proper Pareto-optimality while retaining the ability to reach nonconvex points.[5][1] This makes the augmented Chebyshev family a common default when the shape of the front is unknown or suspected to be nonconvex.[1]

Epsilon-constraint method

The ε-constraint (epsilon-constraint) method keeps one objective as the optimization target and converts the remaining objectives into inequality constraints bounded by parameters εi; systematically varying the bounds generates different efficient points.[6] Because it does not aggregate the objectives into a single weighted line, the ε-constraint method can also reach unsupported points in nonconvex regions of the front, unlike the weighted sum.[2][1] Its main practical costs are that the choice of bounds requires knowledge of sensible objective ranges, and that a naïve grid of bounds can produce infeasible or weakly-efficient subproblems unless the constraints are handled carefully.[2] Ehrgott and colleagues describe generalizations, such as the method of elastic constraints, that unify the weighted-sum and ε-constraint ideas and are guaranteed to generate all Pareto-optimal solutions.[2]

Choosing a scalarization

The practical guidance in the multi-objective literature is that the weighted sum is the cheapest and most solver-friendly option but is safe only when the Pareto front is known to be convex; when the front may be concave, an achievement-type function such as the augmented weighted Chebyshev, or the ε-constraint method, is preferred because either can recover the full front.[1][2][3] More general achievement scalarizing functions, which measure distance from a decision-maker's reference point and are central to interactive methods, extend the Chebyshev idea and can produce any Pareto-optimal solution by moving the reference point through objective space.[1]

Relevance to workforce management

Staffing and scheduling problems in workforce management are naturally multi-objective: a schedule trades service level or answer speed against labor cost, and often against fairness, adherence, or agent preference. When such trade-offs are collapsed into a single weighted cost function—for example, a linear penalty combining understaffing cost and overtime cost—the resulting model is a weighted-sum scalarization, and by the reasoning above it can only expose trade-off configurations on the convex hull of the achievable service-versus-cost frontier. If the true frontier has concave stretches, a weighted-sum staffing model will silently skip those roster options regardless of how the penalty weights are tuned, which is one reason planners exploring a full cost–service trade-off curve may prefer an ε-constraint formulation (optimize cost subject to a service-level floor, then sweep the floor) or a Chebyshev-style objective. These are general implications of the scalarization theory rather than claims specific to any one WFM system.[1][3]

See also

References

  1. 1.00 1.01 1.02 1.03 1.04 1.05 1.06 1.07 1.08 1.09 1.10 1.11 1.12 1.13 1.14 Miettinen, K. (1999). Nonlinear Multiobjective Optimization. Kluwer Academic Publishers. ISBN 978-0-7923-8278-2.
  2. 2.0 2.1 2.2 2.3 2.4 2.5 2.6 2.7 2.8 Ehrgott, M. (2005). Multicriteria Optimization (2nd ed.). Springer. ISBN 978-3-540-21398-7.
  3. 3.0 3.1 3.2 3.3 3.4 3.5 3.6 Das, I., Dennis, J.E. (1997). "A closer look at drawbacks of minimizing weighted sums of objectives for Pareto set generation in multicriteria optimization problems". Structural Optimization 14 (1), 63–69. doi:10.1007/BF01197559.
  4. 4.0 4.1 Bowman, V.J. (1976). "On the relationship of the Tchebycheff norm and the efficient frontier of multiple-criteria objectives". In Multiple Criteria Decision Making, Lecture Notes in Economics and Mathematical Systems 130, 76–86. Springer.
  5. Steuer, R.E. (1986). Multiple Criteria Optimization: Theory, Computation, and Application. Wiley. ISBN 978-0-471-88846-5.
  6. Haimes, Y.Y., Lasdon, L.S., Wismer, D.A. (1971). "On a bicriterion formulation of the problems of integrated system identification and system optimization". IEEE Transactions on Systems, Man, and Cybernetics SMC-1 (3), 296–297. doi:10.1109/TSMC.1971.4308298.