Skip to main content
Log in

Maximization of the Choquet integral over a convex set and its application to resource allocation problems

  • Published:
Annals of Operations Research Aims and scope Submit manuscript

    We’re sorry, something doesn't seem to be working properly.

    Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

We study the problem of the Choquet integral maximization over a convex set. The problem is shown to be generally non-convex (and non-differentiable). We analyze the problem structure, and propose local and global search algorithms. The special case when the problem becomes concave is analyzed separately. For the non-convex case we propose a decomposition scheme which allows to reduce a non-convex problem to several concave ones. Decomposition is performed by finding the coarsest partition of a capacity into disjunction of totally monotone measures. We discuss its effectiveness and prove that the scheme is optimal for 2-additive capacities. An application of the developed methods to resource allocation problems concludes the article.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Notes

  1. In practical implementation we used an algorithm proposed in Duchi et al. (2008).

  2. Pictured are the level sets of the Choquet integral. The feasible set is a simplex . The area of the plot corresponds to the projection of onto the plane 0z 1 z 2. Thus, the axes are z 1 and z 2, while z 3=1−z 1z 2. Also, f 1=f 2=f 3.

  3. In order to simplify the notation, in this section we will use f i instead of f i (z i ).

  4. This is required since in numerical algorithms transitivity is not “automatically” enforced. For practical implementation we have used the Floyd-Warshall algorithm (see e.g. Korte and Vygen 2008). Also, it is convenient to store constraints f i <f j as pairs (i,j).

  5. For equality to hold T i must be accordingly extended by switching back to “≤” from “<”.

  6. All functions f i are identical.

  7. The plot region is as before—projection of the simplex z 1+z 2+z 3=1 onto the plane 0z 1 z 2.

  8. We omit this step in the presented example, assigning value functions arbitrarily.

  9. Rounded to the second digit.

  10. The modeling and optimization procedures were implemented in Python, source codes are available at Timonin (2011).

References

  • Birkhoff, G. (1967). Lattice theory. Providence: Am. Math. Soc.

    Google Scholar 

  • Chateauneuf, A., & Jaffray, J. (1989). Some characterizations of lower probabilities and other monotone capacities through the use of Möbius inversion. Mathematical Social Sciences, 17(3), 263–283.

    Article  Google Scholar 

  • Costa, C., & Vansnick, J. (1994). MACBETH—an interactive path towards the construction of cardinal value functions. International Transactions in Operational Research, 1(4), 489–500. issn:1475-3995.

    Article  Google Scholar 

  • Dem’yanov, V., Vasil’ev, L., & Sasagawa, T. (1985). Nondifferentiable optimization. Berlin: Springer. isbn:0387909516.

    Book  Google Scholar 

  • Denneberg, D. (2000). Totally monotone core and products of monotone measures. International Journal of Approximate Reasoning, 24(2–3), 273–281. issn:0888-613X.

    Article  Google Scholar 

  • Dubois, D., Prade, H., & Harding, E. (1988). Possibility theory: an approach to computerized processing of uncertainty (vol. 2). New York: Plenum Press.

    Google Scholar 

  • Duchi, J., Shalev-Shwartz, S., Singer, Y., & Chandra, T. (2008). Efficient projections onto the l 1-ball for learning in high dimensions. In Proceedings of the 25th international conference on machine learning (pp. 272–279). New York: ACM.

    Chapter  Google Scholar 

  • Dyer, J., & Sarin, R. (1979). Measurable multiattribute value functions. Operations Research, 27(4), 810–822.

    Article  Google Scholar 

  • Fouchal, H., Gandibleux, X., & LeHuédé, F. (2011a). A lower bound of the Choquet integral integrated within martins’ algorithm. In Y. Shi, S. Wang, G. Kou, & J. Wallenius (Eds.), Lecture notes in economics and mathematical systems: Vol648. New state of MCDM in the 21st century (pp. 79–89). Berlin: Springer.

    Chapter  Google Scholar 

  • Fouchal, H., Gandibleux, X., & LeHuédé, F. (2011b). Preferred solutions computed with a label setting algorithm based on Choquet integral for multi-objective shortest paths. In 2011 IEEE symposium on computational intelligence in multicriteria decision-making.

    Google Scholar 

  • Fox, G., Baker, N., & Bryant, J. (1984). Economic models for R and D project selection in the presence of project interactions. Management Science, 30(7), 890–902. issn:0025-1909.

    Article  Google Scholar 

  • Galand, L., Perny, P., & Spanjaard, O. (2010a). A branch and bound algorithm for Choquet optimization in multicriteria problems. In Multiple criteria decision making for sustainable energy and transportation systems (pp. 355–365).

    Chapter  Google Scholar 

  • Galand, L., Perny, P., & Spanjaard, O. (2010b). Choquet-based optimisation in multiobjective shortest path and spanning tree problems. European Journal of Operational Research, 204(2), 303–315. issn:0377-2217.

    Article  Google Scholar 

  • Gordon, L., & Loeb, M. (2002). The economics of information security investment. ACM Transactions on Information and System Security, 5(4), 438–457. issn:1094-9224.

    Article  Google Scholar 

  • Grabisch, M. (1997). k-Order additive discrete fuzzy measures and their representation. Fuzzy Sets and Systems, 92(2), 167–189. issn:0165-0114.

    Article  Google Scholar 

  • Grabisch, M., & Labreuche, C. (2008). A decade of application of the Choquet and Sugeno integrals in multi-criteria decision aid. 4OR: A Quarterly Journal of Operations Research, 6(1), 1–44. issn:1619-4500.

    Article  Google Scholar 

  • Grabisch, M., Labreuche, C., & Vansnick, J. (2003). On the extension of pseudo-boolean functions for the aggregation of interacting criteria. European Journal of Operational Research, 148(1), 28–47.

    Article  Google Scholar 

  • Grabisch, M., Kojadinovic, I., & Meyer, P. (2008). A review of methods for capacity identification in Choquet integral based multi-attribute utility theory: applications of the Kappalab R package. European Journal of Operational Research, 186(2), 766–785. issn:0377-2217.

    Article  Google Scholar 

  • Hammer, P., & Rudeanu, S. (1968). Boolean methods in operations research and related areas. Berlin: Springer.

    Book  Google Scholar 

  • Keeney, R., & Raiffa, H. (1993). Decisions with multiple objectives: preferences and value tradeoffs. Cambridge: Cambridge University Press. isbn:0521438837.

    Google Scholar 

  • Korte, B., & Vygen, J. (2008). Combinatorial optimization: theory and algorithms. Berlin: Springer. isbn:3540718435.

    Google Scholar 

  • Krantz, D., Luce, R., Suppers, P., & Tversky, A. (1971). Foundation of measurement. Vol. 1. Additive and polynomial representations. San Diego: Academic Press.

    Google Scholar 

  • Labreuche, C. (2004). Determination of the criteria to be improved first in order to improve as much as possible the overall evaluation. In 10th int. conf. on information processing and management of uncertainty in knowledge-based systems (IPMU 2004) (pp. 609–616).

    Google Scholar 

  • Labreuche, C., & Grabisch, M. (2003). The Choquet integral for the aggregation of interval scales in multicriteria decision making. Fuzzy Sets and Systems, 137(1), 11–26. issn:0165-0114.

    Article  Google Scholar 

  • Le Huédé, F., Grabisch, M., Labreuche, C., & Savéant, P. (2006a). Integration and propagation of a multi-criteria decision making model in constraint programming. Journal of Heuristics, 12(4), 329–346. issn:1381-1231.

    Article  Google Scholar 

  • Le Huédé, F., Grabisch, M., Labreuche, C., & Savéant, P. (2006b). MCS—a new algorithm for multicriteria optimisation in constraint programming. Annals of Operations Research, 147, 143–174.

    Article  Google Scholar 

  • Lovász, L. (1983). Submodular functions and convexity. In Mathematical programming: the state of the art (pp. 235–257).

    Chapter  Google Scholar 

  • Moffitt, M. D., Peintner, B., & Yorke-smith, N. (2006). Multi-criteria optimization of temporal preferences. In Proceedings of CP’06 workshop on preferences and soft constraints.

    Google Scholar 

  • Nesterov, Y. (2004). Introductory lectures on convex optimization: a basic course. Netherlands: Springer. isbn:1402075537.

    Google Scholar 

  • Ogryczak, W., & Śliwiński, T. (2009). On efficient WOWA optimization for decision support under risk. International Journal of Approximate Reasoning, 50(6), 915–928. issn:0888-613X.

    Article  Google Scholar 

  • Owen, G. (1972). Multilinear extensions of games. Management Science, 18(5), 64–79. issn:0025-1909.

    Article  Google Scholar 

  • Polyak, B. (1983). Introduction to optimization (Vvedenie v optimizatsiyu). Moskva: Nauka.

    Google Scholar 

  • Read, R. (1968). An introduction to chromatic polynomials. Journal of Combinatorial Theory, 4(1), 52–71.

    Article  Google Scholar 

  • Reiter, S. (1963). Choosing an investment program among interdependent projects. Review of Economic Studies, 30(1), 32–36. issn:0034-6527.

    Article  Google Scholar 

  • Reiter, S., & Rice, D. (1966). Discrete optimizing solution procedures for linear and nonlinear integer programming problems. Management Science, 12(11), 829–850. issn:0025-1909.

    Article  Google Scholar 

  • Sahraoui, S., Montmain, J., Berrah, L., & Mauris, G. (2007). User-friendly optimal improvement of an overall industrial performance based on a fuzzy Choquet integral aggregation. In IEEE international conference on fuzzy systems, 2007. FUZZ-IEEE 2007 (pp. 1–6). New York: IEEE Press. isbn:1424412099.

    Chapter  Google Scholar 

  • Santhanam, R., & Kyparisis, G. (1996). A decision model for interdependent information system project selection. European Journal of Operational Research, 89(2), 380–399. issn:0377-2217.

    Article  Google Scholar 

  • Schmeidler, D. (1986). Integral representation without additivity. Proceedings of the American Mathematical Society, 97(2), 255–261. issn:0002-9939.

    Article  Google Scholar 

  • Shor, N. (1998). Nondifferentiable optimization and polynomial problems. Norwell: Kluwer Academic. isbn:0792349970.

    Google Scholar 

  • Stanley, R. (1973). Acyclic orientations of graphs. Discrete Mathematics, 5(2), 171–178.

    Article  Google Scholar 

  • Timonin, M. (2011). Python procedures for the Choquet integral optimization. http://code.google.com/p/choquet-robust-optimization, June.

  • Vasilyev, F. (2002). Optimization methods (Metody optimizatsii). Moscow: Faktorial Press. isbn:5886880569.

    Google Scholar 

  • Weingartner, H. (1966). Capital budgeting of interrelated projects: survey and synthesis. Management Science, 12(7), 485–516. issn:0025-1909.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mikhail Timonin.

Appendix

Appendix

1.1 A.1 Proofs

Lemma 1

Let \(A \subset N, T = \bigcap_{(i,j) \in N^{2}_{T} } (f_{i} < f_{j}) \neq \emptyset\) and exists , jA, and C—is the largest subset of A such that m β(C)≠0, i.e\(\nexists(i,j) \in N^{2}_{T} \colon i \in C, j \notin C \). Then, for any subset DA holds either

(37)

or

(38)

Proof

Notice that \(C = A \setminus\bigcup_{(i,j) \in N^{2}_{T} } i \) for all \((i,j) \in N^{2}_{T} \) such that iA,jA. Then, all subsets \(D \subset A, D \not\subset C\) contain an element i such that jD. Hence, m β(D)=0. If D does not include such an element, then DC. □

Proof of Theorem 8

We will first show that for all sets AN such that \(\nexists (i,j) \in N^{2}_{T}\colon\allowbreak i \in\nobreak A,\ j \notin\nobreak A\),

(39)

entails β T(A)=ν(A). Pick an arbitrary set A for which , jA holds. In the equation

(40)

there exist two types of sets BA. Either , jB, and then m β(B)=0, or \(\nexists(i,j) \in N^{2}_{T} : i \in B, j \notin B\), and then m β(B) is given by (39). Note, that for each set B such that m β(B)=0 there exists a unique C such that \(B \subset C = B\cup(\bigcup_{(i,j) \in N^{2}_{T} } j) \subset A\) for all , jB. In this case the Möbius transform coefficient m β(C) is given by (39) and would include m ν(B) as a summand. Thus,

(41)

Now we will show that m β(A)=0⇒β T(A)=⋁ B⊆̷A β T(B) for all A such that , jA. Moreover, β T(A)=⋁ B⊆̷A β T(B)=β T(C)=ν(C), where \(C = A \setminus\bigcup_{(i,j) \in N^{2}_{T} } i \), , jA. According to Lemma 1, all mass is concentrated on the subsets of the set \(C = A \setminus \bigcup_{(i,j) \in N^{2}_{T} } i \), hence β T(L)=β T(C) for all CLA. At the same time, for any MA, \(M \not\subset C\), \(C \not\subset M\), m β(M)=0 and β T(M)=β T(D), where D is the largest subset included in C such that DM. Due to monotonicity of ν, ν(D)≤ν(C), hence β T(M)≤β T(C), and thus β T(A)=β T(C)=⋁ B⊆̷A β T(B). □

Proof of Theorem 9

A criterion for total monotonicity is the non-negativity of all Möbius transform coefficients. We will demonstrate that m β is actually a permutation of m T. First, we will show that the number of elements equal to zero is identical:

(42)

Fix the coordinates corresponding to i, j for all \((i,j) \in N^{2}_{T} \) in the characteristic vectors of all elements from 2N. Apparently, the number of vectors which can be formed by various combinations of values for the remaining coordinates does not depend on whether the fixed values are 0 or 1. Hence, the number of elements equal to zero is identical in both capacities. Next, we will show that the values

(43)

correspond to the values

(44)

It is sufficient to notice that \(\tilde{A} = A \cup C\), where C={j|iA, \(j \notin A, (i,j) \in N^{2}_{T} \rbrace= \lbrace j \vert i \in\tilde{A}\), \(j \in\tilde{A}\), \((i,j) \in N^{2}_{T} \rbrace\). □

In order to prove Theorem 10 we would introduce a few notions. Capacities are those from (26) and form a disjunctive decomposition of the capacity ν.

Definition 9

We will call capacities and non-∨2m -joinable, if the capacity is not 2-monotone, and there do not exist capacities such that is 2-monotone.

Since we analyze 2-additive capacities, their Möbius transform can have negative coefficients only for sets of the form {a,b}, i.e. for sets of power 2. Denote the set of all unordered pairs {a,b} having a negative Möbius coefficient as K. In other words,

(45)

To simplify the notation we will write ab instead of {a,b} and Ya instead of Y∪{a}.

Denote the subset of N comprised of elements that are included in at least one pair from K as N K . In the following proofs we will denote partial orders over N K induced by various combinations of orderings (with relation <) on each of the pairs from K as P i . Note, that not every combination induce a partial order, see Theorem 11 for details. The elements of N not included into at least one pair in K do not influence the 2-monotonicity of the capacity, and therefore will be excluded from the analysis.

We will prove that it is possible to find at least (−1)p χ(−1) (see Theorem 11) necessity measures which are pairwise non-∨2m -joinable. In particular, it will be shown that it is possible to pick a necessity measure corresponding to each partial order so that these measures are pairwise non-∨2m -joinable. We assume here that the graph made of the pairs from K does not contain disconnected parts. Otherwise, the proof below can be applied to each part separately. In this case the number of resulting measures would be equal to product of numbers generated by each part (recall also Theorem 11 and the fact that the chromatic polynomial of a disconnected graph equals to the product of chromatic polynomials of its connected parts (e.g. Read 1968)).

Each partial order P i corresponding to some combination of orderings on pairs from K can have several linear extensions. For the proofs we will additionally require that the chosen extension complies with the following rule. Index all elements included in pairs from K with numbers from 1 to m. For a given partial order, if two or more elements are incomparable put that with the lowest index first when constructing the linear extension.

Lemma 2

For any two chains , there exists a (possibly empty) set YN K and elements a,bN K such that , . If a and b are such that {a,b}∉K, then , and there exist elements c,dN K Y such that {a,c}∈K, {b,d}∈K.

Proof

Fix two arbitrary chains and corresponding to different partial orders P 1 and P 2. Set Y=∅. Look at the following elements of each chain: , i=1. Assume they are equal. Then, add an element \(c^{1}_{1}\) to the set Y and move on to the next elements , , i=2. Assume, at some step i we have found elements , such that \(c^{1}_{i} \neq c^{2}_{i}\). If such elements could not be found the chains are identical.

Assume, \(\{c^{1}_{i},c^{2}_{i}\} \in K\). Then, the required elements have been found. In the opposite case \(\{c^{1}_{i},c^{2}_{i}\} \notin K\) verify if , . If this holds, the required elements have been found. If this does not hold, two options are possible. Assume , . Then, add \(c^{1}_{i}\), \(c^{2}_{i}\) to Y and move on to the next elements of the chains (i.e., let i=i+2). Note, that this means that all pairs containing \(c^{1}_{i}\) and \(c^{2}_{i}\) have the same ordering in partial orders P 1 and P 2. If \(Yc^{1}_{i}c^{2}_{i}\) is only included in one chain, e.g. , , then look at the elements with index i=i+1, which will have the form , . Add the element \(c^{2}_{i}\) to the set Y and repeat the reasoning for the pair , . Again, note that all pairs including \(c^{2}_{i}\) have the same ordering in both partial orders. If on some iteration we have reached the end of the chains, and the required combination of elements have not been found, then all pairs of elements from K have the same ordering, hence chains and correspond to the same partial order, which contradicts the initial assumptions.

Now, assume the sets Ya and Yb such that {a,b}∉K, YabC 1, YabC 2 have been found. If for either a or b there do not exist elements c and d, c,dN K Y, such that {a,c}∈K and {b,d}∈K, then all elements c i ,d j such that {a,c i }∈K, {b,d j }∈K belong to Y. Therefore, either a or b must be the element with the lowest index from the set N K Y (according to the agreement above). It follows that YabC 1 or YabC 2 which is again a contradiction. □

Corollary 1

Observe, that by construction all pairs comprising elements from Y have the same ordering in both chains. Therefore, either there exist {w 1,w 2}∈K, w 1,w 2N K Y, or the chains correspond to the same partial order.

Lemma 3

Capacities and are non-∨2m -joinable, if there exist , , where , —are maximal chains such that , , {a,b}∈K.

Proof

The 2-monotonicity condition is

$$ \nu(A \cup B) - \nu(A) - \nu(B) + \nu(A \cap B) \geq0, \quad\forall A,B \subset N. $$
(46)

We will write it down for the element Yab:

(47)

Since ν is 2-additive for all AN holds (Grabisch 1997):

$$ \nu(A) = \sum_{i,j \in A} \nu(ij) - \bigl(\vert A \vert- 2\bigr) \sum_{i \in A} \nu(i). $$
(48)

Thus,

(49)

And according to the definition of the measures (see (27)) and the conditions of the lemma .

From the definition of the measures follows and . Therefore, the inequality holds for any combination , i.e. . Therefore, capacities and are non-∨2m -joinable. □

Note

Since {a,b}∈K, conditions of the lemma imply that and correspond to different partial orders.

Lemma 4

is not 2-monotone if there exist , , , , {a,b}∉K, where , , , , and P 1 and P 2 are different partial orders.

Proof

Yab does not belong to maximal chains corresponding to or . Hence, (see (27)). Also, since by construction Y belongs to at least one of the chains. Without loss of generality assume ν(Ya)≥ν(Yb). Therefore,

(50)

Now take sets Ybc and Yc such that {b,c}∈K. According to Lemma 2 such a pair can always be found. Due to monotonicity of ν it holds:

(51)

Since {b,c}∈K, it holds m(bc)=ν(bc)−ν(b)−ν(c)<0. Therefore, ∑ iY [ν(i)+ν(b)−ν(ib)]−ν(b)<0. Thus the capacity is not 2-monotone. □

Lemma 5

and are non-∨2m -joinable if there exist , , , , {a,b}∉K, where , , , , and P 1 and P 2 are different partial orders.

Proof

According to the result of Lemma 4 the capacity is not 2-monotone. We will show that the capacity is also not 2-monotone. It was shown, that if Yab is included in neither of the chains, corresponding to the measures and , it holds:

(52)

Since Y belongs to at least one of the chains, the only way to reverse the inequality is by increasing the value . It can be done by adding another necessity measure which corresponds to a chain containing Yab and not containing Yab, where Y′=Yy, and y—is an arbitrary element of Y. At the same time, ν(Yab) must be greater than max(ν(Ya),ν(Yb)). However, in this case, the conditions of Lemmata 3 or 4 hold for the added necessity measure and both of the old (consider pairs ((Ya)b,(Ya)y), and ((Yb)a,(Yb)y)), so that the obtained capacity is still not 2-monotone.

Another option is to add a necessity measure, which corresponds to a chain including Yab. We then look at pairs of sets (Yab,Yax 1) and (Yab,Ybz 1), where Yax 1 and Ybz 1 are the next elements in chains, corresponding to capacities and (see Fig. 15). The following options are possible

  1. 1.

    {x 1,b}∈K or {z 1,a}∈K. Lemma 3 applies.

  2. 2.

    {x 1,b}∉K, {z 1,a}∉K.

    Look at the pairs (Yax 1,Yab) and (Ybz 1,Yab) (in the special case x 1=z 1 look at the pairs (Yaz 1,Yab), (Yab,Ybz 1), and (Yz 1 a,Yz 1 b)). The sets Yabx 1 and Yabz 1 must belong to the union of the chains corresponding to capacities  . Otherwise, Lemma 4 applies. Therefore, it is necessary to add necessity measures which correspond to chains containing these sets. However, after adding them three new pairs of sets will emerge for which either Lemma 3 or 4 can be applied. These are the pairs (Yax 1 x 2,Yabx 1), (Yabx 1,Yabz 1) and (Yabz 1,Yaz 1 z 2). Hence, we would be required to add yet another necessity measures, corresponding to chains containing the joins of sets in every pair. By repeating this process we will obtain a structure, generated by joins of all elements from chains YYa⊂⋯⊂N K (sub-chain of ) and YYb⊂⋯⊂N K (sub-chain of ). It is in fact a distributive lattice (Birkhoff 1967). This entails the existence of two elements YaZw 1 and YbZw 2, where ZN K Yw 1 w 2 and {w 1,w 2}∈K (see Corollary 1). Thus Lemma 3 applies.

The process is illustrated in Fig. 15. On the left half of the figure we provide the case when elements z i ,i=1,…,k and x i ,i=1,…,k are distinct, and on the right a more general one. The boxed sets are those formed when adding new necessity measures.

Fig. 15
figure 15

Set creation by joining maximal chains

 □

Proof of Theorem 10

Lemmata 2, 3, 5 show that for a 2-additive capacity ν and a set of pairs {i,j}∈K it is possible to find at least one necessity measure for each partial order induced by the combination of orderings on these pairs, such that all thus selected measures are pairwise non-∨2m -joinable. At the same time, the algorithm presented in Figs. 5, 6, 7 will produce exactly this number of 2-monotone measures (see Theorem 11). Therefore, the obtained decomposition is minimal. □

1.2 A.2 Application example data

Table 9 Protection
Table 10 Technical measures
Table 11 Hosting
Table 12 Office
Table 13 Office network
Table 14 Office servers
Table 15 Staff
Table 16 Staff technical
Table 17 Access control
Table 18 HR

Rights and permissions

Reprints and permissions

About this article

Cite this article

Timonin, M. Maximization of the Choquet integral over a convex set and its application to resource allocation problems. Ann Oper Res 196, 543–579 (2012). https://doi.org/10.1007/s10479-012-1147-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10479-012-1147-9

Keywords

Navigation