PHIL 109 · Introduction to Formal Reasoning and Decision Making

7 Decisions under ignorance

This chapter sets out the mathematical model of a decision (choices, states, outcomes, and utilities), represents decisions with matrices, and shows how ordinal utilities can be read off an agent’s preferences when those preferences form a weak order. It then turns to choice under ignorance, where we cannot assign probabilities to the states, and compares three norms: dominance, maximin (with its refinement, leximin), and minimax regret.

In Part I we learned about propositional logic and how it helps us analyze arguments and determine their tautological validity. In Part II we learned about probability, and how it helps us analyze probabilistic arguments. In this part, we’ll apply everything we learned in the previous two, plus some new techniques, to analyze how to make rational decisions. We start by considering those decisions that involve only one agent as a decision-maker, and then we move on to interactive decision theory—also known as game theory.

We start by setting out the main elements in our mathematical model of decisions. They are: choices, states, outcomes, and utilities. Choices are the options that the agent has: go to college, work on the family farm, or form a rock band, for instance. States are ways the world can be that affect what outcome your choice will have: whether the economy will tank in the next five years or not, for example. Outcomes are, precisely, a function of your choice on the one hand and the state of the world on the other: for instance, if you decide to work on the family farm and the economy tanks, the outcome is not as good as if it did not. Finally, utilities are a measure of your preferences over outcomes.

7.1 Representing decisions

The standard way of representing decisions is by using a matrix. For a decision with nn choices and mm states, we use an nn by mm matrix where the choices label the rows, the states label the columns, and the cells represent outcomes:

states
S1S_1S2S_2S3S_3S4S_4
choicesA1A_1O11O_{11}O12O_{12}O13O_{13}O14O_{14}
A2A_2O21O_{21}O22O_{22}O23O_{23}O24O_{24}
A3A_3O31O_{31}O32O_{32}O33O_{33}O34O_{34}
Table 7.1 A decision problem with three choices and four states. Each cell records the outcome of making the choice on its row in the state in its column.

In general, we will write the utilities associated with the outcomes in each cell instead:

states
S1S_1S2S_2S3S_3S4S_4
choicesA1A_1u(O11)u(O_{11})u(O12)u(O_{12})u(O13)u(O_{13})u(O14)u(O_{14})
A2A_2u(O21)u(O_{21})u(O22)u(O_{22})u(O23)u(O_{23})u(O24)u(O_{24})
A3A_3u(O31)u(O_{31})u(O32)u(O_{32})u(O33)u(O_{33})u(O34)u(O_{34})
Table 7.2 The same decision problem, with each cell now recording the utility of the outcome that cell represents.

Suppose that we have a choice between going to the park or going to the movies. Those are our choices. It could rain or not. Those are the states. Pairing a choice with a state gives us an outcome, and so there are four of them: going to the park while it rains, going to the park while it doesn’t rain, going to the movies while it rains, and going to the movies while it doesn’t rain. Let us assume that your utilities for those four outcomes are 1, 4, 3, and 2 respectively (we will study where those utilities come from later in this chapter). A rained-out afternoon at the park is the worst thing that could happen to you, and a sunny one is the best; the movies are somewhere in the middle either way, and marginally better when it rains, since then at least you are not squandering good weather indoors. Writing PP for going to the park, MM for going to the movies, and RR for its raining, we can represent this decision problem with the following matrix:

RR¬R\neg R
PP1144
MM3322
Table 7.3 The decision problem of whether to go to the park (PP) or to the movies (MM), depending on whether it rains (RR) or not. The rows are the choices, the columns are the states, and each cell records the utility of the corresponding outcome.

Not just any list of propositions will do for the columns of such a matrix. Suppose we had taken our states to be it rains and it snows. Then a clear day is a way things might turn out that no column covers, and the matrix simply says nothing about what would happen if it came about—our list of outcomes would be incomplete. Suppose instead that we had taken our states to be it rains and it is cold. Now a cold, rainy day falls under both columns at once, and the cells disagree with each other about what its outcome is. To rule out both defects, we require that the states partition the possibility space:

Definition 7.1. Partition: A set of propositions {S1,S2,…,Sn}\{S_{1}, S_{2}, \ldots, S_{n}\} is a partition of the possibility space if and only if exactly one of them is true in each possible world. That is to say, they must be both:

  1. Mutually exclusive: no two of them are true in the same possible world (see Definition 4.1); and

  2. Jointly exhaustive: there is no possible world in which none of them is true.

Mutual exclusivity is what rules out the second bad case, and joint exhaustiveness what rules out the first. Together they guarantee that, however things turn out, exactly one column describes the situation you are actually in—which is what entitles us to read each row as a complete specification of what a choice would get you.

Our original example passes the test, and does so for a reason that will often be useful: a proposition and its negation always form a partition, since as a matter of logic RR and ¬R\neg R cannot both be true and cannot both be false. The rows of a truth-table are a partition as well: exactly one row describes any given possible world, which is precisely why the probabilities we assign to the rows of a stochastic truth-table have to sum to 1.

7.2 Where do ordinal utilities come from?

Where did the utility numbers come from? The answer is: from your preferences among outcomes. Utilities are a scale we use to represent your preferences. We will consider two different kinds of utility scales, ordinal and cardinal. We start with ordinal scales in this chapter, and turn to cardinal scales in Chapter 8.

We will use the symbol “≻\succ” to represent preference relations—φ≻ψ\varphi \succ \psi means that the agent prefers φ\varphi to ψ\psi. If an agent is indifferent between φ\varphi and ψ\psi, we will write φ∼ψ\varphi \sim \psi. Recall that your most preferred option is a sunny day at the park, which you prefer even to the movies when it rains; that you prefer being at the movies when it rains to being at the movies when it doesn’t; and that you prefer being at the movies when it doesn’t rain even to being at the park when it rains. We can therefore represent these preferences as follows:

(P∧¬R)≻(M∧R)(P \land \neg R) \succ (M \land R)
(M∧R)≻(M∧¬R)(M \land R) \succ (M \land \neg R)
(M∧¬R)≻(P∧R)(M \land \neg R) \succ (P \land R)

Notice that we have not stated all of your preferences here, because we have not stated that you prefer being at the park when it doesn’t rain to being at the movies when it doesn’t rain. You might think that goes without saying, given that you prefer being at the park when it doesn’t rain to being at the movies when it rains, and you prefer being at the movies when it rains to being at the movies when it doesn’t rain. That is to say, you might think it goes without saying that your preferences should be transitive. If so, decision theorists agree with you. In fact, decision theory presupposes that your preferences satisfy several global constraints:

Definition 7.2. Asymmetric: An agent’s preferences are asymmetric if and only if, for any two outcomes φ\varphi and ψ\psi:

  1. If φ≻ψ\varphi \succ \psi, then not ψ≻φ\psi \succ \varphi.

  2. If φ≻ψ\varphi \succ \psi, then not ψ∼φ\psi \sim \varphi.

  3. If φ∼ψ\varphi \sim \psi, then not φ≻ψ\varphi \succ \psi and also not ψ≻φ\psi \succ \varphi.

Definition 7.3. Transitive: An agent’s preferences are transitive if and only if, for any three outcomes χ\chi, φ\varphi and ψ\psi:

  1. If φ≻ψ\varphi \succ \psi and ψ≻χ\psi \succ \chi, then φ≻χ\varphi \succ \chi.

  2. If φ∼ψ\varphi \sim \psi and ψ∼χ\psi \sim \chi, then φ∼χ\varphi \sim \chi.

  3. If φ≻ψ\varphi \succ \psi and ψ∼χ\psi \sim \chi, then φ≻χ\varphi \succ \chi.

  4. If φ∼ψ\varphi \sim \psi and ψ≻χ\psi \succ \chi, then φ≻χ\varphi \succ \chi.

Definition 7.4. Connected: An agent’s preferences are connected if and only if, for any two outcomes φ\varphi and ψ\psi, at least one of the following holds:

  1. φ≻ψ\varphi \succ \psi.

  2. ψ≻φ\psi \succ \varphi.

  3. φ∼ψ\varphi \sim \psi.

Notice that Definition 7.2 and Definition 7.4 work together: connectedness guarantees that at least one of the three relations holds between any two outcomes, and asymmetry guarantees that at most one of them does. Taken together, then, they tell us that for any two outcomes exactly one of φ≻ψ\varphi \succ \psi, ψ≻φ\psi \succ \varphi, and φ∼ψ\varphi \sim \psi is true—an agent whose preferences satisfy both is never undecided between two outcomes, and never prefers each of two outcomes to the other.

Notice also the crucial distinction between being indifferent between two outcomes, on the one hand, and having no preference relations whatsoever between them, not even indifference. If you are indifferent between two outcomes, that means that you are completely willing to replace one with the other. Right now, for instance, I am indifferent between having coffee and tea—I could go for either one. On the other hand, some people have no preference relations between The Rolling Stones and Mozart. It’s not that they are indifferent between them—it’s rather that they think that they each have different properties that make them incommensurable—they just cannot compare one to the other. For better or worse, Definition 7.4 prohibits these incommensurable outcomes. Normal humans also sometimes have intransitive preferences. Suppose you add a single grain of sugar to successive cups of coffee. Normal humans will be indifferent between neighboring cups of coffee, but will definitely have a preference between the first and the last.

What does the fact that we violate some of these conditions mean for the theory of decision that presupposes that we don’t? We won’t deal with this issue here at all, except to make the following two points: first, decision theory is at least partly normative—it tells us not how our preferences actually are ordered, but how they should be ordered if we are to make rational decisions; second, there is some comfort in the fact that we can make rational decisions even when we don’t satisfy all the structural conditions on preferences—for instance, even if your preferences are not connected among all the possible choices for dessert, but you know you can have your first choice, the lack of connectedness doesn’t matter for that particular choice.

If an agent’s preferences do satisfy all the structural conditions on preferences, we will say that their preferences form a weak order:

Definition 7.5. Weak order: An agent’s preferences form a weak order if and only if they are connected, asymmetric, and transitive.

If your preferences form a weak order, then they can be represented by a ranking. The agent’s preferences in the movies/park case, for example, can be represented in the following ranking (ordered from best to worst top to bottom):

Of course, the structural definitions allow ties, but in this case the agent is not indifferent between any of the outcomes.

Once we have a ranking (with ties allowed), we can assign a number to each outcome reflecting its place in the ranking, with higher numbers assigned to higher-ranked outcomes. For instance, we could have the following numbers assigned to the outcomes for the movies/park case:

  1. P∧¬RP \land \neg R
  2. M∧RM \land R
  3. M∧¬RM \land \neg R
  4. P∧RP \land R

Other than assigning higher numbers to higher-ranked outcomes, we are free to assign whatever number we wish. For instance, this other assignment is just as good as the previous one:

We call the number assigned to an outcome its utility, and we write it u(Oi)=nu(O_{i}) = n. If the utility function uu satisfies the requirement just laid out, we say that it is an ordinal utility function:

Definition 7.6. Ordinal utility function: A utility function uu is ordinal if and only if, for any two outcomes φ\varphi and ψ\psi:

  • a u(φ)>u(ψ)u(\varphi) > u (\psi) if and only if φ≻ψ\varphi \succ \psi; and
  • b u(φ)=u(ψ)u(\varphi) = u(\psi) if and only if φ∼ψ\varphi \sim \psi.

The numbers in an ordinal utility function represent nothing more and nothing less than the order of the corresponding outcome in the ranking of the agent’s preferences. If uu is a correct ordinal representation of an agent’s preferences, then any ordinal transformation u′u' of uu will also be a correct ordinal representation of those preferences:

Definition 7.7. Ordinal transformation: u′u' is an ordinal transformation of uu if and only if, for every two outcomes φ\varphi and ψ\psi: u′(φ)≥u′(ψ)u'(\varphi) \geq u'(\psi) if and only if u(φ)≥u(ψ)u(\varphi) \geq u(\psi)

7.3 Choice under ignorance

Decision theorists usually distinguish between three different kinds of decisions: decisions under certainty, decisions under ignorance, and decisions under risk. A decision counts as a decision under certainty when the agent is certain which state in the partition obtains. Decision under certainty need not be computationally easy (the mathematical theory of linear programming has been fruitfully applied to this topic), but theoretically does not give rise to very interesting topics, and therefore we shall not dwell on it any more.

When agents cannot eliminate all but one of the states in the relevant partition, but can assign probabilities to those states, we are dealing with decisions under risk. We will deal with those kinds of decisions in the next chapter. Finally, when subjects cannot even assign meaningful probabilities to the states of the relevant partition, we are dealing with decisions under ignorance. That is what we will be dealing with in the rest of this chapter.

7.3.1 Dominance

Suppose that, in the movies/park example, we have no idea whether it will rain or not. Having no idea is very different from being 50/50 on whether it will rain or not—the latter would be a decision under risk, whereas if we genuinely have no idea then we are facing a decision under ignorance. You might think that there is not much that can be said about how to go about making decisions when we are completely ignorant regarding the probabilities of the different possible states, but you’d be wrong. Consider, for instance, a slight variation of our movies/park example, one where your ranking (together with a possible ordinal utility function) is instead as follows:

  1. P∧¬RP \land \neg R
  2. P∧RP \land R
  3. M∧¬RM \land \neg R
  4. M∧RM \land R

The matrix corresponding to that ranking is then the following:

RR¬R\neg R
PP3344
MM1122
Table 7.4 Park/movies case with alternate ranking of outcomes.

Try it in the Decisions Lab Step through dominance on this matrix.

Something remarkable about this ranking of outcomes is that, no matter whether it rains or not, you prefer to go to the park than to go to the movies. So, even if you are completely ignorant of whether it is going to rain or not, you should go to the park: you will then get your preferred outcome no matter what state the world is in.

When that happens—i.e., when one choice results in a better outcome than all the other ones no matter what state obtains—we say that the choice in question dominates the other. We will define both a strong and a weak form of dominance:

Definition 7.8. Strong dominance: Option φ\varphi strongly dominates option ψ\psi if and only if, for every state SiS_{i}, u(φ∧Si)>u(ψ∧Si).u(\varphi \land S_{i}) > u(\psi \land S_{i}).

Definition 7.9. Weak dominance: Option φ\varphi weakly dominates option ψ\psi if and only if, for every state SiS_{i}, u(φ∧Si)≥u(ψ∧Si),u(\varphi \land S_{i}) \geq u(\psi \land S_{i}), and for at least one state SjS_{j}, u(φ∧Sj)>u(ψ∧Sj).u(\varphi \land S_{j}) > u(\psi \land S_{j}).

And, on the basis of those definitions, we will propose our first norm for decisions:

Norm 7.10. Dominance norm: dominated options are irrational

Notice that the dominance norm doesn’t tell us which option is rational, it only tells us which are irrational—namely, the dominated ones. In the special case where there are only two options, if one of them is dominated then the Dominance norm entails that the other one is the only rationally permissible one. But for cases with more than two options, the fact that one is dominated does not immediately tell you which option is rationally required.

If for two given choices neither one of them is dominated by the other, there are still two other possibilities: it may be that they have the same utility for every state (in which case we’ll say that they are equivalent), or it may be that one of them has a higher utility for at least one state, and the other one has a higher utility for at least one other state (in which case we’ll say that they are crossing):

Definition 7.11. Equivalent: Options φ\varphi and ψ\psi are equivalent if and only if, for every state SiS_{i}, u(φ∧Si)=u(ψ∧Si).u(\varphi \land S_{i}) = u(\psi \land S_{i}).

Definition 7.12. Crossing: Options φ\varphi and ψ\psi are crossing if and only if there is some state SiS_{i} such that u(φ∧Si)>u(ψ∧Si),u(\varphi \land S_{i}) > u(\psi \land S_{i}), and some state SjS_{j} such that u(ψ∧Sj)>u(φ∧Sj).u(\psi \land S_{j}) > u(\varphi \land S_{j}).

To see the dominance norm at work, consider the following three decision problems, each involving three choices and three states.

S1S_1S2S_2S3S_3
A1A_1112211
A2A_2223311
A3A_3223322
Table 7.5 A decision problem in which working through the dominance relations pairwise yields a unique solution.

Try it in the Decisions Lab Step through dominance on this matrix.

We start looking for choices that dominate others by going through them pairwise—that is, we consider each possible pair of choices, ignoring order:

A1,A2A_1, A_2:

A2A_2 weakly dominates A1A_1: going through each state in turn, u(A2∧S1)>u(A1∧S1)u(A_2 \land S_1) > u(A_1 \land S_1) (since 2>12 > 1), u(A2∧S2)>u(A1∧S2)u(A_2 \land S_2) > u(A_1 \land S_2) (since 3>23 > 2), and u(A2∧S3)=u(A1∧S3)u(A_2 \land S_3) = u(A_1 \land S_3) (since 1=11 = 1).

A1,A3A_1, A_3:

A3A_3 strongly dominates A1A_1: u(A3∧S1)>u(A1∧S1)u(A_3 \land S_1) > u(A_1 \land S_1) (since 2>12 > 1), u(A3∧S2)>u(A1∧S2)u(A_3 \land S_2) > u(A_1 \land S_2) (since 3>23 > 2), and u(A3∧S3)>u(A1∧S3)u(A_3 \land S_3) > u(A_1 \land S_3) (since 2>12 > 1).

A2,A3A_2, A_3:

A3A_3 weakly dominates A2A_2: u(A3∧S1)=u(A2∧S1)u(A_3 \land S_1) = u(A_2 \land S_1) (since 2=22 = 2), u(A3∧S2)=u(A2∧S2)u(A_3 \land S_2) = u(A_2 \land S_2) (since 3=33 = 3), and u(A3∧S3)>u(A2∧S3)u(A_3 \land S_3) > u(A_2 \land S_3) (since 2>12 > 1).

The fact that A2A_2 dominates A1A_1 does not mean that we should pick A2A_2, since A2A_2 is itself dominated by A3A_3. Applying the dominance norm is a matter of ruling out choices until, hopefully, only one is left. Once we see that A1A_1 is dominated, we can cross it off as something we would never want to do; once we see that A2A_2 is also dominated, by A3A_3, we cross it off too. That leaves us with A3A_3 as the only remaining choice: dominance reasoning has identified A3A_3 as the single, or unique, solution to the decision problem. This is the best case for dominance reasoning, but things do not always work out so cleanly.

S1S_1S2S_2S3S_3
A1A_1223322
A2A_2221100
A3A_3223322
Table 7.6 A decision problem in which dominance reasoning narrows the choices down without settling on a single one.

Try it in the Decisions Lab Step through dominance on this matrix.

In Table 7.6, A1A_1 weakly dominates A2A_2: u(A1∧S1)=u(A2∧S1)u(A_1 \land S_1) = u(A_2 \land S_1) (since 2=22=2), while u(A1∧S2)>u(A2∧S2)u(A_1 \land S_2) > u(A_2 \land S_2) (since 3>13>1) and u(A1∧S3)>u(A2∧S3)u(A_1 \land S_3) > u(A_2 \land S_3) (since 2>02>0). We can immediately cross off A2A_2, which is convenient, since it means we do not even need to check how A2A_2 relates to A3A_3. We still need to compare A1A_1 and A3A_3, however, and what we find is that neither dominates the other: their utilities agree at every state, so by Definition 7.11 they are equivalent. Dominance reasoning cannot, then, deliver a unique solution to this decision problem—all it can tell us is that we should not pick A2A_2. That is not so bad in this case, though, since it is clear that we should pick either A1A_1 or A3A_3, and it does not matter which.

S1S_1S2S_2S3S_3
A1A_1003322
A2A_2222233
A3A_3111122
Table 7.7 A decision problem in which dominance reasoning narrows the choices down to two that are crossing.

Try it in the Decisions Lab Step through dominance on this matrix.

It is harder to be so sanguine about Table 7.7. Looking at S1S_1 alone tells us that A1A_1 does not dominate either of the other choices, since it has the lowest utility at that state; and looking at S2S_2 alone tells us that A1A_1 cannot be dominated by either of the other choices, since it has the highest utility there. A3A_3, however, is strongly dominated by A2A_2: u(A2∧S1)>u(A3∧S1)u(A_2 \land S_1) > u(A_3 \land S_1) (since 2>12>1), u(A2∧S2)>u(A3∧S2)u(A_2 \land S_2) > u(A_3 \land S_2) (since 2>12>1), and u(A2∧S3)>u(A3∧S3)u(A_2 \land S_3) > u(A_3 \land S_3) (since 3>23>2); so we can safely cross it off. That leaves us with A1A_1 and A2A_2, and comparing them shows that u(A2∧S1)>u(A1∧S1)u(A_2 \land S_1) > u(A_1 \land S_1) (since 2>02>0) while u(A1∧S2)>u(A2∧S2)u(A_1 \land S_2) > u(A_2 \land S_2) (since 3>23>2): by Definition 7.12, A1A_1 and A2A_2 are crossing. All that dominance reasoning can tell us here is that we should not pick A3A_3; it is silent about how to choose between A1A_1 and A2A_2, and unlike in Table 7.6 we cannot reassure ourselves that this silence is harmless, since A1A_1 and A2A_2 are not equivalent—it plainly matters which of the two we end up choosing.

7.3.2 Maximin

Whereas the dominance rule only tells us which choices are irrational, there are other rules for decision under ignorance which tell us which choices are rational. One of them, the maximin norm, tells us to maximize the minimum utility. To do this, we have to first figure out, for each choice, what is the minimum utility it can give us. Then we see which choice has the maximum of these minima. Of course, there may be ties. In that case, we can once again apply the maximin norm to the remaining utilities (eliminating first the minima from the previous steps). If we write min⁡iu(φ∧Si)\min_{i} u(\varphi \land S_{i}) for the minimum utility that option φ\varphi yields across all states SiS_{i}—that is, φ\varphi’s worst-case utility—then the two norms are the following:

Norm 7.13. Maximin norm: Option φ\varphi is (maximin-)rational if and only if min⁡iu(φ∧Si)≥min⁡iu(ψ∧Si)\min_{i} u(\varphi \land S_{i}) \geq \min_{i} u(\psi \land S_{i}) for every other option ψ\psi.

Norm 7.14. Leximin norm: Let u(1)(φ)≤u(2)(φ)≤⋯≤u(n)(φ)u_{(1)}(\varphi) \leq u_{(2)}(\varphi) \leq \dots \leq u_{(n)}(\varphi) be the utilities of φ\varphi across all states, arranged from lowest to highest. Option φ\varphi is leximin-rational if and only if, for every other option ψ\psi, either u(k)(φ)=u(k)(ψ) for every k,u_{(k)}(\varphi) = u_{(k)}(\psi) \text{ for every } k, or there is some kk such that u(k)(φ)>u(k)(ψ)u_{(k)}(\varphi) > u_{(k)}(\psi) and u(j)(φ)=u(j)(ψ)u_{(j)}(\varphi) = u_{(j)}(\psi) for every j<kj < k.

To see the maximin norm at work, consider the following decision problem, involving four options and four states. For each option we star its minimum utility, and we double-star the option whose minimum is itself the maximum among all the minima.

S1S_1S2S_2S3S_3S4S_4
A1A_1550∗0^{*}0∗0^{*}22
A2A_2−1∗-1^{*}443377
A3A_36644441∗1^{*}
A4∗∗A_4^{**}5566443∗3^{*}
Table 7.8 A decision problem in which the maximin norm settles on a unique option.

Try it in the Decisions Lab Step through maximin and leximin on this matrix.

Going through Table 7.8 choice by choice, the minimum utility of A1A_1 is 00, the minimum utility of A2A_2 is −1-1, the minimum utility of A3A_3 is 11, and the minimum utility of A4A_4 is 33. Of those four minima, 33 is the largest, and it belongs to A4A_4 alone: no other option has a worst case that good. So, by Norm 7.13, A4A_4 is the uniquely maximin-rational choice.

Sometimes, though, maximin does not settle on a unique choice, because two or more choices are tied for the best worst case. When that happens, we turn to leximin, which, as we saw, tries to break the tie by looking at the second-worst utility of each of the tied choices (and, if they are tied there too, the third-worst, and so on). But even leximin can fail to settle on a unique choice, as the following decision problem, involving four choices and five states, illustrates.

S1S_1S2S_2S3S_3S4S_4S5S_5
A1A_10033554411
A2A_20033221111
A3A_30011223333
A4A_43300441155
Table 7.9 A decision problem in which applying the leximin norm still leaves two choices tied.

Try it in the Decisions Lab Step through maximin and leximin on this matrix.

In Table 7.9, every choice has the same minimum utility, 00, so maximin alone cannot distinguish between them. To apply leximin, we arrange each choice’s utilities from lowest to highest: A1A_1’s become (0,1,3,4,5)(0,1,3,4,5), A2A_2’s become (0,1,1,2,3)(0,1,1,2,3), A3A_3’s become (0,1,2,3,3)(0,1,2,3,3), and A4A_4’s become (0,1,3,4,5)(0,1,3,4,5). Comparing these term by term, all four choices agree on the lowest utility (00) and on the second-lowest (11), so the tie is not yet broken. At the third-lowest utility, however, A2A_2 (with 11) and A3A_3 (with 22) both fall below A1A_1 and A4A_4 (which each have 33 there), so by Norm 7.14 both A2A_2 and A3A_3 are eliminated. That leaves A1A_1 and A4A_4, and, as it turns out, their utilities sorted from lowest to highest are exactly the same: (0,1,3,4,5)(0,1,3,4,5) in both cases. So leximin narrows the field down to A1A_1 and A4A_4, but—since their sorted utilities agree at every position—it cannot tell us which of the two to choose.

7.3.3 Minimax regret

Consider what happens when we try to apply maximin to the following table:

S1S_1S2S_2
A1A_1$1.50\$1.50$1.75\$1.75
A2A_2$1.00\$1.00$10,000\$10{,}000
Table 7.10 A decision problem in which maximin recommends the cautious option over a gamble with a much higher potential payoff.

Strictly speaking, we cannot apply any decision rule to Table 7.10 because it has amounts of money instead of utilities in the cells. But for anyone whose preferences over money are more or less normal, the corresponding utilities will have the result that the maximin norm tells us to go with A1A_{1} because it has the maximum minimal utility possible (50 cents more than A2A_{2}). That is to say, the maximin rule is telling us to forgo an opportunity to gain $10,000 in order to save $0.50. Many would find that ridiculous. Those who do think that the regret you would feel if S2S_{2} obtains and you miss out on $10,000 is much greater than the relief you would feel if S1S_{1} obtains and you gain $0.50.

Let us formalize this view a bit. Let us define MAXi\mathrm{MAX}_{i} to be the highest utility that any of the available options yields in state SiS_{i}—i.e., the largest number in that state’s column: MAXi=max⁡φu(φ∧Si)\mathrm{MAX}_{i} = \max_{\varphi} u(\varphi \land S_{i}). Then the regret associated with u(φ∧Si)u(\varphi \land S_{i}) is the result of subtracting that value from the maximum for that state: r(φ∧Si)=MAXi−u(φ∧Si)r(\varphi \land S_{i}) = \mathrm{MAX}_{i} - u(\varphi \land S_{i}).

This suggests a new norm: instead of maximizing the minimum utility, minimize the maximum regret.

Norm 7.15. Minimax regret norm: Option φ\varphi is minimax-regret-rational if and only if max⁡ir(φ∧Si)≤max⁡ir(ψ∧Si)\max_{i} r(\varphi \land S_{i}) \leq \max_{i} r(\psi \land S_{i}) for every other option ψ\psi.

Returning to Table 7.10: MAX1=$1.50\mathrm{MAX}_{1} = \$1.50 and MAX2=$10,000\mathrm{MAX}_{2} = \$10{,}000. So A1A_1’s regret is $0 in S1S_1 (since it achieves the maximum there) and $9,998.25 in S2S_2, for a maximum regret of $9,998.25; while A2A_2’s regret is $0.50 in S1S_1 and $0 in S2S_2, for a maximum regret of only $0.50. By Norm 7.15, then, minimax regret recommends A2A_2—the reverse of what maximin recommended, and, to many people, the more sensible verdict.

To see how a regret table is built from a utility table, and how minimax regret is applied to it, consider the following decision problem, involving four choices and three states.

S1S_1S2S_2S3S_3
A1A_1441166
A2A_2225533
A3A_3663311
A4A_4334444
Table 7.11 A decision problem used to illustrate how a regret table is built from a utility table.

Try it in the Decisions Lab Step through minimax regret on this matrix.

We build the regret table one state at a time. In S1S_1, the highest utility anyone achieves is 66 (by A3A_3), so MAX1=6\mathrm{MAX}_{1} = 6; in S2S_2, the highest is 55 (by A2A_2), so MAX2=5\mathrm{MAX}_{2} = 5; and in S3S_3, the highest is 66 (by A1A_1), so MAX3=6\mathrm{MAX}_{3} = 6. Subtracting each choice’s utility from the relevant MAXi\mathrm{MAX}_i gives us the regret table below, where we star each choice’s maximum regret and double-star the choice whose maximum regret is itself the minimum among all the maxima.

S1S_1S2S_2S3S_3
A1A_1224∗4^{*}00
A2A_24∗4^{*}0033
A3A_300225∗5^{*}
A4∗∗A_4^{**}3∗3^{*}1122
Table 7.12 The regret table corresponding to Table 7.11.

Going through Table 7.12 choice by choice, the maximum regret of A1A_1 is 44, the maximum regret of A2A_2 is 44, the maximum regret of A3A_3 is 55, and the maximum regret of A4A_4 is 33. Of those four maxima, 33 is the smallest, and it belongs to A4A_4 alone. So, by Norm 7.15, A4A_4 is the uniquely minimax-regret-rational choice.

Now, maximin (and leximin) have a notable virtue that minimax regret lacks: they only need to know how the outcomes are ranked, not by how much one outcome is better than another. If we transform every utility in a decision problem by any function that preserves the original ranking of the outcomes—an ordinal transformation—maximin and leximin will always recommend the very same choice, since they only ever compare utilities using >>, ≥\geq, or ==, and no ordinal transformation can change the truth value of any of those comparisons. Minimax regret, however, essentially involves subtraction, and ordinal transformations do not, in general, preserve differences between numbers. So minimax regret’s recommendation can change under a transformation that leaves maximin’s recommendation exactly where it was.

To see this, consider what happens if we square every utility in Table 7.11—a legitimate ordinal transformation, since squaring is strictly increasing on positive numbers, and hence preserves the ranking of every outcome.

S1S_1S2S_2S3S_3
A1A_11616113636
A2A_244252599
A3A_336369911
A4A_49916161616
Table 7.13 The utilities of Table 7.11, each replaced by its square.

Try it in the Decisions Lab Step through minimax regret on this matrix.

The minimum utility of A1A_1 is now 11, of A2A_2 is 44, of A3A_3 is 11, and of A4A_4 is 99—so, just as before, A4A_4 has the largest minimum, and maximin still uniquely recommends A4A_4. Minimax regret, however, tells a different story. Now MAX1=36\mathrm{MAX}_{1} = 36, MAX2=25\mathrm{MAX}_{2} = 25, and MAX3=36\mathrm{MAX}_{3} = 36, which gives us the following regret table.

S1S_1S2S_2S3S_3
A1∗∗A_1^{**}202024∗24^{*}00
A2A_232∗32^{*}002727
A3A_300161635∗35^{*}
A4A_427∗27^{*}992020
Table 7.14 The regret table corresponding to Table 7.13.

The maximum regrets are now 2424 for A1A_1, 3232 for A2A_2, 3535 for A3A_3, and 2727 for A4A_4—so minimax regret now uniquely recommends A1A_1, the very choice it had previously ranked worst but one. Simply squaring the utilities—without changing how any outcome is ranked relative to any other—was enough to flip minimax regret’s recommendation from A4A_4 to A1A_1, even though maximin’s recommendation did not budge. This shows that minimax regret, unlike maximin and leximin, is not a purely ordinal norm: it presupposes that differences in utility are themselves meaningful, and can be compared to one another.

Minimax regret has a second, and arguably more troubling, defect: it can violate a principle we might call independence of irrelevant alternatives—roughly, the idea that whether φ\varphi or ψ\psi is recommended should not depend on which other choices happen to also be on the table, so long as neither of those other choices is itself the one recommended. To see minimax regret violate this principle, suppose our decision problem initially involves just two choices, AA and BB, and two states.

S1S_1S2S_2
AA991010
BB101088
Table 7.15 A decision problem involving two choices.

Try it in the Decisions Lab Step through minimax regret on this matrix.

Here MAX1=10\mathrm{MAX}_{1} = 10 and MAX2=10\mathrm{MAX}_{2} = 10, so AA’s regret is (1,0)(1,0), for a maximum of 11, while BB’s regret is (0,2)(0,2), for a maximum of 22. By Norm 7.15, minimax regret recommends AA. Now suppose a third choice, CC, becomes available—one that does very well in S1S_1 and very poorly in S2S_2.

S1S_1S2S_2
AA991010
BB101088
CC151522
Table 7.16 The same decision problem, with a third choice added.

Try it in the Decisions Lab Step through minimax regret on this matrix.

Adding CC raises MAX1\mathrm{MAX}_{1} from 1010 to 1515, which increases everyone’s regret in S1S_1. AA’s regret is now (6,0)(6,0), for a maximum of 66; BB’s regret is now (5,2)(5,2), for a maximum of 55; and CC’s own regret is (0,8)(0,8), for a maximum of 88. Minimax regret now recommends BB, not AA—even though CC, the newcomer, is not itself recommended, and nothing about AA’s or BB’s own prospects changed at all. It would not be strange if adding CC to the menu sometimes changed the recommendation to CC itself—that would just mean CC turned out to be a good choice. What is strange is that merely adding CC can flip the verdict between the two choices that were already on the table, even though CC never had a chance of being recommended in the first place.

Finally, minimax regret can recommend choices that seem straightforwardly wrong. Consider a decision problem with a hundred states, and two choices: A1A_1, which yields 100100 in S1S_1 and nothing at all in every other state, and A2A_2, which yields nothing in S1S_1 but 9999 in every one of the other ninety-nine states.

S1S_1S2S_2⋯\cdotsS100S_{100}
A1A_110010000⋯\cdots00
A2A_2009999⋯\cdots9999
Table 7.17 A decision problem in which minimax regret arguably gives the wrong verdict.

Intuitively, A2A_2 looks like the obviously better choice: it guarantees a solidly good outcome in ninety-nine out of a hundred states, while A1A_1 only pays off in a single state, and leaves us with nothing in all the rest. But minimax regret disagrees. MAX1=100\mathrm{MAX}_{1} = 100 and MAXi=99\mathrm{MAX}_{i} = 99 for every i>1i > 1. So A1A_1’s regret is 00 in S1S_1 and 9999 in every other state, for a maximum regret of 9999; while A2A_2’s regret is 100100 in S1S_1 and 00 everywhere else, for a maximum regret of 100100. Since 99<10099 < 100, minimax regret recommends A1A_1—the choice that, intuitively, we should avoid.

There is, however, a standard reply to this last objection: given that we are dealing with a decision under ignorance, we have no idea about the relative probabilities of the 100 states. For all we know, S1S_{1} has a 99.9999% chance of obtaining, while the remaining 99 states have almost 0 chance each. If, on the other hand, we do have at least some idea of the probabilities of the states, then we are dealing with a decision under risk, which is the topic of our next chapter.

Exercises

  1. What happens to an ordinal scale when it is transformed by multiplying each number by −1-1? By 0? Are these acceptable transformations of the original scale? Why or why not?

    Show solution

    Multiplying by −1-1 reverses the order of the outcomes, and multiplying by 00 makes every outcome tie, so neither transformation preserves the ordinal ranking. Neither is acceptable.

  2. Find the maximin act for the tables below. Use leximin to break ties.

    1. S1S_1S2S_2S3S_3S4S_4
      A1A_111−3-35566
      A2A_222223333
      A3A_34466−10-1055

      Practice in the Decisions Lab Work out maximin and leximin yourself, and the lab checks your answer.

    2. S1S_1S2S_2S3S_3S4S_4
      A1A_100111133
      A2A_200442211
      A3A_333000011

      Practice in the Decisions Lab Work out maximin and leximin yourself, and the lab checks your answer.

    Show solution

    (a) Maximin: the row minima are −3-3, 22, −10-10, so choose A2A_2. (b) The acts tie on their minima, so apply leximin: the sorted utility vectors are (0,1,1,3)(0,1,1,3), (0,1,2,4)(0,1,2,4), (0,0,1,3)(0,0,1,3), and A2A_2 is lexicographically best.

  3. Form the regret tables and find the minimax regret acts for the tables below.

    1. S1S_1S2S_2S3S_3
      A1A_1770044
      A2A_25521211111
      A3A_31010−5-5−1-1

      Practice in the Decisions Lab Work out minimax regret yourself, and the lab checks your answer.

    2. S1S_1S2S_2S3S_3
      A1A_155202066
      A2A_2−3-3881010
      A3A_3445599

      Practice in the Decisions Lab Work out minimax regret yourself, and the lab checks your answer.

    Show solution

    (a) Regrets: A1=(3,21,7)A_1=(3,21,7), max 2121; A2=(5,0,0)A_2=(5,0,0), max 55; A3=(0,26,12)A_3=(0,26,12), max 2626. Minimax regret chooses A2A_2. (b) Regrets: A1=(0,0,4)A_1=(0,0,4), max 44; A2=(8,12,0)A_2=(8,12,0), max 1212; A3=(1,15,1)A_3=(1,15,1), max 1515. Minimax regret chooses A1A_1.