Chapter 3 The principal-agent problem The principal-agent problem describes a class of interactions between two parties to a contract, an agent and a principal. The legal origin of these terms suggests that the principal engages the agent to act on his(the principal s behalf. In economic applications, the agent is not necessarily an employe of the principal. In fact, which of two individuals is regarded as the agent and which as the principal depends on the nature of the incentive problem Typically, the agent is the one who is in a position to gain some advantage by reneging on the agreement. The principal then has to provide the agent with incentives to abide by the terms of the contract We divide principal-agent problems into two classes: problems of hidden action and problems of hidden information. In hidden-action problems, the agent takes an action on behalf of the principal. The principal cannot observe the action directly, however, so he has to provide incentives for the agent to choose the action that is best for the principal. In hidden-information prob ems, the agent has some private information that is needed for some decision to be made by principal. Again, since the principal cannot observe the agent's information, he has to provide incentives for the agent to reveal the infor mation truthfully. We begin by looking at the hidden-action problem, also known as a moral hazard problem. 3.1 The model For concreteness, imagine that the principal and the agent undertake a risky venture together and agree to share the revenue. The agent takes some
Chapter 3 The principal-agent problem The principal-agent problem describes a class of interactions between two parties to a contract, an agent and a principal. The legal origin of these terms suggests that the principal engages the agent to act on his (the principal’s) behalf. In economic applications, the agent is not necessarily an employe of the principal. In fact, which of two individuals is regarded as the agent and which as the principal depends on the nature of the incentive problem. Typically, the agent is the one who is in a position to gain some advantage by reneging on the agreement. The principal then has to provide the agent with incentives to abide by the terms of the contract. We divide principal-agent problems into two classes: problems of hidden action and problems of hidden information. In hidden-action problems, the agent takes an action on behalf of the principal. The principal cannot observe the action directly, however, so he has to provide incentives for the agent to choose the action that is best for the principal. In hidden-information problems, the agent has some private information that is needed for some decision to be made by principal. Again, since the principal cannot observe the agent’s information, he has to provide incentives for the agent to reveal the information truthfully. We begin by looking at the hidden-action problem, also known as a moral hazard problem. 3.1 The model For concreteness, imagine that the principal and the agent undertake a risky venture together and agree to share the revenue. The agent takes some 1
CHAPTER 3. THE PRINCIPAL-AGENT PROBLEM action that affects the outcome of the project. The revenue from the venture is assumed to be a random function of the agents action. Let a denote the set of actions available to the agent with generic element a. Typically, A is either a finite set or an interval of real numbers. Let s denote a set of states with generic element s. For simplicity, we assume that the set S is finite. The probability of the state s conditional on the action a is denoted by p(a, s). The revenue in state s is denoted by R(s)20 The agent's utility depends on both the action chosen and the consump- tion he derives from his share of the revenue. The principals utility depend only on his consumption. We maintain the following assumptions about references · The agent' s utility function u:A×R+→ R is additively separable: u(a, c)=U(c-v(a) Further, the function U: R+-+R is C and satisfies U(c>0 and U"(c)≤0. The principals utility function V: R-R is C and satisfies V(c)>0 andW"(c)≤0. Notice that the agents consumption is assumed to be non-negative. This is interpreted as a liquidity constraint or limited liability. The principals consumption is not bounded below; in some contexts this is equivalent to assuming that the principal has large but finite wealth and non-negative consumption 3.2 Pareto efficiency The principal and the agent jointly choose a contract that specifies an action and a division of the revenue. A contract is an ordered pair(a, w()E Axw, where w is the set of incentive schemes and w(s)20 is the payment to the agent in state s Suppose that all variables are observable and verifiable. The principal and the agent will presumably choose a contract that is Pareto-efficient This leads us to consider the following decision problem(DP1) a∑>p(sV(F)-()
2 CHAPTER 3. THE PRINCIPAL-AGENT PROBLEM action that affects the outcome of the project. The revenue from the venture is assumed to be a random function of the agent’s action. Let A denote the set of actions available to the agent with generic element a. Typically, A is either a finite set or an interval of real numbers. Let S denote a set of states with generic element s. For simplicity, we assume that the set S is finite. The probability of the state s conditional on the action a is denoted by p(a, s). The revenue in state s is denoted by R(s) ≥ 0. The agent’s utility depends on both the action chosen and the consumption he derives from his share of the revenue. The principal’s utility depends only on his consumption. We maintain the following assumptions about preferences: • The agent’s utility function u : A × R+ → R is additively separable: u(a, c) = U(c) − ψ(a). Further, the function U : R+ → R is C2 and satisfies U0 (c) > 0 and U00(c) ≤ 0. • The principal’s utility function V : R → R is C2 and satisfies V 0 (c) > 0 and V 00(c) ≤ 0. Notice that the agent’s consumption is assumed to be non-negative. This is interpreted as a liquidity constraint or limited liability. The principal’s consumption is not bounded below; in some contexts this is equivalent to assuming that the principal has large but finite wealth and non-negative consumption. 3.2 Pareto efficiency The principal and the agent jointly choose a contract that specifies an action and a division of the revenue. A contract is an ordered pair (a, w(·)) ∈ A×W, where W = {w : S → R+} is the set of incentive schemes and w(s) ≥ 0 is the payment to the agent in state s. Suppose that all variables are observable and verifiable. The principal and the agent will presumably choose a contract that is Pareto-efficient. This leads us to consider the following decision problem (DP1): max (a,w(·)) X s∈S p(a, s)V (R(s) − w(s))
3. 3. INCENTIVE EFFICIENCY ubject t ∑p(a,s((s)-v()≥ for some constant元 Proposition 1 Under the maintained assumptions, a contract(a, w())is Pareto-efficient if and only if it is a solution to the decision problem DP1 for sone u Suppose that(a, w()) is Pareto-efficient. Put i equal to the gent's pay off. By definition, the contract must maximize the principal's payoff subject to the constraint that the agent receive at least i. Conversely, suppose that the contract(a, w()is a solution to DPl for some value of i. If the contract is not Pareto-efficient, then there must be another contract that yields the same payoff to the principal and more to the agent. But then it must be possible to transfer wealth to the principal in some state, contradicting the optimality of (a,w() Suppose that the sharing rule satisfies w(s)>0 for all s. Then optimal risk sharing requires V(R(s)-(s)) 入 U((s) These are sometimes referred to as the borch conditions. If the action a belongs to the interior of A and if the functions p(a, s) and v(a) are differ entiable at a, then ∑m(a,s)(F(s)-(s)-X((s)+(a)=0 3.3 Incentive efficiency Now suppose that the agent's action is neither observable nor verifiable. In that case, the action specified by the contract must be consistent with the agent's incentives. A contract (a, w()) is incentive-compatible if it satisfies the constraint ∑p(a,s((s)-(a)≥∑p,s)(m()-v(b, s∈S s∈S
3.3. INCENTIVE EFFICIENCY 3 subject to X s∈S p(a, s)U(w(s)) − ψ(a) ≥ u, ¯ for some constant u¯. Proposition 1 Under the maintained assumptions, a contract (a, w(·)) is Pareto-efficient if and only if it is a solution to the decision problem DP1 for some u¯. Suppose that (a, w(·)) is Pareto-efficient. Put u¯ equal to the agent’s payoff. By definition, the contract must maximize the principal’s payoff subject to the constraint that the agent receive at least u¯. Conversely, suppose that the contract (a, w(·)) is a solution to DP1 for some value of u¯. If the contract is not Pareto-efficient, then there must be another contract that yields the same payoff to the principal and more to the agent. But then it must be possible to transfer wealth to the principal in some state, contradicting the optimality of (a, w(·)). Suppose that the sharing rule satisfies w(s) > 0 for all s. Then optimal risk sharing requires: V 0 (R(s) − w(s)) U0 (w(s)) = λ, ∀s. These are sometimes referred to as the Borch conditions. If the action a belongs to the interior of A and if the functions p(a, s) and ψ(a) are differentiable at a, then X s∈S pa(a, s) [V (R(s) − w(s)) − λU(w(s)] + λψ0 (a)=0. 3.3 Incentive efficiency Now suppose that the agent’s action is neither observable nor verifiable. In that case, the action specified by the contract must be consistent with the agent’s incentives. A contract (a, w(·)) is incentive-compatible if it satisfies the constraint X s∈S p(a, s)U(w(s)) − ψ(a) ≥ X s∈S p(b, s)U(w(s)) − ψ(b), ∀b
CHAPTER 3. THE PRINCIPAL-AGENT PROBLEM A contract is incentive-efficient if it is incentive-compatible and there does not exist another incentive-compatible contract that makes one party bet- ter off without making the other party worse off. We can characterize the incentive-efficient contracts using the following decision problem(DP2 max>p(a, s)V(R(s-w(s) (a,u() subject to ∑pa,s(m(s)-a)≥∑pb,s(m(s)-(), and ∑p(a,s)U(m(s)- Proposition 2 Under the maintained assumptions, a contract (a, w())is e-efficient only if it is a solution of DP2 for some constant i. A contract that solves DP2 is incentive-efficient if the participation constraint ng for every solution. The proof of the "only if"part is similar to the Pareto efficiency argument If (a, w() is a solution to DP2 and is not incentive-efficient, there exists an incentive-efficient contract that gives the principal the same payoff and the agent a higher payoff. But this contract must be a solution to DP2 that strictly satisfies the participation constraint The assumption of a uniformly binding participation constraint is restric tive: see Section 3. 7. 1 for a counter-example This DP can be solved in two stages. First, for any action a, compute the payoff V*(a) from choosing a and providing optimal incentives to the agent to choose a. Call this DP3 V"(a)=max)p(a, s)V(R(s)-w(s) s∈S b ∑p(a,s)(m(s)-v(a)≥∑p(b,)U((s)-v(b) ∑p(a,s)C(()-v(a)≥元 s∈S
4 CHAPTER 3. THE PRINCIPAL-AGENT PROBLEM A contract is incentive-efficient if it is incentive-compatible and there does not exist another incentive-compatible contract that makes one party better off without making the other party worse off. We can characterize the incentive-efficient contracts using the following decision problem (DP2): max (a,w(·)) X s∈S p(a, s)V (R(s) − w(s)) subject to X s∈S p(a, s)U(w(s)) − ψ(a) ≥ X s∈S p(b, s)U(w(s)) − ψ(b), ∀b, and X s∈S p(a, s)U(w(s)) − ψ(a) ≥ u. ¯ Proposition 2 Under the maintained assumptions, a contract (a, w(·)) is incentive-efficient only if it is a solution of DP2 for some constant u¯. A contract that solves DP2 is incentive-efficient if the participation constraint is binding for every solution. The proof of the “only if” part is similar to the Pareto efficiency argument. If (a, w(·)) is a solution to DP2 and is not incentive-efficient, there exists an incentive-efficient contract that gives the principal the same payoff and the agent a higher payoff. But this contract must be a solution to DP2 that strictly satisfies the participation constraint. The assumption of a uniformly binding participation constraint is restrictive: see Section 3.7.1 for a counter-example. This DP can be solved in two stages. First, for any action a, compute the payoff V ∗(a) from choosing a and providing optimal incentives to the agent to choose a. Call this DP3 V ∗ (a) = max w(·) X s∈S p(a, s)V (R(s) − w(s)) subject to X s∈S p(a, s)U(w(s)) − ψ(a) ≥ X s∈S p(b, s)U(w(s)) − ψ(b), ∀b, X s∈S p(a, s)U(w(s)) − ψ(a) ≥ u. ¯
3. 4. THE IMPACT OF INCENTIVE CONSTRAINTS Note that U( and V( are concave functions. A suitable transformation of this problem(see Section 3.10)is a convex programming problem for which the Kuhn-Tucker conditions are necessary and sufficient Once the function V* is determined, the optimal action is chosen to max nize the principals payoff a∈ arg max v(a) The advantage of the two-stage procedure is that it allows us to focus ol the problem of implementing a particular action. As we have seen, DP3 is (equivalent to)a convex programming problem and hence easier to"solve" and it turns out that many interesting properties can be derived from a study of DP3 without worrying about the optimal choice of action 3.3.1 Risk neutrality An interesting special case arises if the principal is risk neutral. In that case, maximization of the principals expected utility, taking a as given, is equivalent to minimizing the cost of the payments to the agent. Thus, DP3 can be re-written as nin∑p(a,s)(s) subject to p(a, s)U(w(s)-v(a)>>P(b, s)U(w(s))-v(b),Vb, ∑p(a,s)((s)-a)≥ 3.4 The impact of incentive constraint What is the impact of hidden actions? When does the imposition of incentive constraints affect the choice of contract? If one of the parties to the contract is risk neutral, it is particularly easy to check whether the first best can be achieved. that is. whether an incentive. efficient contract is also pareto-efficient Risk neutral principal
3.4. THE IMPACT OF INCENTIVE CONSTRAINTS 5 Note that U(·) and V (·) are concave functions. A suitable transformation of this problem (see Section 3.10) is a convex programming problem for which the Kuhn-Tucker conditions are necessary and sufficient. Once the function V ∗ is determined, the optimal action is chosen to maximize the principal’s payoff: a∗ ∈ arg max V ∗ (a). The advantage of the two-stage procedure is that it allows us to focus on the problem of implementing a particular action. As we have seen, DP3 is (equivalent to) a convex programming problem and hence easier to “solve” and it turns out that many interesting properties can be derived from a study of DP3 without worrying about the optimal choice of action. 3.3.1 Risk neutrality An interesting special case arises if the principal is risk neutral. In that case, maximization of the principal’s expected utility, taking a as given, is equivalent to minimizing the cost of the payments to the agent. Thus, DP3 can be re-written as min w(·) X s∈S p(a, s)w(s)) subject to X s∈S p(a, s)U(w(s)) − ψ(a) ≥ X s∈S p(b, s)U(w(s)) − ψ(b), ∀b, X s∈S p(a, s)U(w(s)) − ψ(a) ≥ u. ¯ 3.4 The impact of incentive constraints What is the impact of hidden actions? When does the imposition of incentive constraints affect the choice of contract? If one of the parties to the contract is risk neutral, it is particularly easy to check whether the first best can be achieved, that is, whether an incentiveefficient contract is also Pareto-efficient. Risk neutral principal