'Indifference' methods for managing agent rewards
`Indifference' refers to a class of methods used to control reward based agents. Indifference techniques aim to achieve one or more of three distinct goals: rewards dependent on certain events (without the agent being motivated to manipulate the probability of those events), effective disbelief (where agents behave as if particular events could never happen), and seamless transition from one reward function to another (with the agent acting as if this change is unanticipated). This paper presents several methods for achieving these goals in the POMDP setting, establishing their uses, strengths, and requirements. These methods of control work even when the implications of the agent's reward are otherwise not fully understood.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
House-Swapping with Objective Indifferences
We study the classic house-swapping problem of Shapley and Scarf (1974) in a setting where agents may have "objective" indifferences, i.e., indifferences that are shared by all agents. In other words, if any one agent is…
Shapley-Scarf Markets with Objective Indifferences
In many object allocation problems, some of the objects may effectively be indistinguishable from each other, such as with dorm rooms or school seats. In such cases, it is reasonable to assume that agents are indifferent…
ObjectDynamic indifference pricing via the G-expectation
We study the dynamic indifference pricing with ambiguity preferences. For this, we introduce the dynamic expected utility with ambiguity via the nonlinear expectation--G-expectation, introduced by Peng (2007). We also st…
Asymptotic indifference pricing in exponential L\'evy models
Financial markets based on L\'evy processes are typically incomplete and option prices depend on risk attitudes of individual agents. In this context, the notion of utility indifference price has gained popularity in the…
Forward indifference valuation and hedging of basis risk under partial information
We study the hedging and valuation of European and American claims on a non-traded asset $Y$, when a traded stock $S$ is available for hedging, with $S$ and $Y$ following correlated geometric Brownian motions. This is an…