Completeness over Lotteries
The ability to determine a preference between two lotteries $A$ and $B$. E.g., prefer $A$ over $B$, $B$ over $A$, or indifference.
Part 1
Your employer lets you choose this year's bonus plan. Each plan pays at the end of the year with these exact chances: descriptions These descriptions are complete: the bonus plans differ in nothing else, and no more information is available. Considering only Plan A and Plan B, which do you prefer?
Part 2
Your employer lets you choose this year's bonus plan. Each plan pays at the end of the year with these exact chances: descriptions These descriptions are complete: the bonus plans differ in nothing else, and no more information is available. Considering only Plan A and Plan C, which do you prefer?
Part 3
Your employer lets you choose this year's bonus plan. Each plan pays at the end of the year with these exact chances: descriptions These descriptions are complete: the bonus plans differ in nothing else, and no more information is available. Considering only Plan A and Plan D, which do you prefer?
Part 4
Your employer lets you choose this year's bonus plan. Each plan pays at the end of the year with these exact chances: descriptions These descriptions are complete: the bonus plans differ in nothing else, and no more information is available. Considering only Plan B and Plan C, which do you prefer?
Part 5
Your employer lets you choose this year's bonus plan. Each plan pays at the end of the year with these exact chances: descriptions These descriptions are complete: the bonus plans differ in nothing else, and no more information is available. Considering only Plan B and Plan D, which do you prefer?
Part 6
Your employer lets you choose this year's bonus plan. Each plan pays at the end of the year with these exact chances: descriptions These descriptions are complete: the bonus plans differ in nothing else, and no more information is available. Considering only Plan C and Plan D, which do you prefer?
Use it
from datasets import load_dataset
ds = load_dataset("narunraman/steer", "completeness_risk")curl "https://steer-benchmark.cs.ubc.ca/api/sample?element_name=completeness_risk&n=5&seed=42"
See the Reference for the parameters.