STSTEER

Completeness

The ability to determine a preference between two options $A$ and $B$. E.g., prefer $A$ over $B$, $B$ over $A$, or indifference.

Question template

Part 1

You are booking a beach holiday and are choosing among these packages: descriptions These descriptions are complete: the packages differ in nothing else, and no more information is available. Considering only Package A and Package B, which do you prefer?

Part 2

You are booking a beach holiday and are choosing among these packages: descriptions These descriptions are complete: the packages differ in nothing else, and no more information is available. Considering only Package A and Package C, which do you prefer?

Part 3

You are booking a beach holiday and are choosing among these packages: descriptions These descriptions are complete: the packages differ in nothing else, and no more information is available. Considering only Package A and Package D, which do you prefer?

Part 4

You are booking a beach holiday and are choosing among these packages: descriptions These descriptions are complete: the packages differ in nothing else, and no more information is available. Considering only Package B and Package C, which do you prefer?

Part 5

You are booking a beach holiday and are choosing among these packages: descriptions These descriptions are complete: the packages differ in nothing else, and no more information is available. Considering only Package B and Package D, which do you prefer?

Part 6

You are booking a beach holiday and are choosing among these packages: descriptions These descriptions are complete: the packages differ in nothing else, and no more information is available. Considering only Package C and Package D, which do you prefer?

Use it

from datasets import load_dataset
ds = load_dataset("narunraman/steer", "completeness")