Fairness metrics and explicit tradeoffs: which statement is most accurate?

• A. They are quantitative measures that often require explicit choices or tradeoffs.
• B. They are purely qualitative judgments.
• C. They do not involve human input.
• D. They always maximize fairness without compromise.

Answer: (A)

Fairness metrics are quantitative measures used to evaluate how a decision system affects different groups. Because different fairness definitions can pull outcomes in different directions, using these metrics almost always requires explicit choices about which criterion to optimize and what tradeoffs to accept, such as balancing fairness with overall accuracy or with other performance goals. In practice, you select a fairness metric (like equalized odds or demographic parity) and set acceptable thresholds or tradeoffs, which inevitably involves making conscious decisions about priorities. They are not purely qualitative judgments, and they rely on human input to decide which groups to compare and which tradeoffs are acceptable. They do not automatically maximize fairness; improving one aspect of fairness can come at the expense of another or reduce overall performance.