AI Governance Engineer
GitHub

Calibration within groups

By Updated

The fairness property that, in every group, the people given a score s turn out positive at rate s, so a score means the same thing for everyone. It generally conflicts with equal error rates when base rates differ 1.

Developed in
ch. 16, The impossibility results
Chapters
ch. 16, Fairness & XAI
Contrast with
Calibration · Equalised odds
Source
1 numbered reference, listed below

Where it is used

One chapter of the Body of Knowledge uses the term. Each link opens the first section that does.

Calibration within groups: mentions per chapter3 mentions of the term across 1 of the 23 chapters of the Body of Knowledge; the chapters the glossary cross-references are drawn solid.Cross-referenced chapter16 Fairness & XAI: 3 mentions16 Fairness & XAI3No mentions in the other 22 chaptersSource: the Body of Knowledgev0.5.0
Calibration within groups: mentions per chapter3 mentions of the term across 1 of the 23 chapters of the Body of Knowledge; the chapters the glossary cross-references are drawn solid.Cross-referenced chapter00010203040506070810111213141516 Fairness & XAI: 3 mentions31617181920212223Source: the Body of Knowledge v0.5.0
Mentions per chapter How often each chapter names the term, with the chapters the glossary cross-references drawn solid. The longest bar is where to read the term in use; bars spread across many chapters mark a term that runs through the discipline.
Mentions as a table
Mentions of Calibration within groups per chapter
ChapterMentionsCross-referenced
00 Preface0No
01 Definition0No
02 Why Now0No
03 Values & Principles0No
04 The Stack0No
05 Patterns0No
06 The Role0No
07 Maturity Model0No
08 Regulatory Map0No
10 Reading List0No
11 AI Defined0No
12 Governance Program0No
13 Risk Management0No
14 Development0No
15 Deployment0No
16 Fairness & XAI3Yes
17 Incidents0No
18 EU AI Act0No
19 Privacy & AI0No
20 Existing Law0No
21 AI Laws Worldwide0No
22 Principles & Standards0No
23 AI Agents0No
Calibration within groups: related terms and patternsThe term at the centre; related terms on solid edges, the terms it is contrasted with on dashed edges, and the patterns that use it most in the colour of their layer.RelatedContrastCalibration within groupsRelated terms (1)Fairness · RelatedFairnessContrast with (2)Calibration · ContrastCalibrationEqualised odds · ContrastEqualised odds
Calibration within groups: related terms and patternsThe term at the centre; related terms on solid edges, the terms it is contrasted with on dashed edges, and the patterns that use it most in the colour of their layer.RelatedContrastRelated terms (1)Fairness · RelatedFairnessContrast with (2)Calibration · ContrastCalibrationEqualised odds · ContrastEqualised oddsCalibration withingroups
The term's neighbourhood Terms related to this one on solid edges, terms it is often confused with on dashed edges, and the patterns that use it most in the colour of their layer. Follow a dashed edge to check the distinction before you use either term.
Neighbourhood as a table
Neighbourhood of Calibration within groups
FamilyItemRelation
Related termsFairnessRelated
Contrast withCalibrationContrast
Contrast withEqualised oddsContrast
  • Fairness

    The property that a system's outcomes and errors do not unjustifiably disadvantage people or groups.

Sources

  1. [1] "Inherent Trade-Offs in the Fair Determination of Risk Scores" (Kleinberg, Mullainathan and Raghavan; three fairness conditions cannot hold together except in special cases; arXiv 1609.05807). arXiv. 2016-09-19. https://arxiv.org/abs/1609.05807 (verified: primary)

Definitions of legal terms paraphrase the cited text, which governs. Dated statements are as of .

Cite this term

García Aibar, J. (2026). Calibration within groups. In AI Governance Engineering: The Thesis & Body of Knowledge (v0.5.0), Glossary. https://doi.org/10.5281/zenodo.22956197. https://aigovernanceengineer.com/glossary/calibration-within-groups. CC BY 4.0

BibTeX

@misc{aige2026calibrationwithingroups,
  author  = {Jorge García Aibar},
  title   = {{Calibration within groups}},
  note    = {Glossary, AI Governance Engineering: The Thesis \& Body of Knowledge, version 0.5.0},
  year    = {2026},
  doi     = {10.5281/zenodo.22956197},
  url     = {https://aigovernanceengineer.com/glossary/calibration-within-groups}
}