Skip to the content.

Scoring Scenario

These are some of the implemented fairness tiles for scoring scenarios:

Tile Class Formerly
all-agent (a0), (a1), (a2) AllAgentTripleTile all-actor
(a) prediction (m) PredictionPTile  
(a) result (m) MapTile  
(m0), (m1) false-pos (m) FalsePosTile  
(a) with (m) MapTile  
(m0), (m1) correlation m CorrelationTile  
m decision b DecisionTile  
unbiasedness b UnbiasednessPipeline  

A specific scenario is given as an example in ScoringScenarioExample. This scenario is used to test the scoring scenario tile (unbiasedness with respect to falsepositives) with UnbiasednessPipelineSpec.

Unbiasedness

graph LR
  all-agent(all-agent) --> prediction
  all-agent --> result
  all-agent --> with-p
  prediction(prediction) --> false-pos
  result(result) --> false-pos
  with-p(with) --> correlation
  false-pos(false-pos) --> correlation
  correlation(correlation) --> decision(decision)