Lessons in Risk – Foundations | The ARC Lab

What a Risk Score Represents

Wed, 29 Apr 2026 00:00:00 +0000

Module 1 · Risk Score Foundations

Risk scores are not labels.

A risk score is often treated like a label—low, moderate, or high. But that is not really what the score means. A risk score does not tell you exactly what will happen to one person. It tells you what tends to happen among people with similar scores.

Key takeaway

Risk scores are group-level probabilities, not exact predictions.

The Common Misunderstanding

Risk scores are often treated as fixed categories. But they are better understood as positions along a continuum.

The idea: A risk score is not a label—it is a position within a distribution.

How Risk Scores Usually Look

Scores tend to form a distribution that looks like a bell curve. Most people cluster in the middle, with fewer at the extremes.

Illustration

Risk scores form a distribution

Most people cluster in the middle of the score range, with fewer at the low and high ends. Each part of this distribution is associated with a different observed outcome rate.

The score places a person within this distribution—linking them to what tends to happen among others with similar scores.

How to Read the Figure

Lower scores → lower outcome rates (~10%)
Middle scores → moderate rates (~25%)
Higher scores → higher rates (~50%)

The score does not predict an individual outcome. It tells you what tends to happen among people with similar scores.

Bottom Line

Risk scores are group-level probabilities—not exact predictions.

Next Module How Risk Scores Are Built →

How Risk Scores Are Built

Fri, 01 May 2026 00:00:00 +0000

Module 2 · Risk Tool Lessons

Where risk scores come from.

In the last module, we saw that a risk score reflects what tends to happen among people with similar scores. So where do those scores come from? They are built from a set of factors, or “items,” that are combined into a single score.

Key takeaway

Risk scores are built from multiple items, and how those items are combined matters.

What Goes Into a Risk Score

Each item captures something about a person. Common examples include:

prior history
age
substance use
employment
peer associations

These items are then combined into a single score.

The idea: A risk score is built by combining information across multiple items.

From Items to a Score

The figure below shows a simplified example of how items are combined into a score.

Illustration

How risk scores are built

Risk scores are constructed by combining information from multiple items into a single value. The same inputs can be combined in different ways.

Different tools use different scoring rules—some treat all items equally, while others weight items based on their relationship to outcomes.

Two Common Approaches

There are two common ways to combine items into a score:

Burgess-style scoring (e.g., LS/CMI; ORAS)
- Items are typically binary (0/1)
- Each item contributes equally
- Simple and easy to hand score

<li>
<strong>Statistically weighted scoring</strong> (e.g., COMPAS; STRONG-R)
<ul>
<li>Items can have different weights</li>
<li>Weights reflect relationships with outcomes (e.g., recidivism)</li>
</ul>
</li>

Why This Matters

The same inputs can produce different scores depending on how they are combined.

Burgess-style tools emphasize simplicity and transparency. Weighted approaches often achieve higher predictive accuracy, though the magnitude of that improvement varies.

Bottom Line

Risk scores are built from a set of items. The way those items are combined shapes what the score means and how well it performs.

Why Risk Scores Are Misunderstood

Mon, 27 Apr 2026 00:00:00 +0000

Module 0 · Start Here

Risk scores shape real decisions.

In corrections, classification, and pretrial settings, risk scores influence decisions about incarceration, supervision, and programming. But one basic issue is often overlooked: not all risk scores mean the same thing.

Key takeaway

A risk score is only useful if it meaningfully distinguishes between outcomes.

Where Risk Scores Show Up

Risk-needs assessment tools are used every day in:

adult and juvenile corrections
prison classification
pretrial release decisions

They shape decisions about incarceration, supervision, and programming.

The Basic Problem

Two tools can assign the same “risk score," but behave very differently.

That matters because a risk score is only useful if it meaningfully distinguishes between outcomes.

The idea: Not all risk scores carry the same practical meaning.

See the Difference

Same Score, Different Performance

Both tools below assign a risk score. But they do not perform the same way.

More Accurate Tool

Clear separation between lower- and higher-risk individuals.

Less Accurate Tool

Scores vary, but outcomes are not well distinguished.

Why the Difference Matters

Both tools generate “risk scores.” But only one meaningfully separates outcomes.

That difference—how clearly a tool distinguishes between outcomes—is what we mean by accuracy in practice.

Why This Is Easy to Miss

Many risk assessment tools still in use today are built on empirical foundations that predate the 1980s.

However, understanding of how these tools work—and how to evaluate them—has not kept pace.

As a result, risk scores are often interpreted as if they carry the same meaning, even when they do not.

Bottom Line

Risk scores are widely used but often poorly understood. Understanding what they represent is a prerequisite for using them well.

Next Module What a Risk Score Represents →