Skip to content
Research Medium #risk-of-bias#rob#quality

Risk-of-Bias Traffic Light

Per-study risk-of-bias matrix using red/yellow/green dots.

A free, animated risk-of-bias traffic light you can read here or embed on any website, from Scrollchart.

Risk-of-Bias Traffic Light

Risk-of-Bias Traffic LightROB-2 domain ratings per study: green low, yellow some concerns, red highRandomizationDeviationsMissing dataOutcome measurementSelective reportingOverallAllen 2018++++++Brown 2019+?+++?Chen 2020x?++?xDiaz 2020++?++?Evans 2021??x++xFoster 2022++++++Garcia 2023+x??+xHughes 2024++++?+Domain tallyLow 31 (65%)Some 11 (23%)High 6 (13%)8 studies6 domainsA single high-risk domain (red) is enough to flag the whole study as high risk in ROB-2. Yellow rows still inform sensitivity analysis.

A grid: studies on rows, ROB-2 domains on columns (random sequence, allocation concealment, blinding, attrition, reporting). Each cell has a colored dot indicating low/some-concerns/high risk. Useful for ROB-2, Cochrane reviews.

Good for

  • Visualising ROB-2 or ROBINS-I judgements in a systematic review
  • Spotting domain-wide methodological weaknesses across an evidence base
  • Selecting studies for sensitivity analysis by overall risk tier

Source & accuracy

This risk-of-bias traffic light is an editorial illustration built to represent the concept accurately. Where it shows figures, they are typical or representative values chosen to make the relationship clear, not a single underlying dataset. The diagram and its explainer are reviewed and maintained centrally, and updated over time as understanding improves.

Mapping bias sources across study components

The traffic-light matrix assesses bias risk separately for selection (randomization), performance (blinding of participants and staff), detection (assessor blinding), attrition (dropout and missing data), reporting (selective outcome reporting), and other threats. Each study gets its own row; each bias domain gets its own column. Green signals low risk, yellow signals unclear/some risk, red signals high risk.

No single bias domain determines overall credibility. A study with high selection bias but perfect blinding merits different treatment than one with low selection bias but severe reporting bias. The full row of traffic lights tells the story; systematic reviews use this domain-level detail to weight studies appropriately in meta-analysis.

From traffic lights to publication decisions

Red rows (high-risk studies) are rarely excluded wholesale, but their weight in pooled analysis declines. Many meta-analyses re-run analyses excluding high-risk studies to test robustness. A pooled effect that vanishes when high-risk studies drop out suggests findings rest on biased data, warranting skepticism.

The pictorial format accelerates systematic review reading. A column of reds in one bias domain across many studies signals endemic risk in that area (e.g., widespread failure to blind assessors in a field), prompting scrutiny of whether conclusions remain valid given that shared threat.

Embed this diagram

Add this animated risk-of-bias traffic light to your own site. Copy one line of HTML, or use the embed builder for theme and sizing options.

Reference

What this is
A free, embeddable, animated risk-of-bias traffic light for any website.
Who uses it
Researchers & academics, Science journalists, Medical educators, Health journalists.
How to embed
Copy one line of HTML. No signup. No watermark. Works in WordPress, Webflow, Ghost, Substack, plain HTML.
File size
iframe embed, ~80 KB gzipped (loads on demand, does not block your page paint).
License
Free forever. Editorial explainer text included; updated centrally over time.

Embed format options

Copy the universal HTML snippet, the WordPress shortcode, or an iframe fallback - see the WordPress plugin page for details. Any format keeps the same Core Web Vitals profile and the same explainer text.

Embed snippet
<div data-scrollchart="risk-of-bias-traffic-light" data-scrollchart-v="1"></div>
<script src="https://scrollchart.com/embed.js" async></script>

Frequently asked questions

Where can I get a free animated "Risk-of-Bias Traffic Light" for my website?
Scrollchart provides "Risk-of-Bias Traffic Light" as a free, embeddable animated diagram you can add to any website with one line of HTML. No signup is required and there is no watermark. The diagram and its explainer text are served from scrollchart.com, so the embed stays current without any maintenance on your end.
How do I embed a risk-of-bias traffic light in a blog post or article?
Paste the one-line HTML snippet from the Scrollchart diagram page into your post editor. It works in WordPress, Webflow, Ghost, and plain HTML with no plugin required. The animated diagram and its explainer text load from scrollchart.com and render directly in your page DOM.