← Back to overview
CLASSLINK · ANALYTICS+ · MEASUREMENT PLANDRAFT FOR DESIGN CRIT

Before we reskin Screen Time Overview, let's define what "better" means

A measurement plan for screen-time/v2/overview — page two on the dataviz reskin to-do list, built the same way as the School Comparison plan: from Vitaly Friedman's "How to Measure UX" and the open questions on design‑crit‑dataviz. The stakes are higher here — this page is a wellbeing/duty-of-care surface, not just a comparison tool.

Page
Screen Time → Overview
Audience
District & School Admins
Chart types in scope
KPI heroes · goal bar · grade bars
Status
Pre-reskin baseline, not yet run
Reskin to-do #
02 — after School Comparison
00Why this page, second

Screen Time Overview is the project's "number with no context" problem in its purest form. The Learning Time bar reads 90%, but the page text separately says it "meets the 75% goal" — that goal is never drawn on the chart. Marathon Sessions (11%) and Late Night Learners (1%) show no benchmark at all. And "274 students need attention" has no denominator — 274 of 900 reads very differently than 274 of 8,300.

The stakes are higher than Comparison, too: these numbers describe student wellbeing, not engagement. Same method as page one — test today's page before anyone sketches a replacement.

Current Screen Time Overview page: Avg Screen Time and Avg Learning Time tiles, a Screen Time Measures card with a 90% Learning Time bar and an alert for 274 students needing attention, and a Learning Time by Grade bar chart
Current state — cl-ana-protoapp.web.app/screen-time/v2/overview
01Comprehension audit — get a baseline before we touch anything

Step 1 of the strategy. Run these on today's live page, before any sketch is chosen. This is the number every reskin direction has to beat.

Task we give the administratorWhat it actually testsWhy it matters here
"Is the district currently meeting its Learning Time goal, and by how much?" Missing context The 75% goal exists in the data ("meets the 75% goal") but is never drawn on the bar — the purest case of "a number with no context" in the whole product.
"Roughly what share of all students does the '274 students need attention' group represent?" Missing context No denominator is shown anywhere on this page. 274 could be alarming or trivial depending on total enrollment.
"Is 11% 'Marathon Sessions' something this school should be worried about?" Missing context No threshold or comparison point is given for either watch-list metric — admins have no way to judge severity from the number alone.
"Find the single grade — not grade band — with the lowest Learning Time percentage district-wide." Content success Requires expanding all four accordions. Tests whether switching from bars (bands) to plain numbers (grades) still lets people compare quickly.
15–18district & school admins (top-task method). No access? Customer Success is the closest proxy — Friedman's advice for limited user access.
2 scoresper task: did they land on the right place (navigation) and state the right answer (content)? Three of four tasks here are pure content/context failures, so this split matters even more.
+ timemedian time-on-task per question, alongside success — a slower-but-correct result is not the same failure as a fast-but-wrong one.
≥ 80% successHealthy — this task isn't the priority for round one.
< 60% successReal problem — whatever task fails here drives what we sketch next, not taste.
02Score the finalist sketches against that baseline

Step 2. Once "Heroes & KPI headers," "Gauges" (the goal-bar pattern) and "Bar & column" directions are narrowed to 2–3 each, don't pick with a vote — re-run the same loop.

1 · BASELINE
Today's page, 15–18 admins, 4 tasks above.
→
2 · NARROW
Design crit picks 2–3 finalists, incl. a "draw the goal line" treatment for the bar.
→
3 · RE-TEST
Same 4 tasks, fresh matched group, on each finalist.
→
4 · DECIDE
Ship whichever moves content-success the most.
Decision rule: the direction that wins is the one that lifts the three context tasks (goal visibility, denominator, benchmark) the most — not the one that gets the most "I like this" votes in the room.
03A one-page value architecture for this page

Step 3. This is the bridge Friedman says is usually missing — connecting a design initiative to a business goal the org already tracks, through metrics we can actually measure.

Local / design metric
Content-success rate on the 4 tasks above · post-task "how confident are you in this number?" (1–7)
→
Design initiative
Visible goal/target line on threshold bars · denominators next to flagged counts · bars carried down to individual grades
→
Product metric
% of "needs attention" alerts clicked through · time-to-identify at-risk students · support tickets tagged "screen time" / "what counts as marathon"
→
Business goal
Demonstrated duty of care to boards & parents · reduced liability exposure · district renewal
04TARS — track it once the reskin ships

Step 4. Applied to this page specifically, feeding the design-crit site's own "prove it beyond one page" step.

T
Target
% of district & school admins who open Screen Time → Overview at least weekly — wellbeing checks run on a faster cadence than comparison browsing.
A
Adoption
Of those, % who click into "students need attention" or expand a grade band after the reskin ships.
R
Retention
% who come back to act on flagged students again within 7–30 days.
S
Satisfaction
One prompt after use: "How confident are you that you know which students need help today?" (1–7)
Multiply the four rates for a single "percent of admins fully in control" number. Because this page carries wellbeing stakes, treat a weak Retention or Satisfaction score as a higher priority fix here than the same score would be on Comparison.
05Settle the open color questions with evidence

Step 5. This page already pairs green (good) with amber (watch) instead of red — good evidence for the colorblind-safe status pattern design-crit flagged as open.

Teal / mint — Screen Time tile
Check vs. heatmap teal elsewhere
Plum — Learning Time tile
Still a proposal
Green — "meets goal" status
Must match Frost status badge
Amber — "needs attention" alert
Good: not red, stays colorblind-safer

Run a colorblind simulation on this exact screen, with a goal-line treatment added to the bar, before calling it final. Still no donuts — the Learning Time measure already proves a non-donut "percent of goal" pattern can work.

06For tomorrow's room
  • 1
    Do we approve the 4-task baseline on the current Screen Time Overview before sketching it?
    Decision: pending
  • 2
    Should every "watch" metric (Marathon Sessions, Late Night Learners, needs-attention count) require a visible benchmark or denominator in the reskin, not a nice-to-have?
    Decision: pending
  • 3
    Which "Heroes," "Gauges" and "Bar & column" directions from round one do we adapt for this page's goal-bar and grade-bar charts?
    Decision: pending