What this course is for, and what attention means when somebody measures it

90 min

Listen: this lesson as a conversation

Two hosts talk the lesson through. The voices are synthetic; the script was written from this lesson and checked against it, and asserts nothing the lesson does not.

In this lesson you will learn to
  • Distinguish the two instruments this subject uses, self-report and task performance, and say why the same question answered by each can give different results
  • Say what this course promises and what it refuses to promise, and identify a claim about attention that the course could not support
  • Name the population nearly every figure in this subject was measured on, and say what that does and does not license

There is more advice about attention than about almost anything else, and less measurement behind it than almost anywhere else you'll read.

This course is about the measurement. That means it starts somewhere unhelpful, with what the word covers and how anybody counts it, because the single most useful thing in this subject is knowing which instrument produced a claim, and it comes back in four later lessons.

Two instruments, and they do not agree

Almost every finding about attention comes from one of two places.

A questionnaire. Somebody is asked how often they get distracted, how much media they use at once, how hard they find it to stay on a task. The answer is a judgement the person makes about themselves, usually over weeks or months of remembered experience.

A task. Somebody sits down and does something that produces a count. How many targets they missed, how long they took, how often they responded to something they were told to ignore. The answer is a number produced in the room, in twenty minutes or an hour.

These sound like two routes to the same fact and they aren't. In the 2021 synthesis of the media-multitasking literature, the two halves give different answers about the same question: the association is small but holds where people reported on themselves, and does not survive a standard correction for publication bias where a task did the measuring.[3] Lesson 4 is that case in full.

So the question to ask first, of any claim about attention, is which of the two produced it. That is this course's opening move and it is not a trick to catch researchers out: both instruments measure something real, and the interesting question is what they measure.

Predict first

Before you read on: a questionnaire asks a hundred people how distractible they are, and a task measures the same hundred people. Why might the two disagree? Write down as many reasons as you can in two minutes.

Show the answer

Three reasons, and the first two are in what this course read. The third is the course's own reading of the two instruments rather than a finding anybody has reported,[5] and it is the one worth having.

A questionnaire asks for a judgement and a task produces a count. "How often do you get distracted?" is answered by consulting an impression built over months. A task counts what happened between two o'clock and half past. Those can come apart without anybody being wrong or dishonest.

They are about different stretches of time. The questionnaire is about a life. The task is about half an hour in a room with nothing else to do, which isn't a setting most distraction happens in.

And here is the third, which changes how you read this whole subject. A person who believes their attention is poor will answer the questionnaire accordingly, and that belief is itself a real thing with real effects that the questionnaire is picking up. The self-report isn't a failed attempt at the task's measurement. It is a different measurement, of how somebody experiences and describes their own attention, and that is worth knowing even when the task disagrees.

Which is why this course does not simply say "trust the task". Lesson 4 has to hold both, and so will you.

What the word covers

The literature separates several things, and the separation matters less than the instrument question above, so this is short.

Sustained attention is staying on one thing over time. Selective attention is holding on to one thing while something else competes. Switching is what happens when you move between tasks, and the control of switching is what most of this course is actually about.

Those three descriptions are ordinary usage rather than anything this course read, and they are named here only so they don't arrive unexplained later; no attention textbook was opened for this course, and this is not the place to pretend otherwise.[5]

What the course does require is the instrument question, and one more thing: noticing when a claim about one capacity is being made from evidence about a different one. The brain-drain literature in lesson 5 is the case. Its own meta-analysis sorts the evidence into memory, attention and general cognitive performance, and finds the effect in memory and not in attention,[4] which is the capacity the phrase itself claims.

What this course is for

It won't make you more focused, and that is a statement about the state of the evidence rather than modesty.

What the research in this course can do is tell you what has been measured: what an interruption costs, how often a mind is elsewhere, what happens to two famous claims about devices when the studies are pooled, and whether anything that calls itself attention training transfers to anything. That is a great deal, and it isn't a method.

There is one constructive section in the whole course, in lesson 6, and it is built only from what survives lessons 2 to 5. Where it reasons past the evidence it says so in the sentence. A course that handed you seven techniques on the strength of this literature would be doing the thing this course exists to teach you to spot.

And one refusal is worth stating now, because everybody arrives with the question. This course cannot tell you whether your attention has got worse than it used to be. No source it has read measures the same people on the same instrument years apart. Some follow people for hours or weeks; none follows anybody across the stretch of time the question is about. That's a fact about the evidence rather than a verdict on your impression, and lesson 7 comes back to it with the whole course behind you.

Where this course sits

Time Management lesson 5 already did part of this subject and this course does not repeat it. That lesson covers how long people work before switching or being interrupted, what a real working day looks like when somebody follows people around with a stopwatch, and a trace of the most quoted number in the whole subject back to a source nobody can produce. If you haven't read it, read it before lesson 2 here.

One thing overlaps deliberately and it is worth saying which. Time Management lesson 5 also gives the experiment that lesson 2 here is built on: its sample, its design and its abstract, which is interrupted tasks done faster and paid for in stress and effort. This course has read that paper in full, and lesson 2 takes it to the condition-by-condition times, the workload ratings and the one thing that changed about the work itself. If you have met the headline already, lesson 2 is where it gets taken apart.

Habits and Self-Discipline is the course immediately before this one, and two things from it get used. Lesson 3's cue, which is the best-evidenced practical idea in that course, comes back in lesson 6. And the habit of putting a figure back beside the sentence it came from, which that course built, is assumed here rather than re-taught.

What this course adds is what happens inside the hour. Not how your week is shaped, and not how a behaviour becomes automatic, but what an interruption does to the work and to you, and what the evidence says about the things people blame.

The gap in the evidence, named now rather than discovered later

Predict first

Four sources, below, with what each was measured on. Before you look at the third column: how many of the four do you expect were measured on students or self-selected volunteers? Write a number from nought to four.

Show the answer

Most readers guess one or two. The answer is that three of the four are students or volunteers outright, and the fourth pools studies that are overwhelmingly student samples.

That is not a scandal and it is not a secret. It is the ordinary state of psychology's evidence base, because students are who is available to university researchers, and it is why this course states a sample next to every figure rather than once at the start.

What it should change is the verb you use. Not "people are distracted by their phones" but "students in these studies were", which is a duller sentence carrying a claim somebody has actually supported.

Every main source in this course, with what it was measured on.12[3][4]

The source What it measured On whom When
The interruption experiment Time, errors, politeness and rated workload on an email task 48 people, 81% German university students, mean age 26 2008
The mind-wandering study Self-reported thought and mood at random moments 2,250 adults, 58.8% male, 73.9% in the United States, mean age 34, sampled through an iPhone application 2010
The media-multitasking synthesis 118 assessments pooled from the published literature Overwhelmingly student samples 2021
The phone-presence synthesis 22 studies, 43 effects pooled Overwhelmingly student samples, across three regions 2023

Read the third column rather than the second. Three of the four are students or volunteers, and the fourth is a pooling of studies that are mostly students. That's a real limit on everything this course tells you, and it is the ordinary state of this literature rather than a failure of these particular papers.

Work one row before you go on. Take the mind-wandering study. What it measured is what people said they were thinking, at a moment they did not choose. Who it measured is 2,250 adults who had installed a happiness application on an iPhone. When was 2010. So a sentence beginning "people spend half their time thinking about something else" is already wrong at the second word, and the sentence the row supports is "in a large group of volunteers who chose to track their own happiness in 2010, minds were elsewhere in 46.9 percent of sampled moments". That second sentence is duller, and it is the one lesson 3 can defend.

And it cuts both ways, which is the part people get wrong. A student sample doesn't make a finding worthless: it makes it a finding about people like those, which is still information, and several of the effects here would be surprising in any population. What it rules out is the sentence "people are". Every figure in this course arrives with its sample attached, in the body, where you meet it.

Worked: the same person, two answers

This case is constructed, because no source read for this course reports an individual's two measurements side by side.[5]

Priya answers a questionnaire. Asked how often she is distracted at work, she picks "very often". Asked whether she finds it hard to stay on one task, she agrees strongly. On a self-report measure she comes out as highly distractible, and she would tell you the same over coffee.

Priya does a task. Half an hour in a quiet room, responding to targets and ignoring distractors. Her score is unremarkable: middle of the group, no worse than the people who described themselves as focused.

Both results are real and this course's view is that neither corrects the other. The task says that in a quiet room with one thing to do, her control of attention is ordinary. The questionnaire says that in her working life she experiences constant distraction and has concluded something about herself from it.

Three things could produce that pattern, and the lesson can't tell you which is true of a constructed person; the point is that all three are live.[5]

  1. Her working environment is genuinely more demanding than the room, and the task did not measure the thing that is hard for her.
  2. Her judgement about herself is reporting something other than her attention, such as how much she has to do, or how often she is interrupted by other people.
  3. The belief is doing work of its own. Somebody who has concluded they cannot focus behaves differently from somebody who has not, and the questionnaire is the only one of the two instruments that can see it.

Notice what a course built on only one instrument would tell her. On the task alone: nothing is wrong, which she wouldn't recognise. On the questionnaire alone: her attention is poor, which the task does not support. The honest answer uses both, and it is less satisfying than either.

Check yourself

Somebody objects that this is just academic hedging. They know their attention is worse than it was, they do not need a study to tell them, and a course that will not say so is being precious.

Show the answer

It is a fair challenge and it deserves a real answer rather than a shrug.

The first half of the answer is that their impression is evidence of something. They are reporting a change in how their working life feels, and the whole self-report half of this literature is built on exactly that kind of report. Lesson 4 will show that it is the half in which the associations hold.[3] Nobody here is telling them they've imagined it.

The second half is what their impression cannot settle. A memory of how easy it was to read a book in 2015 is a comparison between a current experience and a remembered one, and nobody has measured how well that comparison tracks. It's also confounded with everything else that changed: their job, their sleep, their age, how many people can now reach them.

And the thing that would settle it doesn't exist in what this course read. You would need the same people measured on the same instrument, years apart, and no source here does that.

So the honest sentence is narrow and it isn't a dodge: this course cannot tell you whether your attention has declined, because nobody it read designed a study that could. Somebody could, and that is the shape of a real answer to a real question, and lesson 7 takes it up again.

Five things people believe about attention

"Attention is one capacity." It covers at least three things, and the useful consequence is not the taxonomy but that a claim about one of them is often supported by evidence about another, which is the mistake the section above describes.

"If I feel more distractible, I am." You are certainly reporting something, and what a questionnaire and a task say about the same person can differ. Which of the two answers your question depends on what you wanted to know.

"Studies of students tell you nothing." This over-corrects and would throw away most of what is known here. A student sample makes a finding narrower rather than empty, and the fix is to carry the sample with the figure.

"Attention research is all lab tricks." Some of it is, and lesson 2's result, which is the clearest thing in this course, came out of a lab. What matters is not whether a study was run in a room but whether its scope travels with its finding.

"A meta-analysis settles it." It pools what has been published, which isn't the same as what has been found, and lesson 4 is about what happens to one pooled effect when somebody corrects for the difference.

What this course leaves out on purpose

Flow. There is a large literature on the state people mean by it, this course hasn't read the measurement side of it, and a lesson of description would be decoration. Named here so it does not look like an oversight.

Attention as a clinical matter. A different literature and a different question, with real harm available if a general course treats them as the same thing. This course does not.

The neuroscience. There are real accounts of attention networks in the brain and this course has not read them.

Notification and interface design. It is the applied half of the literature lesson 2 comes from, and this course is about the person rather than the software.

Practice

Two answers about yourself

Take 25 minutes.

First, the questionnaire half. Write down your answer to three questions, in one word or a number each.

  1. How often are you distracted during work you care about? Very often, often, sometimes, rarely.
  2. How hard do you find it to stay on one task for an hour? Very hard to very easy.
  3. Has this got worse over the last five years? Yes, no, or don't know.

Then, before you go further, write a prediction. If somebody sat you in a quiet room for half an hour with one task and counted your errors, how would you come out against other people? Better than average, average, or worse. One word, written down.

Now the third question, which is the one this lesson is for. For each of the three answers above, write one line saying what would have had to be measured for that answer to be a fact about your attention rather than a report of your experience.

This course expects most readers to find question three the hardest, and to answer it with "nothing I have", which is an expectation rather than a measurement.[5] It is also the correct result, and the reason the course opens here.

Sort five claims

Take 20 minutes, and keep the sheet, because lesson 7 comes back to it.

Find five claims about attention. A headline, an app's marketing, a book's cover, something somebody told you, a post. Write each one down word for word.

For each, answer two questions in writing.

  1. Which instrument would have had to produce this? A questionnaire, a task, something else, or nothing that exists.
  2. Does the claim say? Most don't, and noticing the silence is the skill.

Then one line at the end: how many of the five could be checked at all, as stated, by anybody.

A claim that names no instrument isn't necessarily false. It's a claim nobody can currently check, which is a different thing and is lesson 7's first category.

Connections

Back. Time Management lesson 5 has the field study of a working day, the length of a work segment, and the trace of the twenty-three-minute figure, none of which this course repeats. Habits and Self-Discipline lesson 2 is the nearest relative of this lesson: it is about what a criterion is doing inside a number, and this one is about what an instrument is doing. Reading Well lesson 8 is where reading a paper's methods was taught, and Logic and Argument lesson 5 is what lets you read a study of 48 people as evidence of anything at all.

Forward. Lesson 2 is the clearest measured result in the course and the one that inverts what people expect. Lesson 3 is the interruption that comes from inside your own head. Lessons 4 and 5 are the two device claims, and both of them turn on the instrument question this lesson opened. Lesson 6 asks whether any of it can be trained. Lesson 7 is the one that stays useful once every figure here has dated.

Go deeper

  • The Cost of Interrupted Work: More Speed and Stress (CHI 2008). Six pages, free, read in full by this course. Lesson 2 is about it, and it is worth reading before that lesson rather than after: the result's more surprising if you meet it cold.
  • A Wandering Mind Is an Unhappy Mind (Science, 2010). One page, free, read in full by this course. A single page, and a good demonstration that a famous finding can fit on one with its own caveats printed beside it.

Sources

  1. Gloria Mark, Daniela Gudith and Ulrich Klocke, "The Cost of Interrupted Work: More Speed and Stress", Proceedings of CHI 2008, pages 107 to
    1. Read in full. Supports this lesson's scope row only: 48 subjects, 81 percent German university students, mean age 26, an email task with rated workload. Lesson 2 uses it properly.
  2. Matthew A. Killingsworth and Daniel T. Gilbert, "A Wandering Mind Is an Unhappy Mind", Science 330, 2010, page 932. Read in full. Supports this lesson's scope row only: 2,250 adults, 58.8 percent male, 73.9 percent residing in the United States, mean age 34, sampled through an iPhone application. Lesson 3 uses it properly.
  3. Douglas A. Parry and Daniel B. le Roux, "'Cognitive Control in Media Multitaskers' Ten Years On: A Meta-Analysis", Cyberpsychology 15(2), 2021, article 7. Read in substantial part: the abstract, the overall meta-analytic result, the moderator analyses and the conclusion. Supports this lesson's scope row and the statement that the two instruments disagree in that literature. Lesson 4 gives the figures.
  4. Tobias Böttger, Marius Poschik and Klaus Zierer, "Does the Brain Drain Effect Really Exist? A Meta-Analysis", Behavioral Sciences 13(9), 2023, article 751. Read in substantial part: the abstract, the overall result, both subgroup analyses and the discussion. Supports this lesson's scope row and the statement that its effect is found in memory rather than in attention. Lesson 5 gives the figures.
  5. Priya is constructed, and so is every detail attached to her; the lesson says so where she appears. The three explanations offered for her two results are this course's own reasoning from the two instruments as described, not findings anybody has reported, and the body says so where they are given. The account of why the two instruments come apart, in the predict block, is also the course's own, and the third of its three reasons is the one this course would defend rather than something it read.

Check your understanding

This lesson has a 6-question quiz. Pass it and the questions come back on a schedule in Review, so what you learned stays learned. Your progress is saved in your browser; no account needed.