Taking action
How do I choose a practical way to collect feedback during a small experiment?
Choose the feedback method from the question, not from the tool you happen to have. Use a count or checklist for whether and how often something happened; use a short note, observation, or conversation for how it happened and what shaped it. Reuse an existing record when it answers the question. Pair one numeric trace with one narrative prompt only when you need both the pattern and its context. The ECHO card—Exact question, Cheapest existing trace, Human context, One light-touch method—keeps collection useful and proportionate.
Start with the answer you need
Write one learning question that could change the next step. “Did I complete the planned action?” needs a different record from “What made the action easier or harder?” If the result would not change whether you stop, adapt, continue, or seek help, do not collect it merely because it might be interesting.
CDC's Step 4 guidance says methods, measures, and data sources should align with the evaluation purpose and question. Its setting is programme evaluation, not personal reflection. The modest transfer is to define the answer needed before choosing a form, app, conversation, or score.
Use the ECHO feedback card
ECHO is a Forever Free Compass framework, not an external research finding. Complete it before the experiment begins, then keep the method stable until the planned review unless consent, safety, access, or feasibility requires a change.
- Exact question: write the one thing you need to learn before the next decision.
- Cheapest existing trace: check whether a calendar mark, completion record, time note, or other record already answers it.
- Human or contextual gap: name what the trace cannot explain, including ease, friction, meaning, setting, or another affected person's experience.
- One light-touch method: choose the smallest count, checklist, observation, short note, or permission-based conversation that closes the gap; add a second method only for a stated reason.
Match the method to the kind of question
Use a simple numeric trace when the question is whether, when, or how often something happened. Use words or direct observation when the question is how, why, or under what conditions it happened. Neither is automatically stronger: a precise count can miss context, while a detailed note can make comparison difficult.
CDC distinguishes quantitative methods, which support numerical description and comparison, from qualitative methods, which provide deeper experience and context. The 2026 Test and Learn guidance likewise describes feedback from data analysis, observation, short conversations, surveys, and other methods.
| Learning question | Light-touch method | What it cannot establish |
|---|---|---|
| Did the planned action happen? | One completion mark after each planned opportunity | Why an attempt happened or was missed |
| Where did the action become difficult? | One sentence immediately after the attempt | How common that difficulty will be later |
| How did the change affect another person? | A brief permission-based question in their own words | Consent to continue or a causal effect |
| What happened and what shaped it? | One count plus one fixed context prompt | A generalisable or causal conclusion |
Reuse a trace before creating a new request
Look first for a record the action already produces: a scheduled session, a submitted draft, a start and finish time, or a visible completion state. Reuse it only when it measures the thing you actually asked. A calendar entry can show that time was reserved; it cannot show that the work happened or explain what interrupted it.
The Magenta Book says existing data can reduce cost and respondent burden but may not match the specific question or timing. CDC similarly recommends checking available data before collecting something new. For a personal experiment, reuse should mean less effort without quietly changing the question to fit the available record.
Add one context prompt only when it changes interpretation
If a count alone could mislead the next decision, add one fixed prompt such as “What most helped or blocked this attempt?” Keep the wording and timing consistent. Do not add several ratings and open-ended questions unless each has a named use. At review, read the count as a pattern across these attempts and the note as context, not as proof that the experiment caused an outcome.
The 2026 Test and Learn guidance recommends proportionate qualitative and quantitative feedback and notes that combined methods can show both what is happening and why. It also says early prototype feedback is for the next iteration rather than definitive or generalisable evidence.
Set limits for burden, privacy, and interpretation
Before collecting, write who will record what, when it will be deleted or reviewed, and who may see it. Ask permission before requesting another person's feedback, collect no sensitive detail that the decision does not require, and stop a method that creates disproportionate effort or discomfort. A lighter method is not automatically ethical; purpose, consent, access, storage, and possible harm still matter.
CDC's framework says data plans should balance need-to-know information against time and effort, protect privacy and confidentiality, respect appropriate permissions, and consider context. ECHO is only for low-stakes, reversible exploration. It must not be used to collect private health information, bypass workplace or legal requirements, test safety boundaries, or replace qualified guidance or formal research oversight.
Original contribution
The Forever Free Compass take
Forever Free Compass uses ECHO as an original feedback-choice card: write the Exact learning question; check the Cheapest credible trace that already exists; name the Human or contextual gap the trace cannot explain; choose One light-touch method, adding a second only when the next decision genuinely needs both a pattern and its context. ECHO adds a stopping rule to method selection so a small experiment does not acquire a survey, diary, and dashboard by default. It is not a validated research design, causal method, measurement instrument, privacy review, or substitute for consent, required processes, formal evaluation, or qualified guidance.
Sources
- Step 4 – Gather Credible Evidence — Centers for Disease Control and Prevention. Question-aligned methods and sources; quantitative and qualitative trade-offs; mixed methods; existing data; practical, ethical, validity, reliability, resource, and scope considerations.
- CDC Program Evaluation Framework, 2024 — Centers for Disease Control and Prevention. Need-to-know data; burden and quality trade-offs; privacy and confidentiality; permissions; context; data-plan adaptation; multiple methods and sources.
- Test and Learn — HM Treasury and Evaluation Task Force. Feedback loops; qualitative and quantitative methods; observation, interviews, surveys, and data analysis; proportionality; iterative rather than definitive early findings.
- Magenta Book: Central Government guidance on evaluation — HM Treasury and Evaluation Task Force. Proportionate and fit-for-purpose evaluation; question-led data requirements; existing versus new data; reduced cost and burden; limits of available records.
This is educational reflection, not medical or mental-health care. If distress is persistent, severe, or involves immediate safety, contact a qualified professional or local emergency service.