Survey Design and Analysis

Design a survey that measures what you meant, with unbiased question wording, a sample plan, and an analysis plan fixed before data arrives.

Design a survey for me.

The decision this survey should inform: [WHAT WE WILL DO DIFFERENTLY DEPENDING ON THE ANSWER]
What I currently believe: [THE HYPOTHESIS]
Who I will survey and how I will reach them: [POPULATION + CHANNEL]
Roughly how many responses I can expect: [NUMBER]
Length limit: [MINUTES OR QUESTIONS]

Produce:

1. **The measurement question.** Restate what actually needs measuring to inform the decision. If the stated decision cannot be informed by a survey, say so now and name the method that could, such as observing behavior or running a test. Surveys measure what people say, which is a different thing from what they do.

2. **The questionnaire**, 8-15 questions:
   - Each question with its response scale and why that scale
   - Screening questions first, sensitive questions last
   - Behavior questions before attitude questions, so stated attitudes do not contaminate reported behavior
   - No double-barreled questions, no leading wording, no undefined terms like "regularly" or "affordable"
   - At least one open-ended question that will produce a usable quote
   For each question, note in one line what the answer will tell me and which analysis it feeds.

3. **Bias audit** of your own draft: for each question, the most likely bias (social desirability, acquiescence, recall error, order effects) and the wording choice that reduces it. Flag any question that cannot be de-biased and should be dropped.

4. **Sample plan.** Who is included and excluded, what response rate would make the result trustworthy, and who will be systematically missing from the responses no matter what. State plainly what my expected response count can and cannot detect.

5. **Analysis plan, written before any data exists.** Which questions are cross-tabulated against which, what result would confirm my hypothesis, what result would refute it, and what result would be too small to act on. Committing to this now is what prevents finding a story in the noise afterward.

6. **The pilot.** Five people to test it on and the three questions to ask them about the survey itself.

Rules: keep it as short as the decision allows. If a question does not feed a named analysis, cut it and say you cut it.

How to use

Writing the analysis plan before the data exists is the single practice that separates a survey from a search for confirmation. Once responses are in, every cross-tab looks meaningful and one of them will support whatever you already believed. Section 1 is the other thing that saves money: a surprising number of survey projects are really behavioral questions in disguise, and stated intent to pay is famously unrelated to paying.

Originated fromStan SedberryUpdated
Researchadvanced

More business prompts

Build me a monthly budget and a debt payoff plan from these numbers.

Take-home income per month: [AMOUNT, and note if it varies]
Fixed costs: [RENT/MORTGAGE, UTILITIES, INSURANCE, SUBSCRIPTIONS, TRANSPORT, CHILDCARE, with amounts]
Variable spending, last 3 months if known: [GROCERIES, DINING, SHOPPING, ETC.]
Debts: [FOR EACH: name, balan

Budget and Debt Payoff Plan

Turn your real income, bills, and debts into a monthly budget and a payoff schedule with the math shown and the tradeoffs named.

Businessbeginner
Build a 13-week cash flow forecast.

Cash on hand today: [AMOUNT, and which accounts]
Any restricted or committed cash: [AMOUNT AND WHAT IT IS FOR]

Expected inflows:
- Receivables outstanding: [CUSTOMER, AMOUNT, INVOICE DATE, TERMS, and how reliably each pays]
- Recurring revenue: [AMOUNT, BILLING DATE, CHURN ASSUMPTION]
- New sales expe

13-Week Cash Flow Forecast

Build the rolling weekly cash forecast operators actually run on: opening balance, timed inflows and outflows, and the week you run short.

Businessadvanced
Help me set pricing for [PRODUCT/SERVICE].

What it does and who buys it: [PRODUCT + BUYER]
The alternative if they do not buy: [COMPETITOR, IN-HOUSE, SPREADSHEET, DOING NOTHING]
What that alternative costs them: [MONEY, TIME, RISK. Estimate if needed and say so.]
Value we create, quantified if possible: [TIME SAVED, REVENUE GAINED, COST 

Pricing Strategy

Work out what to charge and how to package it: value basis, tier structure, the metric you meter on, and how to test before committing.

Businessadvanced

Search prompts

Find a prompt by title, description, tag, or category.