Features of ConductExperience
The features researchers use, in groups, from building a study to the data you download. Each feature links to the page that says more.
Build a study from questionnaires, cognitive tests, images and video. Run it in the lab, by link, on tablets or on people's phones, and download one export.
Build a study
- Parts and sections
- Build a study from parts: questionnaires, cognitive tests, images and video, instructions and breaks, in sections you order.
- Templates
- Start from one of 11 templates. Try the ones that need nothing added as a participant first.
- Start from a file
- Start a study from a Qualtrics survey file (.qsf) or a REDCap data dictionary.
- The example study
- Open an example study of 48 made-up people, with its Results page and a real download, before you build your own.
- Groups
- Assign people to groups: Balanced, Random or Weighted, with a limit for each group.
- Order
- Put sections and parts in a fixed or counterbalanced order, or shuffle parts for each person. Counterbalancing uses balanced Latin squares. A section can also show each person some of its parts, drawn at random and not balanced across people.
- Rules on parts
- A part can run only when a rule holds (Run when), and the study can end after a part, as finished, when a rule holds (End the study after this part when). A rule reads the questionnaire parts every person sees before the part, values from the link and the person's group, and End the study after this part when can read the part itself too. In a study with later visits or check-ins, the session ends there instead, and they go on as planned.
- Check
- Check names each problem in a plain sentence before you publish.
- Preview as a participant
- Preview a draft as a participant sees it.
- Versions
- Publishing writes a numbered version that never changes. The data names the version each person ran.
- Duplicate study
- Duplicate study makes a new draft from a study you made. On a completed study it is called Run it again as a new study.
- Pilot it yourself
- Pilot a draft yourself from a link or a QR code. Pilot answers show on Results, marked as a pilot.
Questionnaires
- Question types
- 18 question types, each in check-ins too except Click on a picture.
- Rules
- Show a question only when earlier answers call for it, and end a questionnaire early by a rule.
- Piped text
- Put an earlier answer to a choice, rating, slider, line scale, number, short text, date or time question into a later question's words.
- Random order
- Show a screen's questions, or a choice question's options, in a random order for each person. The answers table records the order of a screen's questions.
- Repeat for each
- A new screen can repeat once for each option a person chose in an earlier multiple choice, up to 20 times, and a placeholder such as {{fruits|it}} shows that option, as in "How often do you eat Apple?" Each repeat is its own screen with its own answer, and an option that goes alone, such as None of these, never repeats. A screen can also repeat once for each row of a list from the Lists section.
- N of these at random
- N of these at random shows each person some of a new screen and the screens after it, as many as you choose, in a random order, drawn once and kept after a progress save.
- Options offered
- A single choice, a multiple choice or a grid can offer only the options chosen, or not chosen, in an earlier multiple choice: Options offered, or Rows offered for a grid. Its other options, such as None of these, always show, and a question left with none of the options it carries is not shown.
- Lists
- A list holds rows you enter, such as products to rate, each with a text for each field. A new screen can repeat once for each row (Repeat for each), in order, or for a number of rows drawn at random for each person (Each person sees), in a random order and kept after a progress save, up to 20 times. On it, placeholders show that row's texts: with the fields juice and maker, "How do you rate {{juice|it}} by {{maker|its maker}}?" reads "How do you rate Plum by Vale?"
- Scores and bands
- Scores add up or average answers, turn a question upside down to reverse it, and name the band each score falls in. Only researchers see them.
- Attention checks
- Make a single choice, multiple choice, rating or grid row a check, with the answer a careful person gives, or add a ready-made check: an instructed answer or a fact anyone knows. The download counts the checks each person missed, and a person never sees which answer is expected. Not in check-ins. In a study with later visits, sessions.csv has the count for each session.
- Answer checks
- A short text question can ask for an email address, or for an answer in a set form, such as a code of P and three digits. A multiple choice can ask for a least and a most number of choices, with options that go alone, such as None of these. A failed check shows its message under the question when the person tries to go on. The editor sets a multiple choice's least and most choices; it has no control for the other checks, and keeps the ones a file brings.
- Page timers
- A screen can wait a number of seconds, up to 600, on the session clock before it shows Continue (Submit answers on the last screen), or move on by itself after them with no Continue. Each showing of a screen starts its timer again. The editor has no control to set a timer, and keeps the ones a file brings.
- Bipolar rows
- A grid can label both ends of each row, for a semantic differential scale: a row reads from its label to its end label, such as Cold to Warm. On a phone each row stacks, its label above the answers and its end label under the last one.
- Recommend, 0 to 10
- Recommend, 0 to 10 is a ready-made question in the Question type list: one rating of 11 points, numbered 0 to 10, from "Not at all likely" to "Extremely likely" in an English questionnaire. Results shows how many chose each point, as for any rating.
- Values from the link
- A questionnaire can take values from the link a person opens: ?arm=b gives arm the value b. Rules and placeholders read a value as they read an answer, and the download has a column for each. Up to 10 are kept for each person when they start.
- Worked-out values
- A worked-out value comes from a formula with + - × ÷, min, max, round and if, such as if(arm = "b", q1 × 2, q1). Its sums use answers that are numbers and number values listed before it, and it reads a value from the link or the group only in an if's condition, like arm here. Rules, placeholders and the download read it as they read a value from the link.
- Value from the group
- A value can hold the name of the person's group, which rules and placeholders read, with a column in the download. It comes with a file: a Qualtrics randomizer that sets a field, or a questionnaire file (.json). The editor shows it and has no button to add one.
- Value from the round before
- In a study with rounds, a value from the round before holds a figure of a statement's ratings in the round before. It can be this person's rating, the median, the lower or upper quartile, or the percent in a band, such as 7 to 9. Medians and quartiles use R's default method (type 7), which is Excel's QUARTILE.INC. Placeholders show the figures, a percent as a whole number, and rules read them, so a statement at consensus can drop out.
- Published scales
- PHQ-8, GAD-7, SUS, 50-item IPIP Big-Five Factor Markers, TIPI, SWLS, PHQ-2, GAD-2, PHQ-4, PHQ-15 and GDS-15, in their holders' wording and scored as published.
- Tasting questions
- Nine-point liking, just-about-right and check-all-that-apply questions, ready to add.
- Languages
- Participant screens in English, Spanish, French, German, Italian, Japanese, Chinese (Simplified) and Portuguese (Brazil), and questionnaires that read right to left.
- Progress saves
- A person who leaves a link study keeps what they finished. In the same browser, a questionnaire continues at its page, with the earlier answers kept.
- Keyboard and picture descriptions
- Every question can be answered with a keyboard, and pictures carry descriptions for screen readers.
The question types
- Single choice
- One answer from options you write.
- Multiple choice
- Several answers from options you write.
- Image choice
- Options that are pictures from the study's own images, each with a description for screen readers.
- Preference test
- An image choice of 2 or 3 pictures side by side, stacked on a phone, shuffled for each person unless you turn off Shuffle options. The download keeps the side of the one chosen.
- Click on a picture
- 1 to 5 clicks on one of the study's pictures, each saved with its place and the area it hit. You draw the areas, and a person who cannot click chooses one from a list. Not in check-ins.
- Grid
- Rows that share one set of answers, one answer per row, up to 300 rows.
- Ranking
- People put the options in order. Each option's place is a column.
- Constant sum
- Amounts that must add up to a total you set, such as 100 points.
- Rating scale
- A rating of 3 to 11 points with a label at each end. For a label on every point, use a grid or a single choice.
- Slider
- A slider between ends and a step you set.
- Line scale
- A line from 0 to 100 that people mark anywhere: the visual analog scale.
- Number
- A number, whole or with decimals, with a least and a most and a unit.
- Yes or no
- A yes or no answer.
- Short text
- Up to 200 characters.
- Long text
- Up to 2,000 characters.
- Date
- A date.
- Time
- A time.
- File
- Photos and PDF files, 1 to 5 of them, up to 10 MB each. Photos are saved without their location.
Pages on the question types:
Files in and out
- Qualtrics files
- Open a Qualtrics survey file (.qsf) and read a report of what came over, what changed and what did not, before anything is added.
- REDCap data dictionaries
- Bring instruments in from a REDCap data dictionary.
- Files for REDCap
- A data dictionary and records for your own REDCap project. Nothing is sent to REDCap.
- The download
- One zip of tables, with a data dictionary entry for every column.
- SPSS, R and Python
- Every download has SPSS syntax and readers for R and Python.
- The ConductExperience API
- Read-only: a key lets a script read your studies, participants, sessions and the download's tables.
Recruit and run
- Links
- Each link has its own limit on people and its own open and close times.
- Share
- Share asks where your participants come from. Your own list or class gets a link in one step.
- QR codes
- Every link has a QR code to show on a screen.
- Panels
- Prolific, Sona Systems and CloudResearch Connect: set-up steps for each, and a completion code after a finished study.
- Screeners
- The study's first questionnaire can be its screener: choose Use as a screener, and write the rule as Turn away when, in the same editor as the other rules. A person who does not fit reads one sentence you can edit. A panel participant goes back to the panel's screen-out address.
- Quotas
- A quota sets a target for each answer of one required question with fixed answers, across all the study's links. When an answer's quota is full, people who give it are turned away: they read one sentence, and a panel participant goes back to the quota-full address. The Links page shows each answer's Finished, In progress and Target, and the Participants page marks who was turned away.
- Sign-up check
- A built-in check stops automated sign-ups, with no outside service.
- A class at once
- A class of up to 100 can start at once on a new link.
- Finished IDs
- On a link from a panel, Copy finished IDs copies the panel IDs of everyone who finished, separated by commas, so you can approve them on the panel.
- In the lab
- One computer, one participant after another. Start each person and hand the computer over.
- Booths
- Staff sign in with a PIN, set out the coded samples and hand over the tablet.
- Sample codes and serving orders
- Foods or drinks under three-digit codes, with a balanced serving order for each person.
- Visits
- Later sessions inside windows you set. Each person gets a private return link with their dates and a calendar file.
- Rounds
- In a study whose questionnaire has a value from the round before, each visit is a round. You close each round on the Participants page: the close freezes the panel's figures, opens the next round for everyone, if there is one, and shows the comments you tick in it, without names. The Delphi panel template starts one.
Daily life
- Check-ins
- Check-ins on the person's own phone, at fixed or random times or when something happens: ecological momentary assessment (EMA).
- Reminders
- A reminder for each check-in, in the person's own time zone.
- Home Screen and Today
- People add the study to their phone's Home Screen and find today's check-ins in one place.
- No network
- An answer given with no network is kept and sent later.
- Photos and files in check-ins
- Check-ins can ask for a photo or a file and offer picture choices.
- Daily life page
- Expected, completed and adherence for every person, with a mark for every check-in.
Lab measures
- Cognitive tests
- The Implicit Association Test, Stroop, go/no-go and decoy choice tasks, scored with ConductCognition's code.
- Images and video
- Show images and video, and mark moments with keys you choose.
- Face and gaze
- Facial expression, blinks, head movement and gaze from the webcam, measured in the browser. Video never leaves the computer.
- Session quality
- Each session ends with a quality check of the face and gaze recording and of key and image timing. The Participants table marks each person Good or Check.
- One clock
- Every answer, trial and video frame in a session is stamped in milliseconds from its start.
Results and data quality
- Results
- Each question's counts, means and charts, written answers, scores with their bands, and test scores by group, filtered by version, group, status and start dates. Excluded people are left out unless you include them, and one line gives the counts for the paper: started, finished, excluded by reason and analyzed.
- Round report
- In a study with rounds, the Participants page gives a round report for the paper, as ACCORD, the reporting guideline for consensus methods, asks. It gives the rounds planned and the stopping rule. For each closed round, it gives the invited, answered and response, each statement's figures and how many rated it, the rules that decide consensus and what the next round asks.
- Flags on each response
- A response is marked when its finish was very fast beside the study's others, and, from a link or a booth, when text was pasted into an answer or the page was left. The download also marks who missed an attention check or gave the same answer throughout, and Results counts them. Nothing is removed, and you decide what to do.
- Same answer throughout
- The download counts each place a person gave one answer: in every row of a grid of 5 rows or more, or in 10 rating questions or more in a row. You can change both numbers on the study's page, and a change counts everyone again, the people already in too. Check-ins are not counted. In a study with later visits, sessions.csv has the count for each session.
- Exclude with a reason
- Exclude a person who finished from the analysis, with one of their flags or a reason of your own. Nothing is deleted: the download marks who was excluded and why, and Include again undoes it.
- Time on each page
- The download's pages.csv has a row for each time a person was on a questionnaire page in a session, with how long the page was shown and how many times they gave or changed an answer. A person who left before the end has no row for the page they left on.
- New since your last visit
- The list of your studies shows how many people finished since your last visit in this browser.
- Finish
- A completed study's page leads with Download the data and See results, and shows the study in figures: the people who finished, the people who ended early, the versions and the days from the first session to the last.
Team and account
- Roles
- Owner, editor and viewer roles on each study's team.
- Activity
- Activity shows who on the team changed what and in which version, and who excluded or included a person.
- Emails when people finish
- An email when a study's first participant finishes, one a day while people finish, and one when a link reaches its target. Email me when people finish, on Account, switches them off.
- Plans
- A Free plan for pilots, student projects and teaching. Researcher is $199 a year and Lab is $799 a year, paid by card.
- A citation
- A citation for your methods section.
Data handling
- Where data is kept
- Study data is kept in Microsoft Azure in the United States, in the account of the researcher who made the study.
- Video stays on the computer
- Video never leaves the computer that runs a session. Only the face and gaze measures are saved.
- Codes, not names
- A person is a study code such as P001. A panel's ID is kept apart from the study data.
- Consent
- The study opens with your consent text, and Check warns when it names no contact.
- Deleting
- A study or session you delete is kept for 7 days in case of a mistake, then removed. Deleting a study removes its people's check-in data too. Backup copies of deleted data are removed within 30 days.
Free tools on the site
- Balanced Latin square generator
- Balanced orders for 2 to 12 conditions, from the code the builder counterbalances with.
- Random three-digit numbers
- Random numbers from 100 to 999, none twice, leaving out the numbers that stand out to a taster for blind sample codes.
- Random assignment generator
- Assign as many as 1,000 people to 2 to 12 groups, balanced or simple random, and download the list as a CSV.
- Sample size calculator
- The people a study needs, or the power of a number of people, for a t-test between two groups, the same people twice or one group, as R's pwr.t.test works them out.
- Effect size calculator
- Cohen's d and Hedges' g with their confidence intervals, from two groups' means, SDs and numbers of people.
- Readability test
- Flesch Reading Ease, the Flesch-Kincaid grade, the SMOG grade and the Gunning fog index of a text you paste, worked out in the browser.
- SUS calculator
- Score System Usability Scale answers as Brooke published them.
- Try a study
- A short study anyone can take, with no account.
Related
Study builder
The parts, groups, orders and versions of a study.
Survey software
The question types, rules, scores and languages of the questionnaire editor.
Templates
Studies to start from, and an example study to open first.
Pricing
Free for pilots and teaching. No charge for each question or answer.
Planning a study?
Start one now, or tell us what you want to measure.