|
|
Designing Multiple Choice Questions with Test Pilot
Each Test Pilot question type has a number of configurable options. Clicking on the Response Handling tab near the top of the database window bring up the first set of these options. If you wish to return to editing the question's text or associated media, click on the Text and Style tab.


- Pop-Up Menu vs. Radio Buttons - this controls how the possible responses to the question will be presented to the user by Test Pilot's web server extension. Consider the example to the right; the question is presented using radio buttons and includes the optional Other fill in the blank choice.
- include "Other" fill out box... - checking this option causes an Other choice to be added to the standard choices. This is typically used on surveys. Please note that Other may not be designated as a correct answer to any question. The example above shows the presentation of an Other choice.
choice - this is the text of the choice you wish to display for the user. Note that Test Pilot can also use media (e.g. pictures) as choices. Simply entering the media filename or URL into the choice boxes will cause Test Pilot to generate the appropriate web page including your media. Remember that the media must be available on the Internet or accompany the file exported by the database to the web server.
default radio buttons - these allow you to designate a particular response to be preselected on the web page generated by Test Pilot's web server extension. Simply click on the button in from of the response you wish preselected or the button in front of none to specify that you wish no answer preselected. This is probably not a good option to use on surveys as it may skew your statistics.
feedback - Test Pilot can optionally return feedback based on the user's choice of response. You may enter your customized feedback for each choice in the space provided. Test Pilot will not issue this feedback unless you choose to Return Feedback to User in the Submission Handling section.
substitution - If you wish to embed the user's response selection in the custom feedback, enter %% into the feedback and their response will be substituted when Test Pilot issues the feedback. In the above example, if you entered "Her father was not %%." for the feedback for incorrect choices, the user would receive "Her father was not King Tut." if the user selected King Tut.
points - you may enter the number of points you wish to award a particular answer. Test Pilot considers any positive non-zero value as a correct answer to a question. You may leave the points fields empty or zero if, as in the case of survey questions, there is no correct answer to the question. When left empty or zero, Test Pilot will refrain from automatically scoring the question.
store - Test Pilot can record the user's responses in three ways: as choices, the actual text of the user's selection is stored; as numbers, a number representing the user's selection is stored (1,2,3,... , -1 for not applicable, -2 for unanswered); as letters, a letter representing the user's choice is stored (a,b,c,... , -1 for not applicable and -2 for unanswered)
custom sets - the database has the capacity to store up to four common sets of choices for multiple choice and check all that apply questions. They are provided as an editing convenience so you may use the same set of choices over and over again without requiring you to type them in every time. Use the setup button to go to the custom choices screen and enter your choice sets. Use the numbered buttons to have Test Pilot copy a particular choice set to the current question's list of choices.
help - as always, you can click on the help message to view a help screen tailored to this particular database screen and it options.
branching - if you have elected to present this assessment one question at a time, you may also enable branching which can present the next question based on the participant's response to the current question. For multiple choice questions, this is implemented as a choice-based decision. That is, if the participant makes a particular choice, one question is shown, while otherwise another question is shown. If any entry is left blank, the next logical question in the assessment is shown when the choice is made.
|