|
 |
 |
Test Pilot |  |
||||||||
|
Test Pilot Enterprise Manual |
||||||||||||
In addition to the common question definition controls, the options below offer specific control over multiple choice question presentation and evaluation.
You may have any number of choices. A space for entering a new choice is always provided. To add a choice, simply enter the data into the new choice box and click the update button. To delete a choice, check the choice's delete checkbox and click the update button.
You may enable the choices checkbox to add an additional response choice of not applicable. You may choose to have the choices presented in a popup menu or shown one after the other as radio buttons. Radio buttons allow all choices to be seen at once. Radio buttons may be presented horizontally or vertically. In combination with a section break to provide column headings, it is possible to form columns of responses to create tables of survey questions. The choices, by default, will be numbered and their text shown. You may optionally suppress the numbering or the printing of the choices' text. This can be handy when developing tables of survey questions with like responses. You can choose to have the participant's response reported as the actual choice, an ordinal letter (a, b, c) or an ordinal number (1, 2, 3). If you wish, you can add a follow-up question such as If important, why? or If never, why not?. Enter your custom tag line in the space provided. A small text box will be provided on the web page generated by Test Pilot. Since the participant's response to a followup question is unscored, the typical use of follow-up questions is on surveys. If this assessment is being offered a question-at-a-time and you have enabled branching based upon the participant's response, additional popup menus are shown to permit defining to which question to branch upon a response. It is generally recommended to first define all questions before setting up branching.
Statistical Analysis Response data from survey questions are automatically summarized as participants record their responses. From the administrative options area, you can always access the most current statistical report for your assessment. Consider the following survey question statistical summary:
A frequency analysis is shown along with summary statistics including minimum, maximum, median, mean (or average) and standard deviation. Random Variables One of Test Pilot's most powerful features is its ability to generate random numbers for use in questions. This permits the generation of unique questions each time a participant requests an assessment. In a computer laboratory environment, this means that each student could get a different test. This drastically reduces the efficacy of copying your neighbor's responses. What it has meant to Purdue University's Electrical Engineering Technology department was that students stopped asking each other What did you get for #...? and now they ask How did you get your answer? - a much more productive question and one geared productively towards learning. Test Pilot supports two categories of random variables: local and global. Global variables are shared by all questions on an assessment. That is, you may construct multiple questions referring to the same set of random data. Local variables are unique to a specific question and are not accessible for use in other questions. There is no limit on the number of global or local random variables that may be defined. Random variables may be defined as follows:
In this sample variable definition a single variable, r, has been defined. Variable names can only consist of alphabetic letters a-z and numbers 0-9. (e.g. x, xx, var2, aVeryLongVariable ) You can use any name that is not reserved by an operator or a predefined constant, as a variable name. You should avoid beginning a variable name with a number, like 3x or 1var. Care should be taken to avoid confusion between a number in scientific notation and a variable name. (e.g. use 2.0E+5 instead of 2E5) You may specify integer or decimal real numbers as start, end and increment values. You may also use scientific notation. Numeric variables are assigned a starting value, and ending value and an increment value. Note the sample list at the end of each row. These are example of calculated values for each of these variables and are typical of the assignments that will be made at assessment time for the participant. Please note that the assignment of these values occurs at assessment time. None of our competitors offer this powerful capability. Pooled random variables In addition to calculated random variables such as shown above, Test Pilot includes the capability to define a pool of numbers or strings to be used to select from. If you enter a series of numbers, words or phrases separated by commas in the start field of a random variable definition, you create a pooled random variable.
In this example random variable definition a pooled random variable named primes is defined to be the set of the first eight non-negative prime numbers. Purdue's EET Department uses pooled random variables to define a set of resistance values common to electronic circuit construction. This lends an aura of realism for their use in Test Pilot for circuit design problems. Pooled variables can also be strings that can be used within question text to make things interesting.
In this example there is a variable called names that can be used to randomly choose a name in a problem. For example, were the text of the question:
a different value for [names] would be generated by Test Pilot every time a participant entered the assessment. Help is Available! Please note that, at any time while you are editing an assessment, you can click upon the titles of the fields listed for your entries. If you do so, a pop-up window with an explanation of the items use and features will be shown. Saving your Changes - Don't Forget to Update It should be noted that on the editing panels, you will see one or more Update buttons. Whenever you adjust a setting or make changes to any item, you must click an update button to record the changes. You may make multiple changes and then click Update, but if you fail to click the update button, your changes may not be recorded. The mode popup menu allows you to adjust access to Test Pilot features and trim the detail of the automatically provided assistance for authoring.
|
|
||||||||||||||
|
|||||||||||||||
|
|||||||||||||||
|
|||||||||||||||
