|
 |
 |
Test Pilot |  |
||||||||
|
Test Pilot Enterprise Manual |
||||||||||||
In addition to the common question definition controls, the options below offer specific control over check all question presentation and evaluation.
You may have any number of items. A space for entering a new item is always provided. Items are shown to the participant in a random order. The order in which the items are entered and shown while editing is considered to be the correct ranking order. To add an item, simply enter the data into the new item box and click the update button. To delete an item, check the item's delete checkbox and click the update button. Points are awarded for each correct ranking made by the user. Point awards must be positive integer numbers. You may optionally specify that no credit be awarded unless all items are correctly ranked by checking the no partial credit box.
You can enter custom feedback in the spaces provided to be shown in the event the question was graded as correct or incorrect.
If this assessment is being offered a question-at-a-time and you have enabled branching, additional popup menus are shown to permit defining to which question to branch upon the correctness of the participant's responses to the question. Questions must be completely unanswered - no ranking made - for the unanswered branch to be followed.
Following is an example of a ranking question as shown to the participant.
Random Variables One of Test Pilot's most powerful features is its ability to generate random numbers for use in questions. This permits the generation of unique questions each time a participant requests an assessment. In a computer laboratory environment, this means that each student could get a different test. This drastically reduces the efficacy of copying your neighbor's responses. What it has meant to Purdue University's Electrical Engineering Technology department was that students stopped asking each other What did you get for #...? and now they ask How did you get your answer? - a much more productive question and one geared productively towards learning. Test Pilot supports two categories of random variables: local and global. Global variables are shared by all questions on an assessment. That is, you may construct multiple questions referring to the same set of random data. Local variables are unique to a specific question and are not accessible for use in other questions. There is no limit on the number of global or local random variables that may be defined. Random variables may be defined as follows:
In this sample variable definition a single variable, r, has been defined. Variable names can only consist of alphabetic letters a-z and numbers 0-9. (e.g. x, xx, var2, aVeryLongVariable ) You can use any name that is not reserved by an operator or a predefined constant, as a variable name. You should avoid beginning a variable name with a number, like 3x or 1var. Care should be taken to avoid confusion between a number in scientific notation and a variable name. (e.g. use 2.0E+5 instead of 2E5) You may specify integer or decimal real numbers as start, end and increment values. You may also use scientific notation. Numeric variables are assigned a starting value, and ending value and an increment value. Note the sample list at the end of each row. These are example of calculated values for each of these variables and are typical of the assignments that will be made at assessment time for the participant. Please note that the assignment of these values occurs at assessment time. None of our competitors offer this powerful capability. Pooled random variables In addition to calculated random variables such as shown above, Test Pilot includes the capability to define a pool of numbers or strings to be used to select from. If you enter a series of numbers, words or phrases separated by commas in the start field of a random variable definition, you create a pooled random variable.
In this example random variable definition a pooled random variable named primes is defined to be the set of the first eight non-negative prime numbers. Purdue's EET Department uses pooled random variables to define a set of resistance values common to electronic circuit construction. This lends an aura of realism for their use in Test Pilot for circuit design problems. Pooled variables can also be strings that can be used within question text to make things interesting.
In this example there is a variable called names that can be used to randomly choose a name in a problem. For example, were the text of the question:
a different value for [names] would be generated by Test Pilot every time a participant entered the assessment. Help is Available! Please note that, at any time while you are editing an assessment, you can click upon the titles of the fields listed for your entries. If you do so, a pop-up window with an explanation of the items use and features will be shown. Saving your Changes - Don't Forget to Update It should be noted that on the editing panels, you will see one or more Update buttons. Whenever you adjust a setting or make changes to any item, you must click an update button to record the changes. You may make multiple changes and then click Update, but if you fail to click the update button, your changes may not be recorded. The mode popup menu allows you to adjust access to Test Pilot features and trim the detail of the automatically provided assistance for authoring.
|
|
||||||||||||||||||
|
|||||||||||||||||||
|
|||||||||||||||||||
|
|||||||||||||||||||
