A. Setup of CAPP Test Administrator (CTA) The following steps need to be performed before any testing can take place: 1 Install the CAPP Test Administrator Software (CAPP_TA or CTA). (Follow directions outlined in Install.doc) If testing is to be completed on workstations connected to a file server, then the software should be installed in a folder on the server (Default: X:\CAPPTA, where X is any available drive mapped on the server). The installation should be performed from the workstation that will be the test administrator's workstation. If testing is to be performed from a single stand-alone computer, then the software can be installed on any hard drive on that computer (e.g. Drive C:). Two icons will appear on the desktop. The CAPP_TA icon will open the test administration program used to set up and maintain the testing software environment, lookup and report on student test/placement results, and prepare data files for exporting to other reporting software. The CTA icon will open the program that actually delivers the computerized tests. 2 Double click the program icons to start. The default user name is 'CAPP' and password is 'CAPP'. These defaults can be changed using the 'Login' menu option under 'Customize' in CAPP_TA. (See 'Login' in CAPP_TA help file). 3 Begin by setting a testing period for storing all
testing data. Click on the ' On the bottom of the 'Testing Period' screen, select the
newly added testing 4 Click on the 'Settings' menu option under 'Customize' to enter some required system specifications. On the 'Institution' page, fill in the name and address information for the institution to be administrating tests. On the 'Server' page, leave the 'Local Server' option checked. On the 'General' page, check 'Use ASAP Setup' only if the CAPP Test Administrator will be used with reporting with the 'ASAP' program from CAPP Associates. Check 'Display CPT Options' only if using the CAPP Test Administrator with Accuplacer software, either network or online versions. On the 'CTA Options' page, check any of the desire options for CTA, the program that delivers the computerized tests. By checking the appropriate setting, you may have any of the these functions in CTA: i) Remove Paper-Pencil Test References in Tutorials (Default - Off), ii) Require Test Administrator Keystroke to Proceed (Default - Off), iii) Ask Confirmation for test choice when a choice of tests is offered (Default - On), and iv) Include Open Session on CTA menu (Default - On). You may also change the Administrative Exit Password (Default - 'Admin'). The Administrative Keystroke is 'Ctrl !' (Left-Ctrl, Right-Shift '1') and is used whenever the test administrator needs to exit the program and/or take some action such as terminate a session or proceed after the testing is interrupted. On the 'Test Code' page, you may change the CAPP three-byte internal code for each test. For ASAP users, these test codes need to be entered to match the corresponding codes in the ASAP program. For non-ASAP users, these test codes are automatically set to appropriate default values; no changes need to be made. (See 'Settings' in the CAPP_TA help file for details on the setting options). The remaining steps do not need to be performed before testing can take place, but are available options for configuring the software to meet specific needs of the institution's testing program. 5 Click on the 'Testing Options' menu option under 'Customize' to add or modify any testing options. Testing Options specify the characteristics of a given test (for example, type and color of item selection) and testing session (for example, ask for the test takers address and/or ask a set of questions about educational background and/or college plans and which reports (score report, assessment and placement letter, counseling report and/or diagnostic letter) should be display and/or printed upon completion of the test). Options are stored in files with a .COP extension (Capp Options). A number of default testing options are installed initially with the program that provide a set of commonly used testing options. Additional options to suit the testing needs of the institution can be selected. (See 'Testing Options' in the CAPP_TA help file for details). 6 Click on the 'Branching Profiles' menu option under 'Customize' to add or modify branching profiles. Branching Profiles specify which tests are delivered and in what order. A Branching Profile is selected for each test taker at the beginning of each test session. Branching Profiles are stored in files with .CPR (Capp Profile). Many default branching profiles are installed initially with the program that provide most of the commonly used testing combinations. Additional branching profiles can be created to fit the test needs of the institution. (See 'Branching Profiles' in the CAPP_TA help file for details). 7 Click on the 'Questionnaire' menu option under
'Customize' to make any changes to the 'CAPP' questionnaire and/or add
additional background questions to the testing. The use of the questionnaire
is optional, specified in the testing options. Questions can be asked
before tests are delivered and question responses can be used in reporting
and/or multiple-measure placement. Individual CAPP questionnaire items
can be set to not be asked and up to 15 additional questions can be asked
that are locally defined. 8 Click on the 'Placement' menu option under 'Customize' to add or modify placement sequences and courses. This menu option is only available to institutions not using ASAP software (ASAP software performs its own placement). You can add up the 4 sequences of courses in each of the subject areas English, Reading, Math and Language (ESL). A sequence can have up to 100 levels with message associates with each specifying which course or courses a student is recommended to take. Placement statements can be one or two lines; although a placement message in paragraph form can be used for the Score Report that can be display on the screen and/or printed after completion of the test). Placement Criteria for each level need to be entered. Criteria can be as simple as a single cut-off on a single test or more complicated using cutoffs on linear combinations of test scores, subscores, questionnaire responses, essay results, etc.. Options are available for checking the logic and generated SQL for the placement criteria. If valid placement criteria are entered, then placement levels for the highest met placement criteria in a given placement sequence are produced for each test taker. These placement results are available for online reporting and data export to other software. (See 'Placement' in the CAPP_TA help file for details on setting up and using placement.) 9 Click on the 'Custom Messages' menu option under 'Customize' to add or modify messages that can be presented to test takers before and after the testing session, the questionnaire, and/or any test. The messages can be entered in rich text format to virtually any length. Messages more than a screen need to be scrolled. Bitmap images can also be added if desired. (See 'Custom Messages' in the CAPP_TA help file for details about entering and editing custom messages). 10 Click on the 'Additional Screens' menu option under 'Customize' to select any of a number of additional screens that can be presented to test takers during testing. These options screens include: I) Show Name /ID/BWD Verification Screen (Default - On) which displays a screen to the test taker after they log-in asking for verification of correctly entered information and an option to correct entries. II) Show ID Screen with options to have numeric or alpha field entry (seven characters maximum) for an optional student id number (which would be in addition to the required SSN or student id number (nine characters maximum). III) Show a disclosure screen that can be a rich text message to test takers informing them testing procedures and asking for consent to release test information. IV) Show Retest Interrupt Screen which, if selected, will have the CTA program present a screen to a test taker who has already taken the same test at some earlier time. The screen asks the test taker to contact the test administrator who can, after doing an administrative exit, review the tests previously completed and decide whether to proceed with testing or terminate the testing session. Use of this option would depend upon institution's policies about retesting. The program can be set to search the current plus any number of previous testing periods for retest identification. V) Show Duplicate Name Interrupt Screen which, if selected, will have the CTA program present a screen to a test taker who enters the same name, but different id, as someone else in the system. The screen asks the test taker to contact the test administrator who can, after doing an administrative exit, review the entries to decide if the person is the same or different, which id to use and/or terminate the testing session. VI) (See 'Additional Screens' in the CAPP_TA help file for details.) 11 Click on the 'Response File' menu option under
'Customize' to specify how an optional response file can be automatically
created either immediately after testing is completed and/or by the test
administrator at some later time. The response file is a text file that
can include either a standard set of fields (name, id, test code, test
scores, and item responses) or a selected set of fields, including address,
questionnaire, test and placement information, customizable for an institutions
special needs. The file format can be either fixed, comma delimited or
pipe delimited, and depending upon the format selected, can be imported
into other software packages, including but limited to Excel, dBase and
Access. An option is available to have the response file in the specified
format be created immediately after a take taker completes his/her test.
The file is created in a specified director (Defaults to \response, a
subdirectory off the program directory) with a unique file name keyed
to the student's unique id number. An institutionally written user exit
program can be called and run to intercept this file after the completion
of each testing session. A path to the created response file is passed
to this user exit program to make for easy real-time interception of the
response file. (See ' 12 Click on the 'Report Setup' menu option under 'Customize' to specify how the Score Report or the MDTP Diagnostic Letter will appear. Options are avail to display/print the header, the amount of information in a test/score record, placement, additional text, etc. (See 'Report Setup' in the CAPP_TA help file for details on configuring the options for the reports.)
B. Using CTA to deliver tests. 1 To administer a test, open the CTA program by double clicking on the CTA icon. This icon will be on the desktop of the computer/workstation used to install CAPP_TA. For other workstations in the network that are to be used for testing, the workstation can be mapped to the drive containing CAPP_TA and a shortcut can be added to the desktop pointing the CTA.EXE. 2 Enter the user name CAPP and password CAPP to obtain the main menu of CTA. 3 Select 'Start Testing' or press Ctrl-T or click on the 'Pencil' button to open a 'Start Testing' Screen. Select an appropriate Testing Option and Branching File to be used for the testing session of the current test taker. You may also choose to have the program stop between examinees or proceed to the login screen for subsequent test takers when testing is completed. CTA remembers at each workstation the selections from previous Testing Startups. Click on OK to begin. 4 The login screen for the test taker appears. This is the first screen the test taker should see and begin working with. The test taker will enter his/her name, id and birth date, and all mandatory fields. After the information is entered, a verification screen will appear with the option to correct or reenter any misinformation. After this screen the program will branch to the information gather screens (address, questionnaire) if these are specified in the selected testing options. Next, the program will either present the first test in the testing option or give the test taker a menu of available tests to select from. The test taker will then complete the tests, each beginning with an appropriate tutorial, as specified in the branching profile. Upon completion of the last test in the branching profile, one or more reports (if set in the testing options) will appear on the screen (with options to print) showing test results, course placements, and skill area diagnostics. Custom messages may appear before and between testing components a determined by the institution. 5 If there are any interruptions to the testing, a screen will appear that asks the test taker to contact the test administrator. The test administrator can then perform a password protected administrative exit (Ctrl-!) to determine the cause of the interruption and proceed accordingly. The Test Administrator can perform a user exit for the test taker at any time. If the session is terminated as an open session, the exact position in the testing process is saved. If an open session exists for a given test taker, then if and when the test taker logs in again with the same id, the program will place the take taker at the exact same place in the same test at the time the open session was created. Even the correct remaining amount of time to complete the test is made available for the test taker for the returned-to test. The Test Administrator can view a listing of all open sessions stored in the system either from a menu option in CTA (if option has not been disabled) or from CAPP_TA. Details of both active sessions and stored open sessions can also be viewed from the 'Open Session' screen. Stored Open Sessions can also be deleted from this screen. 6 After testing and report is completed, a screen will appear depending upon options selected, informing the test taker the testing is completed and to quietly exit the room (or a screen ready for the login of the next test taker). Messages on these screens can be customized by the institution. 7 All data gathered from the students and corrected test scores are saved on the server (or standalone) computer for further reporting and export. C. Maintaining Data in CAPP Test Administrator. 1 Click on 'Open Sessions' under the 'Maintain' menu to view a list of all open sessions. An open session is created as soon as the test taker completes the login. All questionnaire and test results are stored in the CAPP_TA database as they are completed. Prior to completion, the results are saved in an open session. The 'Open Sessions' screen shows which Open Sessions are currently active (test takers are currently working on a test). The 'Review' button on the screen will show a screen indicating the questionnaire or test item the highlighted test taker has last responded to as well as the amount of time remaining since the last response (if the test is a timed test). After the testing is completed, the open session is closed and will no longer appear on the 'Open Sessions' screen. However, if the test administrator terminates a testing session with an administrator exit (Ctrl-!) before testing is completed (because of student illness, insufficient time to complete, etc.), the open session is saved and is labeled inactive. This inactive open session can be reviewed to see exactly where testing was suspended and can be deleted. Or, if the taker logins in with the same id at some future time, the open session can be reactivated. If the open session is reactivated, the CAPP_TA program will take the test taker to the exact same item in the questionnaire or test where they were when the testing was suspended, with an appropriate amount of time remaining if the test was a timed test. (See 'Open Sessions' in CAPP_TA Help for more information about Open Sessions). 2 Click on 'Count Records' under the 'Maintain' menu (or press 'Ctrl-F4') to get a count of all the record types stored in the current testing period. Records type include name records, address records, questionnaire records, assessment records (one for each test taken) and score records (CPT scores, essay scores, etc.). (See 'Count Records' in CAPP_TA Help for details on counting database records). 3 Click on 'Reindex' under the 'Maintain' menu if the database files need reindexing because of data corruption problems. They is a recovery routine that should not need to be run unless there are database problems. Reindexing should not be done when any workstation is logged in the system. (See 'Reindexing' in CAPP_TA Help for details on reindexing the CAPP_TA database). 4 Click on 'Purge Database' under the 'Maintain' menu to remove any data from the database. All records in a testing period can be purged. All records can be purged for selected dates or by actually tagging selected student records. (See 'Purge Database' in CAPP_TA Help for details on purging data). D. Reporting in CAPP Test Administrator. 1 Several types of online and printed reports can be produced for a given test taker immediately after testing is completed. Which reports are produced depends up settings in the selected Testing Options file. Reporting using the CAPP Test Administrator is primarily designed to allow for the same printed reports to be regenerated at any later time from stored data. The following printed reports are available for test results: I) Score report. This basic report shows name, id, test results and course placements. It is most commonly shown to the test taker on the screen upon completion of the testing session. This letter can be customized with special text messages using the 'Report Setup' option on the 'Customize' menu. II) Counseling report. This report can give a complete profile of the take takers educational background and college plans as well as test results and course placements. It can only be useful if the questionnaire information is gathered. III) Assessment and Placement Letter. This report uses a letter format to present test results and course placements. IV) Diagnostic Letter. This report, in a letter format, provides specific feedback regarding strengths and weaknesses in skill areas measured by the test. This letter can be customized with special text messages using the 'Report Setup' option on the 'Customize' menu. (See 'Reports' in the CAPP_TA help for further descriptions and examples of the various reporting options). 2 Click on 'Create Response File' on the 'File' menu (or click on the lightning bolt speed button) to display options for creating a response file. A response file report is a text file containing student information and test and/or placement results. The precise data fields included can be specified using the 'Response File' option on the 'Customize' menu. The response file can be created in two ways: I) A response file can be created for a single student by highlighting the student's id and corresponding test records shown on the 'Single Record Selection' folder (default). Double click the student's name or click on 'Create Response File' to create the file. A record for each (highlighted) test taken will be added to the file. The file's name is unique (the student's id in hexadecimal) with a .RSP extension. It is saved in a folder as specified in the response file setup. There is an option to view the file contents and/or run a user exit program after each file is created. II) A response file can be created for a group of student records selected by a date. After entering the date range and a file name (with default extension .RSP) and path, click on 'Create Response File" to create the file. The resulting file will contain records for all test taken within the data range, although there is an option to include records for all tests taken by students who took at least one test within the selected date range. There is an option to view the file contents and/or run a user exit program after the file is created. (See 'Create Response File' in the CAPP_TA help for further descriptions and examples of the various response file options).
|