Program Configuration

  • Updated

You can use programs to group tests that are delivered over multiple testing windows for reporting purposes. A test must be assigned to a program if you want to access the Performance Report. Programs are designed to work for a single academic year, not multiple years. 

In most cases Customer Support will configure programs after working with customers to determine their reporting requirements.

Important: After assigning a test to a program, performance objectives, windows, grade levels, and content areas cannot be changed. Make sure to plan and configure the program carefully before assigning tests. The checkboxes on the General Settings tab and the ISR Settings can be modified later, even when students are taking tests.

  1. Go to Test Management > Program Configuration and do one of the following:
    • Click the Create New button on the top right to set up a new program.
    • Click the Edit icon in the in the Actions column to modify an existing program.
    • Click the Clone icon in the in the Actions column to copy an existing program.
      Tip: You can search for a program by name in the search bar at the top of the page.
  2. After creating a program, tests can be assigned to it when creating a test from Test Management > Tests.

General Settings

The following settings are available on the General Settings tab:

  • Program Name – Enter a name for the program, such as Interim Assessments 2023. This name will be used when selecting a program in the Performance Report, so it should be easy to recognize.
  • Program Code – Not required. Not currently used or displayed on reports. 
  • ADAM Scored – Select this checkbox for tests delivered through the ADAM player. Leave this checkbox unchecked for tests delivered externally (such as through TestNav). A program cannot contain both ADAM and external tests.
  • Active – Select to make the program available when assigning a test to a program and in reporting. You can leave this unchecked until you are ready to use the program.
  • Class Reports – Select to allow users to access class-level reports in My Classes and Reporting for tests in the program.
  • Program Report – Select to compare results from different tests in the same program.
  • Toggle Reporting Category Results – Only available when the ADAM Scored checkbox is not selected. Use only for PRoPL. Enables the "Show reporting categories" checkbox on the Performance Comparison table. Selecting this checkbox on the report will show all external objectives that are not selected as a secondary objective.
  • Standards Reporting – Standard subscores will be calculated and standard reporting will be available to teachers and administrators. For ADAM-delivered test only.
  • Item Analysis Reporting – Item analysis reporting will be available to teachers and administrators. For ADAM-delivered test only.
    • Show item content, answers, and student responses
    • Show trait level reporting
  • Hide aligned items details – Select this checkbox to hide the "Show aligned items" checkbox on the Standard Performance tab of the Performance Report.
  • Show Student Their Results – Allows students to see their results in ADAM. For ADAM-delivered test only.
  • Show Student Item View – Allows students to see the test items in ADAM. For ADAM-delivered test only.
  • Available Testing Windows – Enter the testing windows used in the program. You will need to manually type each window name, and then press Enter. Click X to remove a window. You can add multiple windows. (Note that testing windows do not exist elsewhere in ADAM.)
  • Available Grades – Select the grade levels to use in the program. You can select multiple grades.
  • Available Content Areas – Select the content areas used in the program, such as Algebra or ELA (these are defined in System > Client Settings). You can add multiple content areas. Content areas are similar to subjects but more specific. For example, Math is a subject while Geometry is a content area.

Define Performance Objectives

On the right side of the screen, define the performance objectives, such as raw score, that will appear in reports. The available objectives will vary based on whether the Scored checkbox is selected. Raw Score and Percent Correct appear by default. You can add additional objectives from the Add Objective dropdown. You can rename objectives in the Objective Name field.

Important: The objective configuration is a template that can be changed at the test level. For example, if you define cut scores here, they can be changed on individual tests when assigning them to the program. 

  • Raw Score – Always available. Reports will show raw score if selected as a primary or secondary objective (see below).
  • Percent Correct – Always available. Reports will show percent correct if selected as a primary or secondary objective (see below).
  • Performance Level
    • Select the Input Variable, such as RAW_SCORE or PERCENT_CORRECT (or another input based on an objective you have created). This value will be used to determine the output score.
    • Enter the Label, Text description (such as "Above expectations"), and Cut Score. Select which of the performance levels are Proficient. You can also import a CSV file. Optionally, select new colors by clicking an existing color.
    • If performance level is used, it is usually the primary objective. Multiple performance levels can be defined.
      mceclip3.png
  • Lookup
    • Enter a database key in the Objective Key field, such as LOOKUP_Scale. This field cannot be blank.
    • Select the Input Variable: RAW_SCORE or PERCENT_CORRECT (or another input based on objectives you have created). This value will be used to determine the output score.
    • Enter the Cut Score and Output fields. You can also import a CSV file. The cut score starts at zero, so the lowest value you enter can be greater than zero, but you may use zero if you define a cut score for every raw score. Optionally, select the Use Color Picker checkbox to customize the colors of the score groups.
      mceclip2.png
  • Dynamic Metadata 
    • Enter a database key in the Objective Key field, such as DYNAMIC_METADATA. This field cannot be blank.
    • Select the Score Calculation: NUMBER or PERCENT.
    • Click the Select Metadata button to select an item bank.
  • External – Only available when the Scored checkbox is not selected (i.e., tests are delivered in TestNav).
    • The Objective Key must match the external passed data, for example SCALE_SCORE.
    • Select the Score Calculation: NUMBER or PERCENT.
    • Enter a default Range Designation (the low and high scaled scores or number of questions, with 0 in the Min field). The range for each test can be defined later when tests are added to the program.
  • Calculation – Currently disabled.

Select Performance Objectives

Select one Primary objective, and optionally select one or more Secondary and/or Minor objectives. The primary objective is the main focus and will be emphasized on the report. The secondary and minor objectives will also be visible but not as prominent. For example, the primary objective may be Performance Level and the secondary objective may be Raw Score or Percent Correct. The Performance Report will emphasize score groups (with colors) defined in the Performance Level objective, while the secondary objective provides the score used to determine the performance levels.

You can define objectives that feed data to the objectives shown on the reports but do not appear on the report.

Defining the report column order. Use the up/down arrows in the widget title bar to move objectives up or down. The order defined here determines the order of the columns on the report. You can modify the order after linking tests to the program.

Not Applicable checkbox. Select the Not Applicable checkbox for an objective that you want to hide on the Performance Report; for example, if you don't want to show a Lexile score for a math test.

ISR Settings

You can set up the Individual Student Results (ISR) Report on the ISR Settings tab. The ISR Report can be used for summative, interim, and benchmark tests. ISR settings can be modified at any time, even during test taking.

Administrators can access the ISR report from the Performance Report: drill down to the class level, and then select View ISR from the more menu. At the top of the report, select a student in the class. Teachers can access the ISR report from My Classes.

mceclip0.png

The following general settings are available:

  • Report Title – Enter a name for the report.
  • Report Logo – Optionally, select a logo by browsing or drag-and-drop. The following image file types are supported: JPG, PNG, and GIF.
  • Show ID – Show the student ID on the report.
  • Show Date of Birth – Show the student's date of birth on the report.
  • Show Grade Level – Show the student's grade level on the report.
  • Show School Name – Show the student's school name on the report.
  • Show District Name – Show the student's district on the report.

Report Sections & Widgets

After defining the general settings, you can select and configure each section you want to include on the individual student report. Each section can contain multiple widgets with specified performance objectives. Report widgets will not appear on the ISR when there is no data for the student (except for Text, which is not dependent on student data).

  • Add Report Section – Click this button to add a report section. Each section may contain one or more widgets.
  • Section Title – Enter a name for the report section.
  • Results Contingent Visibility – Select this checkbox to show the section only if one or more of the widgets has student results. (Widgets will not appear when they have no data, but this checkbox ensures that the section title does not appear without any supporting student results.)
  • Print Break Before Section – Insert a page break before the section.
  • Add Widget – Click this button to add a report widget (subcomponent) to a section. You can add one or more widgets to a section. For each widget, select a single Content Area, one or more Test Windows, and an Objective (database field).
  • Use Battery Outcomes – Select this checkbox to use a battery objective defined on the Battery Edit tab (see Battery Edit below for more information).
  • Move Objective Up/Down, Clone Objective, Delete Objective – Click the appropriate icon on the top-left of a objective to move it up or down, clone it, or delete it. Moving an objective up or down will change where it appears on the report.

The following widgets can be added to the ISR:

  • External Named – Only supports external data (currently TestNav). The External Objective is from TestNav data, such as SCALE_SCORE.
  • Growth – Shows a graph with performance over time for interim or benchmark testing. For performance levels, score groups will appear as background colors on the chart. Supports both ADAM and external data from TestNav.
  • Metadata Performance – Similar to the Growth report but using a grouping of items, such as reading comprehension or writing ability. Supports ADAM data only. 
  • Outcome Table – Only supports external data from TestNav populated based on Content Area, Test Window, and (optionally) Grade. You can build a table with up to 2 data columns and as many rows as needed. The left column is for the row description, and the two data columns allow you to select performance objectives defined in the program or manually entered objective keys (for example REPORTING_CATEGORY_PERCENT_CORRECT). Select the Add Text checkbox to a table description or legend.
  • Page Break – Insert a page break at the selected location (anywhere within a section). You can also select the Print Break Before Section checkbox.
  • Reporting Category Profile – Select the Content Area and add Reporting Category Keys (reporting category code) to display a table with reporting categories.
  • Score and Performance – Shows the scaled score and a bar with colors for each performance level. Select the checkboxes to show test information, score group summary statements, and school and district averages. Supports ADAM data only.
  • Score with Bar – Only supports external data from TestNav. Similar to the Score and Performance widget but with an objective from TestNav data.
  • Simple Level Output – Select a Performance Level Objective. Supports ADAM data only.
  • Text – Use this widget to share text information, including links Enter a Heading and text or links in the Content area.

Battery Edit

Use the Battery Edit tab to set up objectives for battery tests. After defining objectives here, they can be used on the ISR Settings tab by selecting Use Battery Outcome in an ISR widget. The Battery Edit tab is only available when battery testing is enabled in Client Settings (see Client Settings: Battery). The battery tests listed on this tab are populated via TestNav form sync based on the battery definitions defined in the scoring test maps. 

  • If an expected battery test is not listed, select it from the Create Battery Association dropdown. The battery association will be created in ADAM, and the battery will now appear in the table.
  • Click the Edit icon to define that performance objectives for the battery used on the Performance Report. The following objectives are supported:
    • Performance Level
    • External
  • Deleting a battery does not delete the battery association; only the objectives currently defined for the battery are deleted.

Test Edit

The Test Edit tab lists tests assigned to the program. From here, you can:

  • Select the checkbox in the Review Reports column to place all reports for the test under review. Users with permission can review the test reports, and then clear the checkbox here or in Test Configuration to make the reports available to other users.
  • Click the Edit icon in the Actions column to open Test Configuration.