OSM Subjective Test

OSM Subjective Test

Overview

The OSM (On-Screen Marking) Subjective Test enables administrators to conduct descriptive examinations by uploading scanned answer sheets for digital evaluation. Evaluators and moderators can assess answer sheets online, assign marks, add comments, and complete multi-level evaluation workflows.

Prerequisites

  • Each OSM test can have only one subject.

  • Evaluators and moderators should be assigned based on the subject expertise.

  • Scanned answer sheets must be uploaded after the test is created.

  • Answer sheets should follow the prescribed file naming convention.

Creating an OSM Subjective Test

Test Manager → Add Test / Edit Test


Step 1: Basic Configuration

  • Select Test Type as "OSM Subjective" Select the Subject for the test.

  • Choose the appropriate test type:

    • Subjective

    • Hybrid (OMR + Subjective) – For tests containing both OMR and descriptive questions.

Step 2: Test Settings

Enable the following option:

  • On-Screen Marking

If using scanned answer sheets, select:

  • Full Sheet

Evaluation Configuration

Configure the evaluation workflow while creating the test.

Evaluation Mode

Currently supported:

  • Normal Evaluation

Available (future/optional):

  • Rubric Evaluation (currently not functional)

Number of Evaluators

Configure:

  • Number of evaluators required.

  • Whether a moderator is required.

Example:

  • Total Scripts: 100

  • Moderator Percentage: 20%

  • Moderator reviews 20 scripts.

Uploading Answer Sheets

After creating the test:

  1. Navigate to Edit Test.

  2. Click the Action (⋮) menu.

  3. Select Upload Scripts.

  4. Upload answer sheets using one of the following methods using Upload button:

    • ZIP file

    • AWS Bucket

    • Google Drive

Alert
ZIP File Naming Convention

Uploaded files should follow the naming convention:

  • RollNumber_SetNumber

  • RollNumber_1

Correct file naming is mandatory for successful mapping of scripts with candidates.

After uploading, the upload status can be monitored from the test.

Assigning Evaluators and Moderators

Navigate to the OSM Module and open the required test.

Administrators can:

  • Assign Evaluators.

  • Assign Moderators.

Important Notes

  • One evaluator can be assigned to multiple subjects.

  • One moderator can also be assigned to multiple subjects.

  • Evaluators assigned to a test should possess expertise in that subject.

  • Automatic or manual evaluator assignment can be configured based on requirements.

Evaluator Portal

Evaluators can log in to the OSM portal to begin evaluation.

Workflow

  1. Log in to the OSM portal.

  2. Select the assigned test.

  3. Click Start Evaluation.

  4. Use filters such as:

    • Pending

    • In Progress

    • Completed

  5. Open the candidate's scanned answer sheet.

  6. Evaluate the responses.

  7. Assign marks.

  8. Add comments (text or audio).

  9. Submit the evaluation.

Moderator Workflow

Moderators perform the second level of evaluation.

They can:

  • Review evaluator markings.

  • Modify awarded marks.

  • Add remarks.

  • Reassign scripts to another evaluator if required.

Script Upload Methods

Answer sheets can be uploaded:

  • Manually by the administrator.

  • Automatically using the Scanner App.

  • Through an integrated AWS Bucket.

  • Through Google Drive.

Important Notes

  • Each uploaded script represents a candidate's scanned answer sheet.

  • Proper file naming is mandatory for successful processing.

  • Script upload is performed after test creation.

  • Upload progress and processing status can be viewed from the test.

  • Evaluation can begin only after scripts have been successfully uploaded and evaluators have been assigned.