OSM Subjective Test

OSM Subjective Test

Overview

The OSM (On-Screen Marking) Subjective Test enables administrators to conduct descriptive examinations by uploading scanned answer sheets for digital evaluation. Evaluators and moderators can assess answer sheets online, assign marks, add comments, and complete multi-level evaluation workflows.

Prerequisites

  • Each OSM test can have only one subject.

  • Evaluators and moderators should be assigned based on the subject expertise.

  • Scanned answer sheets must be uploaded after the test is created.

  • Answer sheets should follow the prescribed file naming convention.

Creating an OSM Subjective Test

Test Manager → Add Test / Edit Test


Step 1: Basic Configuration

  • Select Test Type as "OSM Subjective" Select the Subject for the test.

  • Choose the appropriate test type:

    • Subjective

    • Hybrid (OMR + Subjective) – For tests containing both OMR and descriptive questions.

Step 2: Test Settings

Enable the following option:

  • On-Screen Marking

If using scanned answer sheets, select:

  • Full Sheet

Evaluation Configuration

Configure the evaluation workflow while creating the test.

Evaluation Mode

Currently supported:

  • Normal Evaluation

Available (future/optional):

  • Rubric Evaluation (currently not functional)

Number of Evaluators

Configure:

  • Number of evaluators required.

  • Whether a moderator is required.

Example:

  • Total Scripts: 100

  • Moderator Percentage: 20%

  • Moderator reviews 20 scripts.

Uploading Answer Sheets

After creating the test:

  1. Navigate to Edit Test.

  2. Click the Action (⋮) menu.

  3. Select Upload Scripts.

  4. Upload answer sheets using one of the following methods using Upload button:

    • ZIP file

    • AWS Bucket

    • Google Drive

Alert
ZIP File Naming Convention

Uploaded files should follow the naming convention:

  • RollNumber_SetNumber

  • RollNumber_1

Correct file naming is mandatory for successful mapping of scripts with candidates.

After uploading, the upload status can be monitored from the test.

Assigning Evaluators and Moderators

Navigate to the OSM Module and open the required test.

Administrators can:

  • Assign Evaluators.

  • Assign Moderators.

Important Notes

  • One evaluator can be assigned to multiple subjects.

  • One moderator can also be assigned to multiple subjects.

  • Evaluators assigned to a test should possess expertise in that subject.

  • Automatic or manual evaluator assignment can be configured based on requirements.

Evaluator Portal

Evaluators can log in to the OSM portal to begin evaluation.

Workflow

  1. Log in to the OSM portal.

  2. Select the assigned test.

  3. Click Start Evaluation.

  4. Use filters such as:

    • Pending

    • In Progress

    • Completed

  5. Open the candidate's scanned answer sheet.

  6. Evaluate the responses.

  7. Assign marks.

  8. Add comments (text or audio).

  9. Submit the evaluation.

Moderator Workflow

Moderators perform the second level of evaluation.

They can:

  • Review evaluator markings.

  • Modify awarded marks.

  • Add remarks.

  • Reassign scripts to another evaluator if required.

Script Upload Methods

Answer sheets can be uploaded:

  • Manually by the administrator.

  • Automatically using the Scanner App.

  • Through an integrated AWS Bucket.

  • Through Google Drive.

Important Notes

  • Each uploaded script represents a candidate's scanned answer sheet.

  • Proper file naming is mandatory for successful processing.

  • Script upload is performed after test creation.

  • Upload progress and processing status can be viewed from the test.

  • Evaluation can begin only after scripts have been successfully uploaded and evaluators have been assigned.

    • Related Articles

    • AI Subjective Evaluation

      Step 1: Enable AI Evaluation for Subjective (TITO) Questions 1. Feature Overview Think Exam now supports AI-based evaluation for Subjective Type Questions (Type In Type Out – TITO) within tests. This feature enables automatic evaluation of candidate ...
    • How to create a Pool Test?

      Steps to create a Pool Test: Step 1: Create Test Log in to your Think Exam panel and navigate to the "Test Manager" tab. Click on "Test" and then on "Add" to create a new test. Enter the test details, such as name, duration, instructions, and other ...
    • How to create a test from Test Manager?

      To create a test, follow the steps given below. Step 1 : create Test 1.Click on the “Test Manager” Tab and then click on the “Test” button. 2. Now click on the “Add” button which is on the right hand side of the screen. 3. Here, add all relevant ...
    • How to Evaluate Subjective Questions?

      Subjective Test Evaluation : Overview The evaluation process for subjective tests involves manually evaluating the responses given by candidates to these questions. Since subjective questions do not have a single correct answer, the evaluation ...
    • How can we get test links from the admin panel?

      Steps to get Test Links form the Admin Panel : Log in to the Admin Panel and navigate to the Test Manager module. 2. Click on the three dots next to the test name under the Action button and select Copy Test Link. Admins can now share these copied ...