Auto Scoring Options for Open-Ended, Video, and Audio Questions

Testlify provides three different ways to evaluate candidate responses for Open-Ended, Video, and Audio questions.

1. Auto Score Using AI

Best for: Open-ended responses where subjective evaluation is required.

When enabled, Testlify's AI automatically evaluates candidate responses based on the question, scoring criteria, and AI context provided by the assessment creator.

How it works

  • AI reviews the candidate's response.
  • AI assigns a score up to the configured maximum marks.
  • AI can also generate insights and feedback based on the response.
  • Behavioral questions
  • Scenario-based questions
  • Technical explanations
  • Video and audio responses

Example

Question:

"Describe how you would handle an unhappy customer."

The AI evaluates communication quality, problem-solving approach, empathy, and overall response quality.


2. Auto Score Using Expected Answer

Best for: Questions that have a predefined correct answer.

When enabled, candidate responses are automatically compared against the expected answer configured by the assessment creator.

Match Types Available

Case-Insensitive Match

The response must match the expected answer, ignoring capitalization.

Example

Expected Answer:

Customer Success Manager

Accepted Responses:

customer success manager
CUSTOMER SUCCESS MANAGER
Customer Success Manager

Not Accepted Responses:

Customer Success Executive
Customer Success Manager -
CustomerSuccessManager

Exact Match

The response must exactly match the expected answer.

Example

Expected Answer:

Customer Success Manager

Accepted Response:

Customer Success Manager

Not Accepted Responses:

customer success manager
CUSTOMER SUCCESS MANAGER
Customer Success Manager 
Customer Success Manager.
  • Short-answer questions
  • Formula-based responses
  • Numerical answers
  • Fixed factual responses

3. Requires Manual Review from Reviewer

Best for: Responses that require human judgment.

When enabled, candidate responses are not automatically scored. Instead, designated reviewers manually evaluate and score the response.

Features

  • Assign scoring access to specific users or teams.
  • Reviewer provides the score manually.
  • Manual scores can be included in the candidate's final assessment score.
  • Portfolio reviews
  • Writing samples
  • Complex technical responses
  • Video interviews requiring human evaluation
  • Subjective assessments

Example

Question:

"Review this investment strategy and provide your recommendation."

Since there may be multiple valid responses, a reviewer manually evaluates the candidate's answer.


Which Option Should You Choose?

Use Case Recommended Scoring Method
Fixed correct answer Auto Score Using Expected Answer
Open-ended written response Auto Score Using AI
Video response Auto Score Using AI or Manual Review
Audio response Auto Score Using AI or Manual Review
Writing sample Manual Review
Portfolio assessment Manual Review
Behavioral interview question Auto Score Using AI

This flexibility allows organizations to choose the scoring method that best fits their assessment requirements while maintaining consistency and accuracy in candidate evaluations.

Did this answer your question? Thanks for the feedback There was a problem submitting your feedback. Please try again later.

Still need help? Contact Us Contact Us