Calculating Questionnaire Scores in VRM

The Vendor Risk Management application uses a structured system to evaluate and visually interpret questionnaire results, providing a comprehensive measure of performance based on responses. This process involves:

• A scoring system that ensures accurate assessment of answers, questions, categories, and the entire questionnaire.
• A color-coding system that highlights critical areas for improvement or success.

Key Factors to Calculating Questionnaire Scores

Answer Impact

Answer Impact is the weight assigned to the selected answers. Each possible answer in a multiple-choice or multiple-select question is assigned a weight ranging from 0 to 100. To calculate Answer Impact (answer_impact):

Example

If the selected answer is Yes with a weight of 100 and there’s only one selected answer, it is calculated as follows:

Question Priority

Question Priority indicates the importance assigned to each question. Each question is assigned a priority level, ranging from 0 (lowest priority) to 4 (highest priority). The priority reflects the relative importance of the question in the overall scoring. The priority levels are as follows:

• 0 = None
• 1 = Low
• 2 = Medium
• 3 = High
• 4 = Critical

Question Scores

A Question Score (question_score) is assigned to individual questions, derived and calculated by multiplying its answer_impact by its question_priority:

question_score = answer_impact × question_priority

Example

If the answer_impact is 1 and the question_priority is 2:

question_score = 1 × 2 = 2

Category Scores

A Category Score (category_score) is assigned, indicating a weighted average performance of all questions within a category. Each category's score reflects the weighted average performance of all questions within that category. It is calculated as:

Example

For a category with two questions:

Question 1
Answered Yes (question_scores = 2, question_priorities = 2)

Question 2
Answered No (question_scores = 0, question_priorities = 3)

Questionnaire Score

A Questionnaire Score (questionnaire_score) is assigned, calculated by evaluating the scores of all individual questions and their respective priorities, across all categories. It indicates a weighted average performance across all questions in the questionnaire, providing an overall performance metric for the entire questionnaire.

Example

A questionnaire has two categories with the following questions:

Category 1

• Question 1: question_scores = 2, question_priorities = 2
• Question 2: question_scores = 3, question_priorities = 3

Category 2

• Question 3: question_scores = 1, question_priorities = 1
• Question 4: question_scores = 4, question_priorities = 4

Step-by-Step Calculation:

1. Calculate the numerator; Sum of all question scores (question_scores):

   

2. Calculate the denominator; Sum of all question priorities (question_priorities):

   

3. Calculate the questionnaire score (questionnaire_score):

   

Color Schemes

Color Schemes is a visual representation of performance, highlighting critical areas for attention. The color schema for questions is calculated based on the impact and the priority level of the question. This calculation determines the color displayed to represent the significance of a particular answer.

The impact is calculated as Answer.Impact * 100 (converted to a percentage). If Priority is not provided, the Impact defaults to 100. Adjustments are made based on Impact thresholds and Priority:

• Impact < 26 and Priority = 2 (Medium) → Impact = 26
• Impact < 51 and Priority = 1 (Low) → Impact = 51

Scoring Based on Condition

Condition: No priority is set (Priority = 0).

Assigned Impact Score: 100

Explanation: Indicates the question or answer is not critical and it does not have a negative impact.

Condition: Answer impact is below 33 and priority is medium (Priority = 2).

Assigned Impact Score: 33

Explanation: Reflects a moderate issue that requires attention due to the question’s medium priority.

Condition: Answer impact is below 66 and priority is low (Priority = 1).

Assigned Impact Score: 66

Explanation: Reflects a more significant issue but is still within acceptable limits for a lower-priority question.

Condition: None of the above conditions are met.

Assigned Impact Score: Calculated Answer Impact

Explanation: The system returns the calculated answer impact as the impact score, allowing flexibility based on the situation.

Color Impact Scores

The color visually represents the severity or status of the answer’s impact. This table summarizes the different color assignments based on the calculated impact score, providing an easy reference for interpreting the results.

Impact Score Range: Unanswered Question

Color: Grey

Meaning: The question is incomplete or it does not have an answer.

Impact Score Range: Impact Score < 33

Color: Red

Meaning: Critical issue; Immediate action is required.

Impact Score Range: Impact Score = 33-66

Color: Orange

Meaning: Medium impact; The issue is concerning, but not critical.

Impact Score Range: Impact Score = 66-100

Color: Yellow

Meaning: Low impact; Caution is needed, but the issue is minor.

Impact Score Range: Impact Score = 100

Color: Green

Meaning: No issue; The answer is fully compliant or is acceptable.

Color Schema for Categories and Questionnaires

The color for categories and questionnaires is based on their overall scores, using similar ranges and color codes:

• Green (76-100): Excellent performance.
• Yellow (51-75): Average performance.
• Orange (26-50): Needs improvement.
• Red (1-25): Poor performance.
• No Tag: For categories or questionnaires with no data.