How to customize AI Scoring – Rinsed

Custom AI Scoring allows you to tailor how your team’s presentations are evaluated. Instead of relying on a one-size-fits-all rubric, you can now enable, disable, or create scoring elements that reflect what matters most to your business.

Available to: Admins, upon request. Contact Customer Support or our Customer Success Team to enable this feature in your account.

What is Custom AI Scoring?

Say goodbye to the fixed scoring rubric. With Custom AI Scoring, you can now:

Enable or disable default scoring elements (such as greeting, upsell, or package explanation)
Create custom scoring elements that are unique to your business needs

Only the enabled elements will be used in session scoring and AI-generated coaching.

How a presentation score is calculated

Each presentation score is equal to the total points earned, divided by the total points that could have been earned.

Each element has a score (how well the salesperson did) and a weight (how much it matters). Multiply those together for every element, and add them up to get the total points earned (numerator).

Then do the same thing using the max possible score for each element instead of the actual score — that's the maximum number of points earned (denominator).

Overall score = Total points earned / Maximum points that could have been earned.

Overall Score = SUM(weight × score) ÷ SUM(weight × max score)

Note: Points are pooled across elements, so a 0-3 element counts 3x more than a true/false element at the same weight.

Default scoring elements

Under Coaching > AI Rubric Config, you’ll find a list of suggested scoring categories labeled as default Salespath elements. These represent common best practices for a successful sales interaction. You can turn each one on or off depending on whether you want it included in scoring.

💡 If a default element is disabled, it will not impact scores or appear in coaching.

For an in-depth breakdown of the default elements, click here.

Creating custom scoring elements

Need to score based on something specific to your business? You can create your own scoring elements and include them in your AI evaluations.

To create a custom scoring element:

From the AI Rubric Config page, click AI Generate.
Enter your prompt into the AI assistant. (e.g., "Ensure my salespeople mention pollen season."). Click Generate and Continue.
The assistant will automatically generate a rubric item that you can now review. The rubric item will contain:
- Element name: A summary of this element criteria. (E.g., "Pollen Season Mentioned")
- Score type: How would you like this to be scored? (E.g., True/False - True means pollen season was mentioned. False means it was not mentioned.)
  - Number (0-3 scale): This score type indicates to AI that it should score the element on a range of how well the salesperson met this specific criteria, on a scale of 0-3.
  - True/False: The AI will score the item as True/False based on if the salesperson met the criteria or not.
  - Nullable: Similar to Number (0-3 scale) option, but with an additional -1 option for in the event that this criteria does not apply. (E.g., if you want to grade how well the salesperson handles objections from the customer, you could use the Nullable score type, where -1 means that no objection was raised, so this criteria is null.)
  - Alerts: Use this for criteria that may require alerting to Managers/Owners. (For example, "Did the salesperson encourage the customer to cancel right after they signed up?")
- Description: A full description of this rubric item (E.g., "Did the salesperson mention pollen season during their presentation?")
Click Next Step to proceed with finalizing your element.
You'll be taken to the Scoring Guidelines page where you can further refine your prompt. Once complete, click Create Element.

How to enable or disable an element

To enable or disable a specific element, simply open the AI Rubric under Coaching > AI Rubric Config. Then, use the simple on/off toggle to enable or disable each element.

At this time, there is no way to delete elements, only to enable or disable them.

To edit, select the pencil icon next to any element

Assigning weights to scoring elements

Tenant Admins can assign a numeric weight to each rubric element to control how much it contributes to the overall AI pitch score. The weight is a multiplier applied to each element's raw score before everything gets added up into the total.

For example: If "Greeting Quality" scores 2 out of 3, and its weight is 5, it contributes 10 points (2 pts * 5) to the total. If "Closing Technique" also scores 2 out of 3 but its weight is 1, it only contributes 2 points.

Elements with a weight of 0 are effectively excluded from scoring (they score, but don't count toward the total). Elements with a weight of 10 have the most influence on the final number.

To assign a weight to an element:

Go to Coaching > AI Rubric Config and locate the element.
Click the pencil icon to edit.
Drag the Scoring Weight scale to increase or decrease the weight for that element.

By default, all enabled elements are weighted equally. Adjusting weights does not affect which elements are included in scoring — only how much each contributes to the total.

💡 Changes to element weights will apply retroactively to all previously scored presentations.

How weighted scores appear

When viewing the scoring details for a presentation, the following changes apply:

Each element displays its assigned weight
The total score for each group is shown as a weighted fraction
Alerts are displayed in their own group and do not count toward the total percentage

Customizing the grading scale

Tenant Admins can now customize the score thresholds that determine each AI letter grade (A through F) at the tenant level.

To adjust the grading scale:

Go to Coaching > AI Rubric Config
Select the Grading Scale tab
Adjust the score thresholds for each letter grade to match your team's standards.
Click Save once complete.

💡 Changes to the grading scale apply retroactively to all previously scored presentations.

Where you'll see scoring elements

Presentation Details

Each recorded presentation will include a score breakdown that reflects:

Your enabled default elements
Any custom elements you’ve created

Click into a presentation from the Salesperson report, then select the AI Scoring tab to view scoring for an individual presentation.

Scorecards

When viewing an individual salesperson's performance scorecard, scores will show both default and custom elements. An overall performance score (A-F scale) will be given based on all enabled elements (custom and default).

AI Sales Coaching

Weekly coaching summaries are now based only on enabled elements. If an element is turned off, it will not generate coaching suggestions.

💡You can coach on custom elements as long as they are enabled and the score warrants coaching.

How changes to your AI scoring impact previous presentations

When you make a change to your element weights or grading scale, these changes will apply to all past and future presentations. However, edits to a rubric element itself - its name, its score type, or scoring criteria - only apply to new presentations.

A presentation is never re-scored once it has been graded; however, the calculation on top of that grade (such as element weights) can change retroactively.

Need help? If you’d like help setting up custom elements or using the AI assistant, reach out to your Customer Success Manager or contact support@rinsed.co!