How do I rate champions?

Gene Bellotti -

Purpose

This unique feature of The Right Profile TAP 360 system allows you to customize the way prospects’ TAP results are evaluated so that you know how well a prospect fits the mold of the kind of player your organization desires. Like the Team Matching feature, this makes the TAP system reports customized to your team. (This TAP “grade” will be unique to your team, not something your competitors get. Your ratings and the resultsThe Right Profile’s formula arewill be held in confidence.)

Overview

You will be supplied a list of players who took the TAP. From this list, you will target players who you know well. The players you target will most likely be present and past players on your team but might also include players you knew if you previously worked in other organizations.

For the players you know, you are to assign them either a 3 or a 2 or a 1.

3 = Champion -- We desire players with this mental makeup and attitude. Our kind of athlete.

1 = Undesirable -- We do not desire players with this mental makeup and attitude. Not our kind of athlete. They don’t necessarily need to be kicked off the team, but we do not desire more athletes like this on our team.

2 = Okay -- We are okay with players with this mental makeup and attitude.

This point will be reinforced many times but do not rate players using this scale on the basis of physical or performance attributes. This will be a challenge because everyone wants more athletes like the player who scores touchdowns, hits homeruns, pitches shut-outs or leads the team in tackles. Only rate these players on the basis of factors like attitude, mental makeup, behavior off the field and in the locker room, ability to get along with coaches and teammates, etc. In short, only rate these players on the basis of personal makeup.

This point will be reinforced many times but DO NOT rate players using this scale on the basis of PHYSICAL or performance attributes. This will be a challenge because everyone wants more athletes like the player who scores touchdowns, hits home-runs, pitches shut-outs or leads the team in tackles. Only rate these players on the basis of factors like attitude, mental makeup, behavior off the field and in the locker room, ability to get along with coaches and teammates, etc. In short, only rate these players on the basis of personal makeup.

Suggested Steps

    1. Select from the list of players who took the TAP those who you feel you know well enough to assign a rating. The more players the better.

 

    1. Before you start rating the players you know well, take some time to list the factors that determine a rating of 3, a rating of 1 and a rating of 2. Remember, do not rate players on the basis of physical or performance attributes. In essence, you should create a scoring rubric.

 

    1. If several people will be rating these players, everyone should be involved in the previous step.
      3a. It is recommended that in most situations, no more than 5 people should be rating players.
      3b. Also, if more than one person is rating players, you need to calibrate raters. This means that the rating team should spend time talking about examples or actual players that definitely fall in each of the 3 categories. During the calibration, remind everyone to only rate these players on the basis of personal makeup, not physical performance.
      3c. It is advised that no one should rate players unless they are involved in this step. This step may take time but it will greatly increase the accuracy of ratings and the output of TAP results.
      3d. Also, everyone on the rating team should know the players selected in step one.

 

    1. Now you can rate players you know.

 

    1. If there are 2 or 3 raters, only retain player ratings if there is consensus. If there are 4 raters, a given player rating can stand if 3 raters agree and if there are 5 raters, a valid rating should only be assigned if 4 of the 5 raters agree. If half the raters say a player is a 3 but the other half say he is a 2, the player cannot be a 2 ½.
      5a. When raters disagree on a player’s rating, it is wise to deliberate, much like a jury, to see if everyone can have a consensus rating.

 

  1. Count the number of players with each of the ratings. For better results there should be at least 20 players in each rating level and a more ideal sample size is 50 players per each rating.
Have more questions? Submit a request

0 Comments

Please sign in to leave a comment.