Qu: What are the main differences between the old and new Torch 360?
(a) Length of assessment
- New 360 is shorter, containing less statements overall
- Reduces “survey fatigue”
(b) Scoring Scale
- Relative to “others” vs Likert scale (Agree/Disagree).
- 3 out of 5 will be the new norm / average score (vs closer to 4 out of 5 in the previous version)
- New domains drawn from latest research and leadership theory to provide holistic picture of leadership
(d) New Presentation of Results
- Summary Page
- Radar charts to display gaps between self assessment and “others”
- In-app written guidance on how to interpret results
- Ability to export as PDF and print
Qu: What is the new Scoring Scale and why do we use it?
The new 360 scoring scale has raters assess coachees relative to others they have worked with over their careers as exhibiting the traits in each statement:
5 - Much more than others
4 - More than others
3 - Same as others
2 - Less than others
1 - Much less than others
Qu: Who are the “others” for the purposes of the scoring scale?
“Others” are those with whom the rater has worked with throughout their career.
Qu: How many raters should a client invite?
The more the better - as long as each rater has sufficient experience working with the client to be able to provide constructive feedback on their strengths and growth areas. We recommend inviting at least 7-10 - depending on the size of the organization.
Qu: Do raters receive reminders to complete the survey?
Yes! Raters will receive a reminder from Torch every week until feedback is completed. You may also suggest your client sends a note or slack to "nudge" a respondent who is taking a while to complete their feedback. You can see on your Torch dashboard which raters have not completed the survey.
RELEASING A 360
Qu: What should I check before releasing the 360 to my client?
Once a 360 is released, it cannot be "unreleased", so it's important to ensure the following conditions are met / considered before releasing it to your client:
- Did all the invited colleagues respond? If not, you can suggest your client give the remaining invitees a personal reminder in addition to those sent automatically by Torch.
- Were enough colleagues invited (we recommend a minimum of 7)?
- Were key stakeholders invited (eg manager, direct reports, etc)? If not, the client can add new respondents at any time until results are released.
- In cases where many weeks have passed and one or two people have still not responded despite multiple reminders, the coach and client may decide to close out the 360 in the interests of moving the process along. Note that this should only happen if the remaining respondents are not key stakeholders (eg manager).
- Did you check the written feedback for any inflammatory or attacking language (see below)? If you find comments that may be detrimental to the client's wellbeing, please let us know. In such circumstances we can remove those comments before release where in the best interests of the client.
Qu: How do I release 360 results to my client?
Once all the above factors are met, you may release the results to your client. Simply click the button on the 360 tab of your dashboard to enable the results. The 360 results will immediately appear on the client’s dashboard.
Qu: Should I release the results before or during a session with my client?
We recommend releasing the results during a session. This allows you to support and guide them to process the information in a constructive way. You can have them log in to their Torch account and review the results together on a zoom call.
Qu: What if I find inflammatory or attacking language in the 360? Should I release it anyway?
No. Please review the results carefully before releasing them, to make sure there is no sensitive or inflammatory information that may be detrimental to the client.
Note that this is different from candid, constructive feedback that may be perceived by the client as negative - but which is overall useful for their growth as a leader. It is the coach’s role to support the client to digest this feedback, and use it to fuel their growth and goals.
If you find inflammatory language in a 360, or you are unsure about a particular comment, please reach out to firstname.lastname@example.org. If necessary, we can remove such statements from the 360.
Qu: Can feedback still be provided after a 360 has been released?
No. Once the 360 results have been released to the client by their coach, the system will not allow any more responses. For this reason, it’s important that you review the 360 Release Checklist before releasing, paying particular attention to whether all respondents have submitted feedback - especially the client’s Manager.
Qu: Can I release the 360 results to my client without all responses being submitted?
While technically possible, it’s best practice to wait a few weeks to allow all raters time to respond. They will receive reminders from Torch every Monday until feedback is submitted.
If many weeks have passed and a small number of raters have not responded, check in with your client to see if they’d like to wait longer or release. Make sure they understand that no further responses will be accepted once it’s released.
Qu: What if my client's Manager hasn’t responded to the survey - can I release it anyway?
We generally do not release the 360 without the Manager’s feedback. If many weeks have passed, and reminders have been sent by the client without response, we recommend you reach out to our Customer Success team (email@example.com). They’ll contact the Program Manager at the client's company for assistance.
INTERPRETING THE RESULTS
Qu: What do the numbers inside the triangles under Hidden Strengths and Blind Spots refer to?
- These numbers refer to the difference between the client’s self assessment score and the average score given by their colleagues.
- The numbers in the circles under "Strengths" and "Challenges" refer to the actual score being an average of all responses from colleagues.
Qu: How are Hidden Strengths and Blindspots determined?
Hidden Strengths are highlighted where there is a difference of 0.7 or greater between the client's self assessment score and the average score given by their colleagues (where the client's score is lower).
Blind Spots are highlighted where there is a difference of 0.7 or greater between the average score given by colleagues and the client's self assessment score (where the client's score is higher).
Qu: What are percentiles and how should I use them?
The percentile scores shown in the 360 Details View are calculated by comparing the average score of all of the responses (except your own) against every leadership assessment ever taken on the Torch platform.
The higher the percentile score the higher you are in relation to all leaders on the Torch platform.
Qu: My client received a score of 3 ("same as others") overall for the domain of "Empathy" but the percentile score was only 10%. What does this mean?
In some cases, clients will score "Same as others" but still receive a low percentile score for that domain. This indicates that most others who have taken the new Torch 360 scored higher for this domain.
If a client has a low percentile in any domain, get curious with them on what they can learn or how they can grow. You can remind them that these responses are just "perspectives" - and, especially where a smaller number of raters was chosen, this is based on a small sample only.
Qu: How do I interpret the radar charts? What is the difference between them?
Radar Chart One: Score Comparison by Domain
This chart shows a comparison between your client's self-assessment scores (pink line) and how colleagues rated them (black line). It gives a quick visual snapshot of the gaps and/or alignment between your client's perceptions of themselves and the perceptions of their peers.
Simply ask your client to take a look and see what they notice. They may need some help interpreting it.
Radar Chart Two: Percentile Comparison by Domain
This chart compares your client's scores to all others who have taken this assessment across the Torch platform (not just within their organization).
The pink "self responses" shows the percentile in which your own responses fall compared to the responses of all Torch 360 self assessment takers.
The grey "colleague responses" shows the percentile in which your colleagues' responses fall as compared to all Torch 360 feedback provider responses.
Qu: What are "reverse-scored" statements?
Reverse scoring means that the numerical scoring scale runs in the opposite direction. Some statements will be presented in a way that “less than others” or “much less than others” are positive indicators and will align to a “4” or “5” instead of a “2” or “1” on the scoring scale.
Qu: What if we don't get through the whole 360 in one session?
Sometimes it may take two sessions to work through all the feedback with your client. Don't feel you need to rush through it - there is a lot to process.
You can set a homework assignment for the client such as reviewing their results again between sessions and identifying the three main themes of the feedback, etc.
Qu: Are any adjustments made for people taking the assessment from other regions and cultural backgrounds?
Currently, the assessment statements have been tested with a pool of people from the US. Over time we hope to create versions that adapt to other cultures.
Qu: My client wants to show their 360 results to their colleagues. How do they do that?
They can easily export it to a PDF by clicking the button on their dashboard: