We launched Feedback Campaigns (BETA) at the end of 2020 as a way for artists to get quality feedback on their music.
In only a few months we have hosted over 3000 feedback campaigns with a combined total of over 30,000 responses. Thank you to everyone who has created a campaign or left feedback for their fellow creators!
With the feature being in BETA, we are always looking at ways to improve it and also to identify any issues.
One such issue we spotted was with the 6-star rating system.
The original idea was that feedback campaign creators would rate the quality of the feedback they received on a simple scale from 1-6.
These ratings affect how many credits feedback providers can earn per response. In theory, the best feedback providers should get the best ratings and eventually end up earning the most credits.
But having crunched the data, it seems that this system for rating is not the most appropriate model.
Often, excellent quality feedback, which identified issues and suggested solutions, was rated poorly. At the same time poor quality feedback (which was often full of praise but lacked detail) was being rated highly.
The new rating system, introduced today, is less subjective, less open to emotion and more black and white. It consists of two questions:
Does the feedback respond to your campaign topics and notes?
Does the feedback contain the following (select all that apply)
We calculate a rating based on the answers provided. This rating will go on to affect the feedback provider's Rep Score and Level.
Constructive criticism
Does the feedback identify areas of your track that could be improved? If the feedback consists of 100% praise, this box should NOT be ticked.
Specific observations
Does the feedback make reference to specific aspects of your track? This could be sounds, lyrics, techniques, parts of the arrangement or anything else unique to your song. Can you be certain the feedback relates to your track, and yours alone?
Suggestions or solutions
Does the feedback make suggestions about how you could improve the track. Do these suggestions make sense? And are they of a reasonable level of detail?
Knowledgeable feedback
Does the feedback provider express reasonable knowledge/ experience in what you are trying to achieve? Do they understand your genre? Are the observations relevant and insightful?
Useful resources
Does the feedback reference any external sources which could assist you? This could be a link to a YouTube tutorial, a book/article suggestion or a particular artist or producer to check out.
None of the above
If the feedback does not contain any of the criteria mentioned above, do not be afraid to tick this box!
As we trial this new system, the RepostExchange admins will be taking a much more hands on approach to moderating ratings. If we do not feel a rating is fair or objective, we will update it and both parties will be notified.
Note to campaign creators: If you find your ratings being repeatedly moderated, please re-read this post and make an effort to answer the questions accurately. Members who consistently apply inaccurate ratings (too positive or too negative) may have account restrictions imposed.
As has happened in the past at different stages of the BETA, we are performing a Rep Point reset. This time it only affects Level 6 feedback providers. Rep Score for Level 6 members will be reduced to to 85. This is still comfortably within Level 6 but will to allow the new rating system to take affect your level if necessary. If your feedback adheres to the criteria outlined above, your Rep Score will continue to increase. If not, you may drop levels. This is how the system is supposed to work.
