View Single Post
Old 02-16-2015, 08:00 PM   #1
PrawnSkunk
Administrator
User Administrator
AdministratorDeveloperFFR Simfile AuthorFFR Veteran
 
PrawnSkunk's Avatar
 
Join Date: Dec 2007
Location: Vancouver, BC
Age: 29
Posts: 3,902
Default Skill Rating & Leaderboards Discussion [Updated Oct 16]

What is Skill Rating?

Skill Rating is a ranking metric aimed at determining the actual skill of a player based on their performance on any song in-game.

The Skill Rating formula was designed by Trumpet63, PrawnSkunk, and Silvuh. The project has undergone numerous iterations since its inception in February 2015, and continues to evolve.


Increasing Your Level

Your Level/Skill Rating is an exponentially weighted average of your top fifteen scores. Your personal best score matters the most (24.04%), and your fifteenth best score matters the least (0.17%). Your rating for each song is determined by the “AAA equivalency” formula.


The AAA Equivalency Formula



… Or essentially, X number of goods on Y difficulty is equivalent to a perfect score on Z difficulty.


The above graph describes the relationship between AAA equivalent and raw score. However unlike the previous formula, your rating is now scaled by difficulty as well as good count. Crossing into the third dimension allows the Skill Rating formula to calculate AAA equivalent scores with greater than 28 goods, and in some cases, well over 1000 goods:


The constants used are the result of applying a learning algorithm to a set of data points accumulated by the Official Tournament division placement team and other community members.




To-Do List: Feature Requests

Levelrank breakdown page of your top 50 scores.
Make skill rating levelranks publicly searchable.
Expand scope of skill rating beyond your top 4 scores.
• Distinguish inactive users from active users.
• Add skill points section on results screen in R^3 for every score.


Changelog

February 16th, 2015
• Skill Rating and Global Leaderboards released.

February 17th, 2015
• Skill Rating levelranks released.

April 2nd, 2015
• Skill Rating levelranks are now publicly searchable

April 3rd, 2015
• Skill Rating now includes token songs.

October 1st, 2015
• Skill Rating v2 released.

October 16th, 2016
• Skill Rating v3 released.
• D7 cutoff raised to Lv.95

What is Skill Rating?

Skill Rating is a new skill-based ranking system designed by Trumpet63, Silvuh and PrawnSkunk that assigns a rating to each player based on their performance on public songs. The following graph describes the relationship between the number of goods in a score and how well the difficulty of the song represents your skill:



This formula was created using data accumulated by the Official Tournament division placement team. Using this information, each qualifying score with less than 28 goods can be changed into a AAA-equivalent score, giving you the difficulty of the song on which you have essentially played with 0 goods. This difficulty is multiplied by one hundred to yield your rating.

Your final rating is calculated by sum of your four best scores (0.4*A+0.3*B+0.2*C+0.1*D), where A is your best score. There are plans to expand the influence of your rating beyond your four best scores. There is no way to reduce your rating, unless the difficulty of one of your top 4 songs is lowered, or you record a better combo score.







Skill Rating by Jeffrey Spreng, Max Proske, and Silvuh Ryvinia is licensed under a
Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License
based on work at http://www.flashflashrevolution.com/leaderboards

Last edited by PrawnSkunk; 07-5-2020 at 04:57 PM..
PrawnSkunk is offline   Reply With Quote