Flash Flash Revolution

Flash Flash Revolution (http://www.flashflashrevolution.com/vbz/index.php)
-   Bug Reports and Suggestions (http://www.flashflashrevolution.com/vbz/forumdisplay.php?f=15)
-   -   Skill Rating & Leaderboards Discussion [Updated Oct 16] (http://www.flashflashrevolution.com/vbz/showthread.php?t=140927)

PrawnSkunk 02-16-2015 08:00 PM

Skill Rating & Leaderboards Discussion [Updated Oct 16]
 
What is Skill Rating?

Skill Rating is a ranking metric aimed at determining the actual skill of a player based on their performance on any song in-game.

The Skill Rating formula was designed by Trumpet63, PrawnSkunk, and Silvuh. The project has undergone numerous iterations since its inception in February 2015, and continues to evolve.


Increasing Your Level

Your Level/Skill Rating is an exponentially weighted average of your top fifteen scores. Your personal best score matters the most (24.04%), and your fifteenth best score matters the least (0.17%). Your rating for each song is determined by the “AAA equivalency” formula.


The AAA Equivalency Formula



… Or essentially, X number of goods on Y difficulty is equivalent to a perfect score on Z difficulty.


The above graph describes the relationship between AAA equivalent and raw score. However unlike the previous formula, your rating is now scaled by difficulty as well as good count. Crossing into the third dimension allows the Skill Rating formula to calculate AAA equivalent scores with greater than 28 goods, and in some cases, well over 1000 goods:


The constants used are the result of applying a learning algorithm to a set of data points accumulated by the Official Tournament division placement team and other community members.




To-Do List: Feature Requests

Levelrank breakdown page of your top 50 scores.
Make skill rating levelranks publicly searchable.
Expand scope of skill rating beyond your top 4 scores.
• Distinguish inactive users from active users.
• Add skill points section on results screen in R^3 for every score.


Changelog

February 16th, 2015
• Skill Rating and Global Leaderboards released.

February 17th, 2015
• Skill Rating levelranks released.

April 2nd, 2015
• Skill Rating levelranks are now publicly searchable

April 3rd, 2015
• Skill Rating now includes token songs.

October 1st, 2015
• Skill Rating v2 released.

October 16th, 2016
• Skill Rating v3 released.
• D7 cutoff raised to Lv.95

What is Skill Rating?

Skill Rating is a new skill-based ranking system designed by Trumpet63, Silvuh and PrawnSkunk that assigns a rating to each player based on their performance on public songs. The following graph describes the relationship between the number of goods in a score and how well the difficulty of the song represents your skill:



This formula was created using data accumulated by the Official Tournament division placement team. Using this information, each qualifying score with less than 28 goods can be changed into a AAA-equivalent score, giving you the difficulty of the song on which you have essentially played with 0 goods. This difficulty is multiplied by one hundred to yield your rating.

Your final rating is calculated by sum of your four best scores (0.4*A+0.3*B+0.2*C+0.1*D), where A is your best score. There are plans to expand the influence of your rating beyond your four best scores. There is no way to reduce your rating, unless the difficulty of one of your top 4 songs is lowered, or you record a better combo score.







Skill Rating by Jeffrey Spreng, Max Proske, and Silvuh Ryvinia is licensed under a
Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License
based on work at http://www.flashflashrevolution.com/leaderboards

YoshL 02-16-2015 08:03 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
alot less skill debating tyvm

blanky! 02-16-2015 08:04 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
I love the mathematical/statistical aspects of this.

Finally some SCIENCE

Guest15937 02-16-2015 08:04 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
And yet, no raw scoring

ilikexd 02-16-2015 08:05 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
i am now d6

Ohaider 02-16-2015 08:05 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
maths

Rapta 02-16-2015 08:06 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
Suggestion: Add a place to view top 1000 ranks if that isn't there

Edit: Found it!

storn42 02-16-2015 08:11 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
so, what are the cut-offs for each division based on skill rating. i'd go look through the leaderboards but ffr is being really slow. i blame the hype train.

Mahou 02-16-2015 08:11 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
I will be happy to compete in d5 for the 11th official.

kmay 02-16-2015 08:13 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
went from av rank 50th to 245...


looks like no one even tries to AAA the old easy songs anymore =[

Kawaii025 02-16-2015 08:15 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
Good gravy there are a lot of people looking at this thread... :P

Anyways, I'm curious about something; so does the Skill Bracket mean that's your official division for tournaments and stuff? Has the skill bracket requirements changed?

TheSaxRunner05 02-16-2015 08:16 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
It's not based on average rank anymore, just your best 4 scores.

PrawnSkunk 02-16-2015 08:25 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
Quote:

Originally Posted by storn42 (Post 4277452)
so, what are the cut-offs for each division based on skill rating. i'd go look through the leaderboards but ffr is being really slow. i blame the hype train.

The boundaries are currently 0/2300/4700/5600/6450/7630/8650 for each respective division -- However these numbers are not final, and will change as the skill rating formula evolves over time. As I receive feedback and suggestions, I will manually adjust the cutoff for each division.

TheSaxRunner05 02-16-2015 08:27 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
Quick, someone go out and get 29 clean on RATO

Charu 02-16-2015 08:27 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
I was totally expecting that new site layout, dang it.

Oh well, I guess this is sort of cool too!

TheSaxRunner05 02-16-2015 08:29 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
I would be more impressed with the daily stats page if it kept track of how many times you had made the list :p

And then make a leaderboard for that too, even if it's just for the GT stat (most AAAs would just be an excite bike fest)

Charu 02-16-2015 08:30 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
Also, our skill rank isn't displayed when browsing forums. Just FYI!!!

Guest15937 02-16-2015 08:30 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
Is there any way to see your best 4 scores?

PrawnSkunk 02-16-2015 08:34 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
Quote:

Originally Posted by Guest15937 (Post 4277465)
Is there any way to see your best 4 scores?

That's a great suggestion! The next feature I would like to finish is a complete stat breakdown page, expanding beyond your top 4 scores so it is not a mystery how you can improve your rating. :)

TheSaxRunner05 02-16-2015 08:41 PM

Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]
 
I'd like to see the regional leaderboards extended to 20 or 25 :)


All times are GMT -5. The time now is 05:08 AM.

Powered by vBulletin® Version 3.8.1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright FlashFlashRevolution