Old 02-16-2015, 08:00 PM   #1
PrawnSkunk
Administrator
User Administrator
AdministratorDeveloperFFR Simfile AuthorFFR Veteran
 
PrawnSkunk's Avatar
 
Join Date: Dec 2007
Location: Vancouver, BC
Age: 29
Posts: 3,902
Default Skill Rating & Leaderboards Discussion [Updated Oct 16]

What is Skill Rating?

Skill Rating is a ranking metric aimed at determining the actual skill of a player based on their performance on any song in-game.

The Skill Rating formula was designed by Trumpet63, PrawnSkunk, and Silvuh. The project has undergone numerous iterations since its inception in February 2015, and continues to evolve.


Increasing Your Level

Your Level/Skill Rating is an exponentially weighted average of your top fifteen scores. Your personal best score matters the most (24.04%), and your fifteenth best score matters the least (0.17%). Your rating for each song is determined by the “AAA equivalency” formula.


The AAA Equivalency Formula



… Or essentially, X number of goods on Y difficulty is equivalent to a perfect score on Z difficulty.


The above graph describes the relationship between AAA equivalent and raw score. However unlike the previous formula, your rating is now scaled by difficulty as well as good count. Crossing into the third dimension allows the Skill Rating formula to calculate AAA equivalent scores with greater than 28 goods, and in some cases, well over 1000 goods:


The constants used are the result of applying a learning algorithm to a set of data points accumulated by the Official Tournament division placement team and other community members.




To-Do List: Feature Requests

Levelrank breakdown page of your top 50 scores.
Make skill rating levelranks publicly searchable.
Expand scope of skill rating beyond your top 4 scores.
• Distinguish inactive users from active users.
• Add skill points section on results screen in R^3 for every score.


Changelog

February 16th, 2015
• Skill Rating and Global Leaderboards released.

February 17th, 2015
• Skill Rating levelranks released.

April 2nd, 2015
• Skill Rating levelranks are now publicly searchable

April 3rd, 2015
• Skill Rating now includes token songs.

October 1st, 2015
• Skill Rating v2 released.

October 16th, 2016
• Skill Rating v3 released.
• D7 cutoff raised to Lv.95

What is Skill Rating?

Skill Rating is a new skill-based ranking system designed by Trumpet63, Silvuh and PrawnSkunk that assigns a rating to each player based on their performance on public songs. The following graph describes the relationship between the number of goods in a score and how well the difficulty of the song represents your skill:



This formula was created using data accumulated by the Official Tournament division placement team. Using this information, each qualifying score with less than 28 goods can be changed into a AAA-equivalent score, giving you the difficulty of the song on which you have essentially played with 0 goods. This difficulty is multiplied by one hundred to yield your rating.

Your final rating is calculated by sum of your four best scores (0.4*A+0.3*B+0.2*C+0.1*D), where A is your best score. There are plans to expand the influence of your rating beyond your four best scores. There is no way to reduce your rating, unless the difficulty of one of your top 4 songs is lowered, or you record a better combo score.







Skill Rating by Jeffrey Spreng, Max Proske, and Silvuh Ryvinia is licensed under a
Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License
based on work at http://www.flashflashrevolution.com/leaderboards

Last edited by PrawnSkunk; 07-5-2020 at 04:57 PM..
PrawnSkunk is offline   Reply With Quote
Old 02-16-2015, 08:03 PM   #2
YoshL
Celestial Harbor
FFR Simfile AuthorFFR Music ProducerD7 Elite KeysmasherFFR Veteran
 
YoshL's Avatar
 
Join Date: Aug 2008
Location: Celestial Harbor
Age: 30
Posts: 6,156
Send a message via AIM to YoshL Send a message via MSN to YoshL Send a message via Skype™ to YoshL
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

alot less skill debating tyvm
__________________


Quote:
Originally Posted by Charu View Post
Only yours, for an easy price of $19.99! You too can experience the wonders of full motion rump sticking.
YoshL is offline   Reply With Quote
Old 02-16-2015, 08:04 PM   #3
blanky!
Banned
D7 Elite KeysmasherFFR Veteran
 
Join Date: Jan 2015
Posts: 164
Send a message via Skype™ to blanky!
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

I love the mathematical/statistical aspects of this.

Finally some SCIENCE
blanky! is offline   Reply With Quote
Old 02-16-2015, 08:04 PM   #4
Guest15937
One-handed elite
FFR Veteran
 
Guest15937's Avatar
 
Join Date: May 2008
Posts: 1,464
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

And yet, no raw scoring
__________________
The renegade has betrayed me.
Guest15937 is offline   Reply With Quote
Old 02-16-2015, 08:05 PM   #5
ilikexd
Retired StaffFFR Simfile AuthorD7 Elite KeysmasherFFR Veteran
 
Join Date: Apr 2006
Posts: 3,205
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

i am now d6
ilikexd is offline   Reply With Quote
Old 02-16-2015, 08:05 PM   #6
Ohaider
FFR Veteran
FFR Veteran
 
Join Date: Jun 2012
Age: 28
Posts: 2,893
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

maths
Ohaider is offline   Reply With Quote
Old 02-16-2015, 08:06 PM   #7
Rapta
🡸Index🡻Is🡹Fun!🡺
Global ModeratorMultiplayer ModeratorFFR Simfile AuthorD8 Godly KeysmasherFFR Veteran
 
Rapta's Avatar
 
Join Date: Dec 2010
Location: Auserd
Posts: 1,924
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

Suggestion: Add a place to view top 1000 ranks if that isn't there

Edit: Found it!
__________________
Old Quotes
Quote:
Originally Posted by IwasAsquidOnce
Note the left hand pinky. It stretches out into attack mode to make etienne's hand appear larger, an intimidation technique for the arrows.
Quote:
Originally Posted by Mourningfall
[3:51 PM] Mourningfall: i spent the second half of that song getting face fucked by a fly
Quote:
Originally Posted by Xiz View Post
Hi I see rapta come play TWG next game
Quote:
Originally Posted by xXOpkillerXx View Post
Rapta thinks alot about memes and fonts. I'd be inclined to think he's town because wolves wouldn't have time to meme would they ?
Quote:
Originally Posted by Prawnskunk
if we keep releasing engines that work on 1/4 of people's computers, we'll get there
Quote:
Originally Posted by gold stinger
do u even agrabah
Quote:
Originally Posted by gold stinger
Today at 12:53 AM
I have no fucking idea how you were able to identify that specific line from meme show so you are basically an elder god of memes
Quote:
Originally Posted by Psychotik
When I think Mother’s Day, I think Venetian Snares.
Quote:
Originally Posted by Haku
have you heard someone mention eating pancakes to negate friday 13th?




Quote:
Originally Posted by Prawnskunk at 10:53:56pm on 10/26/11
OMFG VC! I want your programming fingers in or around my mouth OnO
Quote:
Originally Posted by Storn at 3:03 PM
We have so many batches open. Its like a backlog clearance sale. ALL FILES MUST GO!!
Quote:
Originally Posted by ToonE156 at 11:07 PM
You've never felt intimacy until you've practiced Jiu Jitsu ground techniques with the only girl in class

Last edited by Rapta; 02-16-2015 at 08:38 PM..
Rapta is offline   Reply With Quote
Old 02-16-2015, 08:11 PM   #8
storn42
RIP Storn D0-D0
Simfile JudgeFFR Simfile AuthorFFR Veteran
 
storn42's Avatar
 
Join Date: Jun 2012
Posts: 3,453
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

so, what are the cut-offs for each division based on skill rating. i'd go look through the leaderboards but ffr is being really slow. i blame the hype train.
__________________


Quote:
Originally Posted by Xiz View Post
"I think storn is town but he doesn't have a shirt on" - Roundbox
Quote:
Originally Posted by the sun fan View Post
I have beat my meat to storn's posts no less than four times


Quote:
Originally Posted by ShadoWolfe View Post


storn42 is offline   Reply With Quote
Old 02-16-2015, 08:11 PM   #9
Mahou
魔法少女
FFR Veteran
 
Mahou's Avatar
 
Join Date: Jan 2006
Age: 33
Posts: 2,150
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

I will be happy to compete in d5 for the 11th official.
__________________
Quote:
Originally Posted by lofty rhino View Post
one does not simply hate everyone that plays stepmania
AND watch anime.
Mahou is offline   Reply With Quote
Old 02-16-2015, 08:13 PM   #10
kmay
Don't forget me
FFR Veteran
 
kmay's Avatar
 
Join Date: Jan 2007
Location: USA
Age: 31
Posts: 6,491
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

went from av rank 50th to 245...


looks like no one even tries to AAA the old easy songs anymore =[
__________________
kmay is offline   Reply With Quote
Old 02-16-2015, 08:15 PM   #11
Kawaii025
Fake D4
FFR Veteran
 
Kawaii025's Avatar
 
Join Date: Jun 2007
Location: Ten-ah-c
Posts: 1,398
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

Good gravy there are a lot of people looking at this thread... :P

Anyways, I'm curious about something; so does the Skill Bracket mean that's your official division for tournaments and stuff? Has the skill bracket requirements changed?
__________________
My List of FFR Tournaments
Pre-10/16/16
Highest AAA: Connect (HOUSE SOUL REMIX) & Case Closed (54)
Highest Blackflag: Survive (60)
Highest FC: Challenge the final mission! (68)
Highest SDG: The Fusion (63)
Otaku Speedvibe [Heavy] unlocked 03/04/15 - On The Origin of Species (Evolution) (50)

Highest AAA:Case Closed (58)
Highest Blackflag: Survive (58)
Highest Booflag: Fill Me Up With Snacky Happiness & Suit Up (55)
Highest FC: Challenge the final mission! (72)
Highest SDG: The Fusion (67)
Kawaii025 is offline   Reply With Quote
Old 02-16-2015, 08:16 PM   #12
TheSaxRunner05
The Doctor
FFR Veteran
 
TheSaxRunner05's Avatar
 
Join Date: Apr 2006
Age: 35
Posts: 6,145
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

It's not based on average rank anymore, just your best 4 scores.
__________________


TheSaxRunner05 is offline   Reply With Quote
Old 02-16-2015, 08:25 PM   #13
PrawnSkunk
Administrator
User Administrator
AdministratorDeveloperFFR Simfile AuthorFFR Veteran
 
PrawnSkunk's Avatar
 
Join Date: Dec 2007
Location: Vancouver, BC
Age: 29
Posts: 3,902
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

Quote:
Originally Posted by storn42 View Post
so, what are the cut-offs for each division based on skill rating. i'd go look through the leaderboards but ffr is being really slow. i blame the hype train.
The boundaries are currently 0/2300/4700/5600/6450/7630/8650 for each respective division -- However these numbers are not final, and will change as the skill rating formula evolves over time. As I receive feedback and suggestions, I will manually adjust the cutoff for each division.
PrawnSkunk is offline   Reply With Quote
Old 02-16-2015, 08:27 PM   #14
TheSaxRunner05
The Doctor
FFR Veteran
 
TheSaxRunner05's Avatar
 
Join Date: Apr 2006
Age: 35
Posts: 6,145
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

Quick, someone go out and get 29 clean on RATO
__________________


TheSaxRunner05 is offline   Reply With Quote
Old 02-16-2015, 08:27 PM   #15
Charu
Snivy! Dohoho!
FFR Simfile AuthorFFR Veteran
 
Charu's Avatar
 
Join Date: Mar 2006
Age: 33
Posts: 6,161
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

I was totally expecting that new site layout, dang it.

Oh well, I guess this is sort of cool too!
__________________


Quote:
Originally Posted by JohnRedWolf87 View Post
Charu the red-nosed Snivy
Had a very shiny nose
And if you ever saw it
You could even say it glows

All of the other Snivies
Used to laugh and call him names
They never let poor Charu
Join in any Snivy games

(Click the arrow to see the rest)


Quote:
Originally Posted by Vendetta21 View Post
All in all I would say that Charu not only won this game, his play made me reconsider how I play it.
Charu is offline   Reply With Quote
Old 02-16-2015, 08:29 PM   #16
TheSaxRunner05
The Doctor
FFR Veteran
 
TheSaxRunner05's Avatar
 
Join Date: Apr 2006
Age: 35
Posts: 6,145
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

I would be more impressed with the daily stats page if it kept track of how many times you had made the list

And then make a leaderboard for that too, even if it's just for the GT stat (most AAAs would just be an excite bike fest)
__________________


TheSaxRunner05 is offline   Reply With Quote
Old 02-16-2015, 08:30 PM   #17
Charu
Snivy! Dohoho!
FFR Simfile AuthorFFR Veteran
 
Charu's Avatar
 
Join Date: Mar 2006
Age: 33
Posts: 6,161
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

Also, our skill rank isn't displayed when browsing forums. Just FYI!!!
__________________


Quote:
Originally Posted by JohnRedWolf87 View Post
Charu the red-nosed Snivy
Had a very shiny nose
And if you ever saw it
You could even say it glows

All of the other Snivies
Used to laugh and call him names
They never let poor Charu
Join in any Snivy games

(Click the arrow to see the rest)


Quote:
Originally Posted by Vendetta21 View Post
All in all I would say that Charu not only won this game, his play made me reconsider how I play it.
Charu is offline   Reply With Quote
Old 02-16-2015, 08:30 PM   #18
Guest15937
One-handed elite
FFR Veteran
 
Guest15937's Avatar
 
Join Date: May 2008
Posts: 1,464
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

Is there any way to see your best 4 scores?
__________________
The renegade has betrayed me.
Guest15937 is offline   Reply With Quote
Old 02-16-2015, 08:34 PM   #19
PrawnSkunk
Administrator
User Administrator
AdministratorDeveloperFFR Simfile AuthorFFR Veteran
 
PrawnSkunk's Avatar
 
Join Date: Dec 2007
Location: Vancouver, BC
Age: 29
Posts: 3,902
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

Quote:
Originally Posted by Guest15937 View Post
Is there any way to see your best 4 scores?
That's a great suggestion! The next feature I would like to finish is a complete stat breakdown page, expanding beyond your top 4 scores so it is not a mystery how you can improve your rating.
PrawnSkunk is offline   Reply With Quote
Old 02-16-2015, 08:41 PM   #20
TheSaxRunner05
The Doctor
FFR Veteran
 
TheSaxRunner05's Avatar
 
Join Date: Apr 2006
Age: 35
Posts: 6,145
Default Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

I'd like to see the regional leaderboards extended to 20 or 25
__________________


TheSaxRunner05 is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump



All times are GMT -5. The time now is 05:10 AM.


Powered by vBulletin® Version 3.8.1
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Copyright FlashFlashRevolution