Skill Rating & Leaderboards Discussion [Updated Oct 16]

Collapse
This is a sticky topic.
X
X
 
  • Time
  • Show
Clear All
new posts
  • PrawnSkunk
    Administrator
    FFR Simfile Author
    FFR Administrator
    • Dec 2007
    • 3907

    #1

    Skill Rating & Leaderboards Discussion [Updated Oct 16]

    What is Skill Rating?

    Skill Rating is a ranking metric aimed at determining the actual skill of a player based on their performance on any song in-game.

    The Skill Rating formula was designed by Trumpet63, PrawnSkunk, and Silvuh. The project has undergone numerous iterations since its inception in February 2015, and continues to evolve.


    Increasing Your Level

    Your Level/Skill Rating is an exponentially weighted average of your top fifteen scores. Your personal best score matters the most (24.04%), and your fifteenth best score matters the least (0.17%). Your rating for each song is determined by the “AAA equivalency” formula.


    The AAA Equivalency Formula



    … Or essentially, X number of goods on Y difficulty is equivalent to a perfect score on Z difficulty.


    The above graph describes the relationship between AAA equivalent and raw score. However unlike the previous formula, your rating is now scaled by difficulty as well as good count. Crossing into the third dimension allows the Skill Rating formula to calculate AAA equivalent scores with greater than 28 goods, and in some cases, well over 1000 goods:


    The constants used are the result of applying a learning algorithm to a set of data points accumulated by the Official Tournament division placement team and other community members.




    To-Do List: Feature Requests

    Levelrank breakdown page of your top 50 scores.
    Make skill rating levelranks publicly searchable.
    Expand scope of skill rating beyond your top 4 scores.
    • Distinguish inactive users from active users.
    • Add skill points section on results screen in R^3 for every score.


    Changelog

    February 16th, 2015
    • Skill Rating and Global Leaderboards released.

    February 17th, 2015
    • Skill Rating levelranks released.

    April 2nd, 2015
    • Skill Rating levelranks are now publicly searchable

    April 3rd, 2015
    • Skill Rating now includes token songs.

    October 1st, 2015
    • Skill Rating v2 released.

    October 16th, 2016
    • Skill Rating v3 released.
    • D7 cutoff raised to Lv.95

    What is Skill Rating?

    Skill Rating is a new skill-based ranking system designed by Trumpet63, Silvuh and PrawnSkunk that assigns a rating to each player based on their performance on public songs. The following graph describes the relationship between the number of goods in a score and how well the difficulty of the song represents your skill:



    This formula was created using data accumulated by the Official Tournament division placement team. Using this information, each qualifying score with less than 28 goods can be changed into a AAA-equivalent score, giving you the difficulty of the song on which you have essentially played with 0 goods. This difficulty is multiplied by one hundred to yield your rating.

    Your final rating is calculated by sum of your four best scores (0.4*A+0.3*B+0.2*C+0.1*D), where A is your best score. There are plans to expand the influence of your rating beyond your four best scores. There is no way to reduce your rating, unless the difficulty of one of your top 4 songs is lowered, or you record a better combo score.







    Skill Rating by Jeffrey Spreng, Max Proske, and Silvuh Ryvinia is licensed under a
    Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License
    based on work at http://www.flashflashrevolution.com/leaderboards
    Last edited by PrawnSkunk; 07-5-2020, 03:57 PM.
  • YoshL
    Celestial Harbor
    FFR Simfile Author
    FFR Music Producer
    • Aug 2008
    • 6156

    #2
    Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

    alot less skill debating tyvm


    Originally posted by Charu
    Only yours, for an easy price of $19.99! You too can experience the wonders of full motion rump sticking.

    Comment

    • blanky!
      Banned
      • Jan 2015
      • 164

      #3
      Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

      I love the mathematical/statistical aspects of this.

      Finally some SCIENCE

      Comment

      • Guest15937
        One-handed elite
        • May 2008
        • 1464

        #4
        Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

        And yet, no raw scoring
        The renegade has betrayed me.

        Comment

        • ilikexd
          FFR Simfile Author
          • Apr 2006
          • 3208

          #5
          Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

          i am now d6

          Comment

          • Ohaider
            FFR Veteran
            • Jun 2012
            • 2893

            #6
            Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

            maths

            Comment

            • Rapta
              🡸Index🡻Is🡹Fun!🡺
              Profile Moderator
              FFR Simfile Author
              Global Moderator
              • Dec 2010
              • 1948

              #7
              Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

              Suggestion: Add a place to view top 1000 ranks if that isn't there

              Edit: Found it!
              Last edited by Rapta; 02-16-2015, 07:38 PM.
              Old Quotes
              Originally posted by IwasAsquidOnce
              Note the left hand pinky. It stretches out into attack mode to make etienne's hand appear larger, an intimidation technique for the arrows.
              Originally posted by Mourningfall
              [3:51 PM] Mourningfall: i spent the second half of that song getting face fucked by a fly
              Originally posted by Xiz
              Hi I see rapta come play TWG next game
              Originally posted by xXOpkillerXx
              Rapta thinks alot about memes and fonts. I'd be inclined to think he's town because wolves wouldn't have time to meme would they ?
              Originally posted by Prawnskunk
              if we keep releasing engines that work on 1/4 of people's computers, we'll get there
              Originally posted by gold stinger
              do u even agrabah
              Originally posted by gold stinger
              Today at 12:53 AM
              I have no fucking idea how you were able to identify that specific line from meme show so you are basically an elder god of memes
              Originally posted by Psychotik
              When I think Mother’s Day, I think Venetian Snares.
              Originally posted by Haku
              have you heard someone mention eating pancakes to negate friday 13th?




              Originally posted by Prawnskunk at 10:53:56pm on 10/26/11
              OMFG VC! I want your programming fingers in or around my mouth OnO
              Originally posted by Storn at 3:03 PM
              We have so many batches open. Its like a backlog clearance sale. ALL FILES MUST GO!!
              Originally posted by ToonE156 at 11:07 PM
              You've never felt intimacy until you've practiced Jiu Jitsu ground techniques with the only girl in class

              Comment

              • storn42
                RIP Storn D0-D0
                FFR Simfile Author
                • Jun 2012
                • 3473

                #8
                Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

                so, what are the cut-offs for each division based on skill rating. i'd go look through the leaderboards but ffr is being really slow. i blame the hype train.


                Originally posted by Xiz
                "I think storn is town but he doesn't have a shirt on" - Roundbox
                Originally posted by the sun fan
                I have beat my meat to storn's posts no less than four times


                Originally posted by ShadoWolfe


                Comment

                • Mahou
                  魔法少女
                  • Jan 2006
                  • 2153

                  #9
                  Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

                  I will be happy to compete in d5 for the 11th official.
                  Originally posted by lofty rhino
                  one does not simply hate everyone that plays stepmania
                  AND watch anime.

                  Comment

                  • kmay
                    Don't forget me
                    • Jan 2007
                    • 6523

                    #10
                    Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

                    went from av rank 50th to 245...


                    looks like no one even tries to AAA the old easy songs anymore =[

                    Comment

                    • Kawaii025
                      Fake D4
                      • Jun 2007
                      • 1404

                      #11
                      Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

                      Good gravy there are a lot of people looking at this thread... :P

                      Anyways, I'm curious about something; so does the Skill Bracket mean that's your official division for tournaments and stuff? Has the skill bracket requirements changed?
                      My List of FFR Tournaments
                      Pre-10/16/16
                      Highest AAA: Connect (HOUSE SOUL REMIX) & Case Closed (54)
                      Highest Blackflag: Survive (60)
                      Highest FC: Challenge the final mission! (68)
                      Highest SDG: The Fusion (63)
                      Otaku Speedvibe [Heavy] unlocked 03/04/15 - On The Origin of Species (Evolution) (50)

                      Highest AAA:Case Closed (58)
                      Highest Blackflag: Survive (58)
                      Highest Booflag: Fill Me Up With Snacky Happiness & Suit Up (55)
                      Highest FC: Challenge the final mission! (72)
                      Highest SDG: The Fusion (67)

                      Comment

                      • TheSaxRunner05
                        The Doctor
                        • Apr 2006
                        • 6144

                        #12
                        Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

                        It's not based on average rank anymore, just your best 4 scores.


                        Comment

                        • PrawnSkunk
                          Administrator
                          FFR Simfile Author
                          FFR Administrator
                          • Dec 2007
                          • 3907

                          #13
                          Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

                          Originally posted by storn42
                          so, what are the cut-offs for each division based on skill rating. i'd go look through the leaderboards but ffr is being really slow. i blame the hype train.
                          The boundaries are currently 0/2300/4700/5600/6450/7630/8650 for each respective division -- However these numbers are not final, and will change as the skill rating formula evolves over time. As I receive feedback and suggestions, I will manually adjust the cutoff for each division.

                          Comment

                          • TheSaxRunner05
                            The Doctor
                            • Apr 2006
                            • 6144

                            #14
                            Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

                            Quick, someone go out and get 29 clean on RATO


                            Comment

                            • Charu
                              Snivy! Dohoho!
                              FFR Simfile Author
                              • Mar 2006
                              • 6161

                              #15
                              Re: Skill Rating & Leaderboards Discussion [Updated Feb 16]

                              I was totally expecting that new site layout, dang it.

                              Oh well, I guess this is sort of cool too!


                              Originally posted by JohnRedWolf87
                              Charu the red-nosed Snivy
                              Had a very shiny nose
                              And if you ever saw it
                              You could even say it glows

                              All of the other Snivies
                              Used to laugh and call him names
                              They never let poor Charu
                              Join in any Snivy games

                              (Click the arrow to see the rest)


                              Originally posted by Vendetta21
                              All in all I would say that Charu not only won this game, his play made me reconsider how I play it.

                              Comment

                              Working...