Automated division placer (Levelrank analyzer redux)

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • Guest15937
    One-handed elite
    • May 2008
    • 1464
    #1

    Automated division placer (Levelrank analyzer redux)

    I said I would do it, and I did, and here it is

    What you will need:
    The Code
    List of all in-game files and their notecounts NOTE: THIS MUST BE IN THE SAME FOLDER AS THE CODE OR ELSE IT WILL NOT WORK (well, it might, but it will record a 1-0-0-0-0 as a AAA so it's unreliable without it)
    Necessary tools to run Java files (unfortunate, but unless I redid the whole thing in Python, unavoidable)

    To run:

    Paste the levelranks of the desired player into a text file called "Levelrank.txt" and save it in the same folder as the other two files.
    Run the program. It will output a file called "DivisionPlacement.txt" which will contain the results of the program.


    How it works:

    Basically the same as my levelrank analyzer, except for a few additions:

    After getting the AAAeq's of the levelrank, it looks at the top four songs.

    If any of the top 3 scores are 5% or more greater than the 4th place score, they are labeled as "outliers" and discounted.

    Then, the program uses the #1 remaining score to place the user into a division based on the following:

    90+ = D7
    80-90 = D6
    70-80 = D5
    60-70 = D4
    50-60 = D3
    30-50 = D2
    <30 = D1

    It also records the number of outliers.

    Sample Output:

    Outliers: 0
    Division: D3

    What I've noticed: Despite the slightly looser division requirements in comparison to Prawn's tool, it actually tends to place players slightly HIGHER than the tool, because it notices and uses scores such as teens or 20s goods on high songs that are passed over by Prawn's tool, which only notices SDGs or below.

    Anyway, here you go for you tourney hosts out there
    The renegade has betrayed me.
    Tags: None
    • XelNya
      [Kaho]
      FFR Simfile Author
      • Sep 2012
      • 3368
      #2
      Re: Automated division placer (Levelrank analyzer redux)

      My immediate question is did you factor in token ranks?

      Because if not, your program is extremely flawed. My best score (on this account) is arguably my AAA of Minute Waltz V2. That song is in token ranks and not the public ones. (Assuming I can remember things properly.)

      Just a curiosity I have, because if I were to use it, it would certainly need that.
      Last edited by XelNya; 09-10-2014, 08:10 PM.

        Comment

        • Guest15937
          One-handed elite
          • May 2008
          • 1464
          #3
          Re: Automated division placer (Levelrank analyzer redux)

          You can use them (if you have them...they're not in levelranks) but the song masterlist doesn't include them so you'd have the 1-0-0-0-0 = AAA problem.

          So no, it's not really built for it.
          The renegade has betrayed me.

            Comment

            • TC_Halogen
              Rhythm game specialist.
              FFR Simfile Author
              FFR Music Producer
              • Feb 2008
              • 19376
              #4
              Re: Automated division placer (Levelrank analyzer redux)

              Originally posted by Guest15937
              What I've noticed: Despite the slightly looser division requirements in comparison to Prawn's tool, it actually tends to place players slightly HIGHER than the tool, because it notices and uses scores such as teens or 20s goods on high songs that are passed over by Prawn's tool, which only notices SDGs or below.

              Anyway, here you go for you tourney hosts out there
              For the record, this is completely inaccurate.

              also:

              If any of the top 3 scores are 5% or more greater than the 4th place score, they are labeled as "outliers" and discounted.

              Then, the program uses the #1 remaining score to place the user into a division based on the following:

              90+ = D7
              80-90 = D6
              70-80 = D5
              60-70 = D4
              50-60 = D3
              30-50 = D2
              <30 = D1
              Assuming that there are four scores that are within a certain range by your difficulty placement, there is a potential for [Heavy] gets in D2, Scarhand [Standard] gets in D3, [Oni] gets in D4, and Scarhand [Heavy] gets in D5. Additionally, this also underestimates D7 players, which are usually placed in D7 with their best scores falling in the upper 80s. A typical metric for my D7 placement is 88 AAA, 87 AAA with some higher SDGs, 86 AAA with consistency from 77-85 FGOs, or extremely good non-AAAs that are 91+.

              Assigning a simple arbitrary range is not going bode well, especially because this fixates heavily on AAAs.

              If any of the top 3 scores are 5% or more greater than the 4th place score, they are labeled as "outliers" and discounted.
              This is also a bit strange to me -- throwing away the top 3 scores is risky if those scores are substantially higher AAAs compared to what the 4th place result is as well.

              There are a lot of inherent flaws with this program. Also, what Prawn's placement tool does that this one does not (which I feel is important) is that it actually weighs multiple things at the same time, not a single thing exclusively. There are various flags that are compared against the level ranks, and there could easily be more to come.
              Last edited by TC_Halogen; 09-10-2014, 08:41 PM.

                Comment

                • choof
                  Banned
                  FFR Simfile Author
                  • Nov 2013
                  • 8563
                  #5
                  Re: Automated division placer (Levelrank analyzer redux)

                  goddamnit aj this analyzer put me into d6 and you had to go and ruin my dreamz....

                    Comment

                    • Guest15937
                      One-handed elite
                      • May 2008
                      • 1464
                      #6
                      Re: Automated division placer (Levelrank analyzer redux)

                      wait...is prawn's tool something else from what I was hearing about?

                      because i thought it was this...

                      And the outlier stuff is meant to protect against stuff like zageron AAA'ing aim while the rest of his scores are D3 tier. Stuff like [heavy] gets in D2 would only happen if the [heavy]-obtaining score is not just stronger, but disproportionately stronger, than the rest of their scores. (basically, it's a "this player is absurdly good at [insert pattern here] compared to every other pattern" protection)
                      Last edited by Guest15937; 09-10-2014, 09:14 PM.
                      The renegade has betrayed me.

                        Comment

                        • TC_Halogen
                          Rhythm game specialist.
                          FFR Simfile Author
                          FFR Music Producer
                          • Feb 2008
                          • 19376
                          #7
                          Re: Automated division placer (Levelrank analyzer redux)

                          Originally posted by Guest15937
                          wait...is prawn's tool something else from what I was hearing about?

                          because i thought it was this...

                          And the outlier stuff is meant to protect against stuff like zageron AAA'ing aim while the rest of his scores are D3 tier. Stuff like [heavy] gets in D2 would only happen if the [heavy]-obtaining score is not just stronger, but disproportionately stronger, than the rest of their scores. (basically, it's a "this player is absurdly good at [insert pattern here] compared to every other pattern" protection)
                          Your next issue then comes when a player happens to be a hybrid-advantaged player of sorts and they get absurd scores because they have an innate ability to do one skill while sufficiently being able to do another. Take someone who AAAs Turbo, Tell v3 (not public, but still), Club, and AIM Anthem, which from highest to lowest has a span of 17 points (easily more than a full division level). What happens if their AAAs get nullified down to the lowest one in this set, but they show a proficiency in files like... La Campanella, or Magical 8 bit tour? It would be fair to assume a player that is decent at jacks is likely also good at trills since in physicality, trills are just offset jacks.

                          (playing devil's advocate for an analysis tool is a great way to improve it, by the way. )

                            Comment

                            • Guest15937
                              One-handed elite
                              • May 2008
                              • 1464
                              #8
                              Re: Automated division placer (Levelrank analyzer redux)

                              Those four alone would put the player in D5, and if the player is good in La Camp or 8bit, there scores on those files would probably rank in the 70s, if not 80s, in any rate. Remember that this program gives a value for EVERY song (even failed songs), so if a player does well on a song, they'll have a high value on it.

                              (I just calced it. Even a 100g score on 8bit tour is a 70.3.)

                              P.S. Jacks are my best pattern, and trills are my worst. So good at jacks doesn't always mean good at trills. :P
                              Last edited by Guest15937; 09-10-2014, 09:36 PM.
                              The renegade has betrayed me.

                                Comment

                                • Chocille
                                  FFR Player
                                  • Jun 2013
                                  • 135
                                  #9
                                  Re: Automated division placer (Levelrank analyzer redux)

                                  If only you were able to set a course like IIDX's Dan courses huhuhu

                                    Comment

                                    • YoshL
                                      Celestial Harbor
                                      FFR Simfile Author
                                      FFR Music Producer
                                      • Aug 2008
                                      • 6156
                                      #10
                                      Re: Automated division placer (Levelrank analyzer redux)

                                      Originally posted by TC_Halogen
                                      Your next issue then comes when a player happens to be a hybrid-advantaged player of sorts and they get absurd scores because they have an innate ability to do one skill while sufficiently being able to do another. Take someone who AAAs Turbo, Tell v3 (not public, but still), Club, and AIM Anthem, which from highest to lowest has a span of 17 points (easily more than a full division level). What happens if their AAAs get nullified down to the lowest one in this set, but they show a proficiency in files like... La Campanella, or Magical 8 bit tour? It would be fair to assume a player that is decent at jacks is likely also good at trills since in physicality, trills are just offset jacks.

                                      (playing devil's advocate for an analysis tool is a great way to improve it, by the way. )
                                      Originally posted by Guest15937
                                      Those four alone would put the player in D5, and if the player is good in La Camp or 8bit, there scores on those files would probably rank in the 70s, if not 80s, in any rate. Remember that this program gives a value for EVERY song (even failed songs), so if a player does well on a song, they'll have a high value on it.

                                      (I just calced it. Even a 100g score on 8bit tour is a 70.3.)

                                      P.S. Jacks are my best pattern, and trills are my worst. So good at jacks doesn't always mean good at trills. :P
                                      are you talking about me? cause i remember you ran the thing on my ranks and la camp was a funny outlier lol

                                      take this scenario.
                                      a player plays songs and quits out at the first miss because they only want FCs. They spend a huge amount of time nailing a 83 AAA which is like instant D6. their best AAAs besides that are 60-70 because they can't be bothered to try hard on songs they don't like. if you throw away that "outlier", then welp you just put a D4 player in D6

                                      it's not about the score being an outlier, it's what song the supposed "outlier" is on. I could have like 250 plays on an account and get sightread AAAs on everything, with like 249 on difficulty 20 and under, and 1 70, and then i'd get put in D2 by your system?


                                      Originally posted by Charu
                                      Only yours, for an easy price of $19.99! You too can experience the wonders of full motion rump sticking.

                                        Comment

                                        Previous template Next
                                        Working...