New Skill Analysis Metric (Trial Phase)

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • #46
    Mostly Ignored
    Trumpet63
    • Mar 2011
    • 570

    Re: New Skill Analysis Metric (Trial Phase)

    That's everyone!
    EDIT: No, actually it's not


    Z-Score = 71.06
    Z-Score Scaled = 77.45


    Z-Score = 74.65
    Z-Score Scaled = 92.45


    Z-Score = 69.62
    Z-Score Scaled = 90.00


    Z-Score = 72.82
    Z-Score Scaled = 85.44


    Z-Score = 86.24
    Z-Score Scaled = 85.42


    Z-Score = 77.15
    Z-Score Scaled = 79.45


    Z-Score = 74.37
    Z-Score Scaled = 88.55


    Z-Score = 74.50
    Z-Score Scaled = 91.75


    Z-Score = 64.86
    Z-Score Scaled = 66.73


    Z-Score = 77.12
    Z-Score Scaled = 75.03
    Last edited by Trumpet63; 10-2-2014, 09:17 PM.
    2014 October 7th 1:03 AM

    Zageron: Trumpet
    Trumpet63: yes, im here
    Zageron: You have a problem.

    Comment

    • #47
      Anime Avatars ( ◜◡^)っ✂╰⋃╯
      FFR Simfile Author
      One Winged Angel
      • Mar 2007
      • 10936

      Re: New Skill Analysis Metric (Trial Phase)

      Very neat.

      Just noticed one thing after looking at a few of the curves -- partial and failed runs on files are being taken in account. Like AlphaWolf for instance, his 265-2-0-1-1 on La Camp is being valued the same as 2-0-1-1 on the full file, leading to his scaled Z-score of 90.


      Originally posted by ilikexd
      i want to be cucked by cirno

      Comment

      • #48
        Mostly Ignored
        Trumpet63
        • Mar 2011
        • 570

        Re: New Skill Analysis Metric (Trial Phase)

        Originally posted by One Winged Angel
        Very neat.

        Just noticed one thing after looking at a few of the curves -- partial and failed runs on files are being taken in account. Like AlphaWolf for instance, his 265-2-0-1-1 on La Camp is being valued the same as 2-0-1-1 on the full file, leading to his scaled Z-score of 90.
        Yep, that's a "known issue". thank you for pointing out this instance of it, because it will probably be used in analysis. I or Silvuh will grab a list of note totals in the future and make a change in the formula to remove incomplete scores.
        2014 October 7th 1:03 AM

        Zageron: Trumpet
        Trumpet63: yes, im here
        Zageron: You have a problem.

        Comment

        • #49
          Mostly Ignored
          Trumpet63
          • Mar 2011
          • 570

          Re: New Skill Analysis Metric (Trial Phase)

          Alright! I'm caught up


          Z-Score = 68.92
          Z-Score Scaled = 82.27


          Z-Score = 71.61
          Z-Score Scaled = 74.44


          Z-Score = 34.28
          Z-Score Scaled = 48.66


          Z-Score = 88.93
          Z-Score Scaled = 87.00


          Z-Score = 74.61
          Z-Score Scaled = 84.93


          Z-Score = 78.05
          Z-Score Scaled = 84.16


          Z-Score = 52.72
          Z-Score Scaled = 60.39


          Z-Score = 68.35
          Z-Score Scaled = 70.21


          Z-Score = 43.08
          Z-Score Scaled = 55.90
          Last edited by Trumpet63; 10-2-2014, 10:11 PM.
          2014 October 7th 1:03 AM

          Zageron: Trumpet
          Trumpet63: yes, im here
          Zageron: You have a problem.

          Comment

          • #50
            Nope
            FFR Simfile Author
            Poison-
            • Nov 2010
            • 3785

            Re: New Skill Analysis Metric (Trial Phase)

            Apparently I'm almost as good as Kevin's Weeney
            Last edited by Poison-; 10-2-2014, 10:16 PM.

            Comment

            • #51
              FFR Veteran
              FFR Simfile Author
              ~Zero~
              • Nov 2006
              • 1557

              Re: New Skill Analysis Metric (Trial Phase)

              I would like to see mine as well. Please and thank you.


              Originally posted by Xiaounlimited
              More like Tier ~0~

              Comment

              • #52
                Mostly Ignored
                Trumpet63
                • Mar 2011
                • 570

                Re: New Skill Analysis Metric (Trial Phase)

                Here ya go!

                Z-Score = 70.14
                Z-Score Scaled = 85.68
                Last edited by Trumpet63; 10-2-2014, 10:39 PM.
                2014 October 7th 1:03 AM

                Zageron: Trumpet
                Trumpet63: yes, im here
                Zageron: You have a problem.

                Comment

                • #53
                  Mostly Ignored
                  Trumpet63
                  • Mar 2011
                  • 570

                  Re: New Skill Analysis Metric (Trial Phase)

                  Okay, let's start some analysis! Silvuh, if you want to try adding another column to this with one of your formulas, be my guest. I think I'm done for tonight.
                  Last edited by Trumpet63; 10-2-2014, 11:16 PM.
                  2014 October 7th 1:03 AM

                  Zageron: Trumpet
                  Trumpet63: yes, im here
                  Zageron: You have a problem.

                  Comment

                  • #54
                    remederpin
                    remedy1502
                    • Feb 2007
                    • 4936

                    Re: New Skill Analysis Metric (Trial Phase)

                    What's the difference between the Zenith score and scaled?

                    lol this table

                    Comment

                    • #55
                      Mostly Ignored
                      Trumpet63
                      • Mar 2011
                      • 570

                      Re: New Skill Analysis Metric (Trial Phase)

                      Originally posted by remedy1502
                      What's the difference between the Zenith score and scaled?
                      It is a difference in how the calculated weights are used. The standard Zenith Score takes the sum of the weights within a difficulty, while the scaled takes the average. These values are seen in the y-axis. Visit the OP for a better explanation of the calculated weights.

                      More specifically, the scaled represents your average good count among songs that you have less than 20 goods in (with higher values representing a better score).
                      Last edited by Trumpet63; 10-2-2014, 11:03 PM.
                      2014 October 7th 1:03 AM

                      Zageron: Trumpet
                      Trumpet63: yes, im here
                      Zageron: You have a problem.

                      Comment

                      • #56
                        remederpin
                        remedy1502
                        • Feb 2007
                        • 4936

                        Re: New Skill Analysis Metric (Trial Phase)

                        Originally posted by Trumpet63
                        It is a difference in how the calculated weights are used. The standard Zenith Score takes the sum of the weights within a difficulty, while the scaled takes the average. These values are seen in the y-axis. Visit the OP for a better explanation of the calculated weights.
                        Word. Also my stuff if you want to use it in the table you just posted above:

                        Z-score: 70.9897914
                        Scaled: 79.3884094
                        D6

                        Comment

                        • #57
                          Mostly Ignored
                          Trumpet63
                          • Mar 2011
                          • 570

                          Re: New Skill Analysis Metric (Trial Phase)

                          I guess I'm not done tonight. Here's some minor analysis on the table of players. It seems the scaled version is better than I thought!

                          2014 October 7th 1:03 AM

                          Zageron: Trumpet
                          Trumpet63: yes, im here
                          Zageron: You have a problem.

                          Comment

                          • #58
                            Buh
                            Kanzas
                            • Jul 2014
                            • 1523

                            Re: New Skill Analysis Metric (Trial Phase)

                            Very interesting.




                            Top 5
                            Pimp Slap - 7-0-0-1
                            party 4u "holy nite mix" v2 - 5-0-1-2
                            Fei Longer - AAA
                            HELLBEAT - 9-0-1-3
                            Flame Repellent - 5-0-0-0

                            Comment

                            • #59
                              Mostly Ignored
                              Trumpet63
                              • Mar 2011
                              • 570

                              Re: New Skill Analysis Metric (Trial Phase)

                              Originally posted by Untimely Friction
                              TIL I'm d6 by 0.19... value... on the scaled zenith curb 8)
                              To be fair, the scales are based on the sample, so it's more like you're 0.19 from the lowest person in D6 for whom we have data. Oh, and you're referencing the 74.25 "Combined by Average" number? That is an amalgamation of the regular and the scaled, and it's not on the table. So, you'd have to compare your 74.44 with the 76.12. (I used the word average on the table to mean something else. Sorry it was misleading)

                              Also, Zenith Score is in units of difficulty... so, you are now 1.68... difficulties... away?

                              I should add, if you're curious you can compare yourself to others in your division (who are not listed here) using the link in the OP, if you have Excel.
                              2014 October 7th 1:03 AM

                              Zageron: Trumpet
                              Trumpet63: yes, im here
                              Zageron: You have a problem.

                              Comment

                              • #60
                                quit
                                FFR Simfile Author
                                FFR Music Producer
                                Silvuh
                                • Apr 2005
                                • 938

                                Re: New Skill Analysis Metric (Trial Phase)

                                Yeah, I touched on the incomplete play issue earlier but didn't want to collect all the notecounts at the time. But I finally got this. (I started working at like 10:30, haha, and now I see I missed a few posts in here, welp!) Anyway, download link is the same.

                                zenith-score.xlsx

                                Writing a script to collect all the FFR file notecounts was much easier than trying to figure out how to get Excel's alphabetical sort to match FFR's, which ... I wasn't able to do, haha.

                                So there's a few more steps than before now:

                                1. Copy table data from levelrank.php
                                2. Sheet1!A1 should already be selected, so paste your data into the spreadsheet.
                                3. The pasted data will be selected, so you can go to Sort & Filter > Custom Sort
                                4. Sort by Level on Values with order A to Z so the note counts match up properly.
                                5. Enter Sheet2 to find your results.

                                The scaled score now divides by all completely played files of that difficulty. This does mean I'll have to update the spreadsheet every time new songs are uploaded, but that won't be a problem for me to do.

                                EDIT:

                                Oh, one thing you can add to your table is just a column of like (if the Google sheet uses the same notation as Excel)

                                =IF(ISBLANK(D2)=FALSE,D2=IF(C2<20,"D1",IF(C2<40,"D2",IF(C2<50,"D3",IF(C2<60,"D4",IF(C2<70,"D5",IF(C2<80,"D6","D7")))))),"")

                                filled down. First it checks if a user has an Actual Division Placement, outputs nothing if false, then assigns the scaled score to a division and checks if it's the same as the ADP, outputting TRUE or FALSE. Maybe you already did something like that for your table in post 57 though.

                                Oh, and just to say again, some version of the scaled score will definitely be more accurate, because the score is dependent on one's Best Difficulty. Like, a D7 player's Best Difficulty should not be 64, so the original score underestimates their skill.
                                Last edited by Silvuh; 10-3-2014, 03:25 AM.

                                Comment

                                Working...