New Skill Analysis Metric (Trial Phase)

[Trumpet63]

Re: New Skill Analysis Metric (Trial Phase)

That's everyone!
EDIT: No, actually it's not


Z-Score = 71.06
Z-Score Scaled = 77.45


Z-Score = 74.65
Z-Score Scaled = 92.45


Z-Score = 69.62
Z-Score Scaled = 90.00


Z-Score = 72.82
Z-Score Scaled = 85.44


Z-Score = 86.24
Z-Score Scaled = 85.42


Z-Score = 77.15
Z-Score Scaled = 79.45


Z-Score = 74.37
Z-Score Scaled = 88.55


Z-Score = 74.50
Z-Score Scaled = 91.75


Z-Score = 64.86
Z-Score Scaled = 66.73


Z-Score = 77.12
Z-Score Scaled = 75.03

[One Winged Angel]

Re: New Skill Analysis Metric (Trial Phase)

Very neat.

Just noticed one thing after looking at a few of the curves -- partial and failed runs on files are being taken in account. Like AlphaWolf for instance, his 265-2-0-1-1 on La Camp is being valued the same as 2-0-1-1 on the full file, leading to his scaled Z-score of 90.

[Trumpet63]

Re: New Skill Analysis Metric (Trial Phase)

Very neat.

Just noticed one thing after looking at a few of the curves -- partial and failed runs on files are being taken in account. Like AlphaWolf for instance, his 265-2-0-1-1 on La Camp is being valued the same as 2-0-1-1 on the full file, leading to his scaled Z-score of 90.

Yep, that's a "known issue". thank you for pointing out this instance of it, because it will probably be used in analysis. I or Silvuh will grab a list of note totals in the future and make a change in the formula to remove incomplete scores.

[Trumpet63]

Re: New Skill Analysis Metric (Trial Phase)

Alright! I'm caught up


Z-Score = 68.92
Z-Score Scaled = 82.27


Z-Score = 71.61
Z-Score Scaled = 74.44


Z-Score = 34.28
Z-Score Scaled = 48.66


Z-Score = 88.93
Z-Score Scaled = 87.00


Z-Score = 74.61
Z-Score Scaled = 84.93


Z-Score = 78.05
Z-Score Scaled = 84.16


Z-Score = 52.72
Z-Score Scaled = 60.39


Z-Score = 68.35
Z-Score Scaled = 70.21


Z-Score = 43.08
Z-Score Scaled = 55.90

[Poison-]

Re: New Skill Analysis Metric (Trial Phase)

Apparently I'm almost as good as Kevin's Weeney

[~Zero~]

Re: New Skill Analysis Metric (Trial Phase)

I would like to see mine as well. Please and thank you.

[Trumpet63]

Re: New Skill Analysis Metric (Trial Phase)

Here ya go!

Z-Score = 70.14
Z-Score Scaled = 85.68

[Trumpet63]

Re: New Skill Analysis Metric (Trial Phase)

Okay, let's start some analysis! Silvuh, if you want to try adding another column to this with one of your formulas, be my guest. I think I'm done for tonight.

[remedy1502]

Re: New Skill Analysis Metric (Trial Phase)

What's the difference between the Zenith score and scaled?

lol this table

[Trumpet63]

Re: New Skill Analysis Metric (Trial Phase)

What's the difference between the Zenith score and scaled?

It is a difference in how the calculated weights are used. The standard Zenith Score takes the sum of the weights within a difficulty, while the scaled takes the average. These values are seen in the y-axis. Visit the OP for a better explanation of the calculated weights.

More specifically, the scaled represents your average good count among songs that you have less than 20 goods in (with higher values representing a better score).

[remedy1502]

Re: New Skill Analysis Metric (Trial Phase)

It is a difference in how the calculated weights are used. The standard Zenith Score takes the sum of the weights within a difficulty, while the scaled takes the average. These values are seen in the y-axis. Visit the OP for a better explanation of the calculated weights.

Word. Also my stuff if you want to use it in the table you just posted above:

Z-score: 70.9897914
Scaled: 79.3884094
D6

[Trumpet63]

Re: New Skill Analysis Metric (Trial Phase)

I guess I'm not done tonight. Here's some minor analysis on the table of players. It seems the scaled version is better than I thought!

[Kanzas]

Re: New Skill Analysis Metric (Trial Phase)

Very interesting.

[Trumpet63]

Re: New Skill Analysis Metric (Trial Phase)

TIL I'm d6 by 0.19... value... on the scaled zenith curb 8)

To be fair, the scales are based on the sample, so it's more like you're 0.19 from the lowest person in D6 for whom we have data. Oh, and you're referencing the 74.25 "Combined by Average" number? That is an amalgamation of the regular and the scaled, and it's not on the table. So, you'd have to compare your 74.44 with the 76.12. (I used the word average on the table to mean something else. Sorry it was misleading)

Also, Zenith Score is in units of difficulty... so, you are now 1.68... difficulties... away?

I should add, if you're curious you can compare yourself to others in your division (who are not listed here) using the link in the OP, if you have Excel.

[Silvuh]

Re: New Skill Analysis Metric (Trial Phase)

Yeah, I touched on the incomplete play issue earlier but didn't want to collect all the notecounts at the time. But I finally got this. (I started working at like 10:30, haha, and now I see I missed a few posts in here, welp!) Anyway, download link is the same.

zenith-score.xlsx

Writing a script to collect all the FFR file notecounts was much easier than trying to figure out how to get Excel's alphabetical sort to match FFR's, which ... I wasn't able to do, haha.

So there's a few more steps than before now:

1. Copy table data from levelrank.php
2. Sheet1!A1 should already be selected, so paste your data into the spreadsheet.
3. The pasted data will be selected, so you can go to Sort & Filter > Custom Sort
4. Sort by Level on Values with order A to Z so the note counts match up properly.
5. Enter Sheet2 to find your results.

The scaled score now divides by all completely played files of that difficulty. This does mean I'll have to update the spreadsheet every time new songs are uploaded, but that won't be a problem for me to do.

EDIT:

Oh, one thing you can add to your table is just a column of like (if the Google sheet uses the same notation as Excel)

=IF(ISBLANK(D2)=FALSE,D2=IF(C2<20,"D1",IF(C2<40,"D2",IF(C2<50,"D3",IF(C2<60,"D4",IF(C2<70,"D5",IF(C2<80,"D6","D7")))))),"")

filled down. First it checks if a user has an Actual Division Placement, outputs nothing if false, then assigns the scaled score to a division and checks if it's the same as the ADP, outputting TRUE or FALSE. Maybe you already did something like that for your table in post 57 though.

Oh, and just to say again, some version of the scaled score will definitely be more accurate, because the score is dependent on one's Best Difficulty. Like, a D7 player's Best Difficulty should not be 64, so the original score underestimates their skill.