New Skill Analysis Metric (Trial Phase)

[TheSaxRunner05]

Re: New Skill Analysis Metric (Trail Phase)

Can you make the tool where we can just imput the link to our level ranks, hit enter, and then it churns out our own graph?

[Trumpet63]

Re: New Skill Analysis Metric (Trial Phase)

Can you make the tool where we can just imput the link to our level ranks, hit enter, and then it churns out our own graph?

I would so dearly love for this to be the case, but alas, I have not the programming prowess to put that together, as I said in the OP. I just got back from school, so maybe after I've solidified the work here, someone will be interested in helping me with something like that.

Note: I'll start just updating the OP with changes in formula, and any thoughts I have about the changes.

[_Zenith_]

Re: New Skill Analysis Metric (Trail Phase)

After seeing Sorie's Zenith Score, if you happen to do anyone in D7 with 90+% of all songs AAA'd, the curve would be straight until the very end, even if so, such a tiny fluctuation between the 90 scores which is kind of neat

Realistically, having more AAA's will boost your Zenith Curve up to an extent, where the person's highest difficulty drops off depending on how high that is. Such a cool feature to have though. #SenseOfAchievement

[Silvuh]

Re: New Skill Analysis Metric (Trail Phase)

zenith-score.xlsx

If you have Excel, you can use this. Go to your level ranks page and copy the whole table, including the column titles (in Firefox, it's some kind of Ctrl+Shift with clicking and dragging from just outside the table). Paste it into A1 of Sheet1, go into Sheet2, and all the results will be there.

There are more levels of difficulty 64 than any other (49 of them), so that's one problem with the non-scaled score. I can update my sheet with any changes made to the formula.

And for my Level Ranks, it's
Non-scaled: Z-Score: 68.34; Best Diff: 64
Scaled: Z-Score: 70.22; Best Diff: 62

[Kanzas]

Re: New Skill Analysis Metric (Trail Phase)

ME

[Trumpet63]

Re: New Skill Analysis Metric (Trail Phase)

zenith-score.xlsx

If you have Excel, you can use this. Go to your level ranks page and copy the whole table, including the column titles (in Firefox, it's some kind of Ctrl+Shift with clicking and dragging from just outside the table). Paste it into A1 of Sheet1, go into Sheet2, and all the results will be there.

There are more levels of difficulty 64 than any other (49 of them), so that's one problem with the non-scaled score. I can update my sheet with any changes made to the formula.

And for my Level Ranks, it's
Non-scaled: Z-Score: 68.34; Best Diff: 64
Scaled: Z-Score: 70.22; Best Diff: 62

<3 <3 <3 <3
I Approve, thank you so much for optimizing the Excel work for me. I hope everyone knows: I didn't post a dl link for my Excel file because it really wouldn't have been usable by anyone else. I'm still posting the stuff for everyone that asked.

@Silvuh I hope my explanation in the OP was sufficient in helping you put this together. You've just signed yourself up as the Senior Excel Formula Updater. I'd better put your link in the OP.

[Trumpet63]

Re: New Skill Analysis Metric (Trial Phase)

Second batch of scores and graphs, feel free to comment.


Z-Score = 68.72
Z-Score Scaled = 68.98


Z-Score = 56.00
Z-Score Scaled = 62.02


Z-Score = 68.80
Z-Score Scaled = 84.00


Z-Score = 74.50
Z-Score Scaled = 90.70


Z-Score = 61.13
Z-Score Scaled = 76.13


Z-Score = 64.53
Z-Score Scaled = 64.64


Z-Score = 39.96
Z-Score Scaled = 57.00

[yo man im awesome]

Re: New Skill Analysis Metric (Trial Phase)

sure, throw me in there

[Silvuh]

Re: New Skill Analysis Metric (Trial Phase)

Rawr, haappy to help~ And, yeah, it was kind of funny that with my scaled score, my best difficulty goes down but my score goes up. And it's due to the effect you mentioned: I only have one 80 and one 82 on the chart, 10 goods and a boo on Ketsarku Mozgalom and 12 goods on Blue Rose. My other scores in that range are definitely not comparable.

So rather than divide by the number of files for a difficulty in your sheet, I tried dividing by the total number of files in that difficulty. And this seems to work better; the curve is doesn't fan out so much. (It's equivalent to multiplying the scaled score by the ratio of files you have NGC<20 on, because the count of NGC<20 files cancels out.) My new Z-Score is 67.58 with a best difficulty of 61.

The change on my spreadsheet is pretty simple, and I can update my file if you like the idea.

Sheet2 Column C currently references Sheet1 Column L, which restates the difficulty for played files with a non-negative NGC (new good count). So instead, you can put =IF(B2=0,0,B2/COUNTIF(Sheet1!B:B,"="&A2)) in C2, referring to the complete difficulty list in Column B, and fill that down.


Oh, and the only step in your explanation I got stuck on was Step 2, because it doesn't explicitly say to multiply the Averages, Misses, and Boos by those factors and sum them all up with the number of goods to make a new good count. (And Step 4 still refers to what I'm calling the NGC as the "good count".)

[Poison-]

Re: New Skill Analysis Metric (Trial Phase)

I'm interested in seeing what it says for me.

[MyNameIsNothing]

Re: New Skill Analysis Metric (Trial Phase)

64 is a pretty great difficulty.
thanks for the graphs, cool stats.

[Trumpet63]

Re: New Skill Analysis Metric (Trial Phase)

Rawr, haappy to help~ And, yeah, it was kind of funny that with my scaled score, my best difficulty goes down but my score goes up. And it's due to the effect you mentioned: I only have one 80 and one 82 on the chart, 10 goods and a boo on Ketsarku Mozgalom and 12 goods on Blue Rose. My other scores in that range are definitely not comparable.

So rather than divide by the number of files for a difficulty in your sheet, I tried dividing by the total number of files in that difficulty. And this seems to work better; the curve is doesn't fan out so much. (It's equivalent to multiplying the scaled score by the ratio of files you have NGC<20 on, because the count of NGC<20 files cancels out.) My new Z-Score is 67.58 with a best difficulty of 61.

The change on my spreadsheet is pretty simple, and I can update my file if you like the idea.

Sheet2 Column C currently references Sheet1 Column L, which restates the difficulty for played files with a non-negative NGC (new good count). So instead, you can put =IF(B2=0,0,B2/COUNTIF(Sheet1!B:B,"="&A2)) in C2, referring to the complete difficulty list in Column B, and fill that down.


Oh, and the only step in your explanation I got stuck on was Step 2, because it doesn't explicitly say to multiply the Averages, Misses, and Boos by those factors and sum them all up with the number of goods to make a new good count. (And Step 4 still refers to what I'm calling the NGC as the "good count".)

Aww man, you beat me to it, lol. I had been thinking the same thing. Let me think on this, because I'm not yet entirely convinced that this conveys the same concept as the straight average, and that might still be useful. Part of me is concerned that this will very much reduce scores for people who have only played a few songs. In principle, if a player is selecting songs randomly (evenly distributed), then this scaling down perfectly counteracts the difficulty concentration issue, but I find that it reduces my score a bit too much for me to be completely convinced yet. I'd say, keep both versions of the file
And thank you again for the updated formula to put in! (You're a wizard with Excel, I swear...)

[choof]

Re: New Skill Analysis Metric (Trial Phase)

my graph will look like shit

[Silvuh]

Re: New Skill Analysis Metric (Trial Phase)

Yeah, I didn't even think about accounting for unplayed songs, because I've played everything except for the most recent stuff (and sometimes I ignore long/hard files for a while.) Trying [TeRa]'s level ranks, because he's in D7 and has a lot of unplayed files. (His best difficulty is 81 in all of these.)

divided by NGC < 20 files:

Z-Score: 85.01 (This chart is similar to the others, where the earlier difficulties have a straight line of all AAAs, starting to scatter around the mid-70s and curving down in the 80s.)

divided by all files:

Z-Score: 84.62 (This chart is scattered throughout with an obvious break after 83, the following scores being much lower.)

So next, I thought to try dividing by all played files. There's still trouble if a person has, like, a good score on the only 80 they've ever played (though I'd think that must be pretty rare and not worth figuring out how to account for until it comes up, and they'd have to deliberately play one they know they can score well on for their skill in that range to be overestimated).

C2=IF(B2=0,0,B2/COUNTIFS(Sheet1!B:B,"="&A2,Sheet1!K:K,">0"))

Z-Score: 84.25 (The graph has a few early dips but is mostly linear at the start and doesn't get as scattered, with a noticeable break at 84.)

Also, sometimes people don't play a file the whole way through. Like, [TeRa] has 540-1-0-21-1 on Daybreak, making a dip in the 44s. The most reliable way to fix this would be including a total note count for each file, but that's not in the level ranks. Some people miss or boo out, but I think some also do that with auto-fail. One way to get some of them out would be checking for "goods < 50 & averages = 0 & (miss >= 20 || boo >=25)" I know for me, at least, that I always get at least one average and a lot of goods on a file I truly miss that much on, but the unfinished scores usually don't.

I didn't know how to do it all in one forumla, so I had to add Sheet1!O2=AND(F2<50,G2=0,OR(H2>=20,I2>=25)) and fill that down, and then Sheet2!C2 becomes =IF(B2=0,0,B2/COUNTIFS(Sheet1!B:B,"="&A2,Sheet1!K:K,">0",Sheet1!O:O,"=FALSE")).

Z-Score: 84.29 (Slightly higher than the previous one. The graph raises a few points a bit, fixing some of the gaps.)

And my new Z-Score with this last one is 68.21, which is closer to the original, non-scaled score. If someone knows they don't have any incomplete plays, they can just use the formula dividing by all played files, because this check for incomplete plays isn't perfect.

[TC_Halogen]

Re: New Skill Analysis Metric (Trial Phase)

I'm interested in seeing my output, haha.