Rethink Our Chart Difficulties

[hi19hi19]

Originally Posted by TheSaxRunner05

What would be really helpful is if we could run a query on the songs that make the most people's top 4, and then decide whether there on so many people's top scores because they are actually good scores, or if they are overrated.

This is a really, really good idea.

Conversely, you can also run a query for songs that hardly appear at all in people's top scores, and see if that's because they are underplayed or underrated.
Ideally, you'd want a fairly even distribution of songs appearing in people's top scores. This will never be perfect due to factors such as popularity and differences in song structure (files that are tricky to PA versus straight up files that are just a "are you this fast" speed test) but it's completely worth checking.

[blanky!]

Some curve needs to be invented that measures the difficulty of getting a certain score on a file.
On every song the curve would be different; for example, World Tour 2004 is easily SDG'able by upper D4, but AAA'ing is another story.
Meanwhile, you have jacky files like Turbo that are hard to FC but easy to AAA.

Though, unless a reliable difficulty formula is established, this would have to rely on statistics, which can be muddled by all the D7 players on harder songs.
So +1 to Sax's idea.

[noname219]

Originally Posted by hi19hi19

This is a really, really good idea.

Conversely, you can also run a query for songs that hardly appear at all in people's top scores, and see if that's because they are underplayed or underrated.
Ideally, you'd want a fairly even distribution of songs appearing in people's top scores. This will never be perfect due to factors such as popularity and differences in song structure (files that are tricky to PA versus straight up files that are just a "are you this fast" speed test) but it's completely worth checking.

Or if a range of songs always appears on top (say 60-65), maybe it's the formula that is problematic and we should tweak it a little bit. Anyway, it's a win-win idea.

[TheSaxRunner05]

Originally Posted by blanky!

Some curve needs to be invented that measures the difficulty of getting a certain score on a file.
On every song the curve would be different; for example, World Tour 2004 is easily SDG'able by upper D4, but AAA'ing is another story.
Meanwhile, you have jacky files like Turbo that are hard to FC but easy to AAA.

Though, unless a reliable difficulty formula is established, this would have to rely on statistics, which can be muddled by all the D7 players on harder songs.
So +1 to Sax's idea.

This effects could be mitigated by small adjustments to those specific file difficulties which need to be reworked to fit our new system.