Re: Poll: Which global skill rating system is best ?
 

Issue there is the assumption that there will be too many files with that one specific skillset only with nothing else all also in the same small difficulty range, but way too many files would need to be added for this to be the case.

Re: Poll: Which global skill rating system is best ?
 

That's correct. However, if you add sufficiently enough files into the engine (whether the time it takes to reach that state is 5 years vs 50 years), you will eventually run into this issue in some finite amount of time (unless we decide to retire FFR and not add any more files into the engine haha).

This solution regardless how the engine and how FFR ages over time will be built to avoid these scalability concerns that will inevitably be present. This is why I'm advocating for the weighted solution. In the unweighted case, you have to have sufficiently enough people to play sufficiently enough files to be considered ranked. Is that guaranteed to happen? Who knows? Personally, I wouldn't hedge my bets on it if I know a solution that can circumvent these potential issues.

Re: Poll: Which global skill rating system is best ?
 

@People who voted for unweigthed:

I personally conceded the debate to WirryWoo after some more discussion on discord today.

I invite you to take a look at the conversation that has been going on today (may 24th) in the #dev-chitchat channel.

The demand I make after accepting the weighted system as a generator of our main skill rating metric is that we display, for each player, information that informs others of how flukey/biased their scores are. This (imo) would let the community easily find outliers which may not have been adequately ranked by the model (due to the high variance of opinion when tuning the hyperparameters), and better discuss the finegrained placement for events for example.

Feel free to discuss things more on here or over on discord :)