|
View Poll Results: Should we add a AA metric to FFR ? | |||
Yes, like how the OP described it | 7 | 31.82% | |
Yes, but not exactly as described | 5 | 22.73% | |
No | 10 | 45.45% | |
Voters: 22. You may not vote on this poll |
|
Thread Tools | Display Modes |
08-16-2021, 10:23 AM | #1 |
✘ Forever OP✘
Join Date: Dec 2008
Location: Canada,Quebec
Age: 29
Posts: 4,171
|
Definition of a FFR AA
This is a continuation thread based on the feedback from the FC implementation thread. Please go read that thread to know why this metric seems to be needed on FFR.
So, what is a AA ? Basically a AA on other games serves the purpose of determining if you did "well enough" on a given chart, without necessarily being close to perfection on it. On Stepmania for example, this grade is obtained by getting 93.00% accuracy or better. What is accuracy on FFR ? Since FFR is frame based, it makes sense for its judgement values (Amazing, Perfect, Good, ...) to be defined by some frame window around the exact note timing. In any case, frames can always be converted to ms timing. That being said, the simplest way one could define accuracy on FFR is by comparing the obtained raw score on a chart with the AAA raw score on that same chart. This allows for any configuration of non-perfects to be a AA, as long the raw score is sufficiently high. Other games like Etterna will consider even the slightest ms timing difference to compute the accuracy. In other words, a 100% is extremely rare and only achievable on super easy/short charts by very talented accuracy players. In the context of FFR, that would mean considering Amazings in the computation, where an Amazing would result in more points than a Perfect. Given the reputation of FFR to be relatively unstable at that scale, I think it's safe to say that Amazings should not make a difference. When it comes to a specific % requirement, I believe it can be discussed mostly subjectively. I personally don't see why we couldn't use a round number like 90%. One interesting piece of data that could be useful is how much % can one get on average when just mashing charts. This would give a lower bound to the discussion. I don't have the time right now to compute that, but if someone could, that'd be very helpful. What about chart structure ? Chances are you havent asked yourself that question yet. Chart structure matters when you compare two charts, and one has a single difficulty spike whereas the other one is more balanced overall. This currently affects FFR in a major way since the AAA metrics that we use do not account for such chart structure, resulting in what is commonly known as "farm files". Well, the same logic applies to any AA metric, except that it introduces even more of these "farm files". Although the AA metric would be even slightly more "broken" than our AAA metrics, it is far less of a big deal. The reason is that AA would never be FFR's main skill measure. Knowing that, there's no real need to fix AAA stuff before implementing AA. There's a non-0 chance that if/when difficulty is redefined in the future, AA will have to follow the changes, but that's probably the least of our concerns given the other implications that would come with a redefinition of difficulty. What would AA give to users ? Obviously, the first thing associated with AA's would be a completion metric just like the AAA's and FC's (and maybe SDG's eventually). Then, some Tokens and Skill Tokens could be made to use this new tracked grade. ________________________________ So what do you think of this suggestion, and do you have anything you'd like to see regarding this AA grade ? |
08-16-2021, 10:47 AM | #2 |
owo
Head of Events Team
Join Date: Jun 2020
Posts: 373
|
Re: Definition of a FFR AA
I think the most reasonable way to set an AA threshold in FFR is by using raw goods- similar to SDG. if AAA is 0 raw goods, and SDG is <10 raw goods, maybe somewhere between 30 and 50 raw goods? anything stricter than 30 is too close to SDG to really be valuable. 50 is a strong choice because at that threshold you're at least demonstrating some amount of control and competency on the patterns- maybe there was a bit of mashing on a difficulty spike and some bigger mistakes here and there, but you were doing something right for a good portion of the file.
(but if you think you can implement a competent accuracy% system for this, that'd be even better. i just think raw goods based fits well with the existing grades) Last edited by Lights; 08-16-2021 at 10:49 AM.. |
08-16-2021, 10:51 AM | #3 |
FFR Player
Join Date: Jan 2007
Location: Hyrule Castle
Age: 31
Posts: 333
|
Re: Definition of a FFR AA
Seems unnecessary tbh lol. Isn’t SDG basically a AA? And unless u want to score lower for tokens, that’s literally just letting the better scorers AAA until the end when they can get that I don’t play competitively often for myself, so outside looking in: it’s pointless aside from the clout of saying u got a AA. I’m know SDGs have their own reason for be excluded from this kind of scoreboard reasoning since it’s a kind of a 1/10 get if u can’t. How would u determine a AA? Getting more perfects than amazing? Would it be a percentage? Also if u do implement it, maybe make it like “perfects and amazing -only score”a limited to that same ‘1/10 get’ before the AAA. In the end if it does happen I’m looking forward to seeing my scores change and people get hyped since others will use it to work on their songs. If in the end the AAA metric is all that matters, I’d just kind of cut the idea unless u wanna hype competition. I also have no idea what metrics are like in these games coz I just go and play em, I mean as far as charting goes for this, I don’t see the relevance since for all I know judging is subjective too. Maybe it could help sort out more songs in the engine since there’s over 2k. Regardless it’s cute seeing everyone want to expand the game and I’m down to see your progress!!
|
08-16-2021, 10:51 AM | #4 | |
✘ Forever OP✘
Join Date: Dec 2008
Location: Canada,Quebec
Age: 29
Posts: 4,171
|
Re: Definition of a FFR AA
Quote:
Why an absolute raw good count vs a relative one though ? To me it seems like absolute count would simply be too similar to the other flags we use (Blackflag, Booflag, SDG), whereas a relative count would bring in some variety to FFR while also catering to the players from other games. |
|
08-16-2021, 10:57 AM | #5 |
FFR Veteran
Join Date: May 2014
Age: 28
Posts: 351
|
Re: Definition of a FFR AA
A value of 95% of the maximum possible raw score would sound good. It's a nice round number, high enough to show you managed to play the file decently, and low enough to be significantly easier than SDG. A value of 90% would be too low: looking at my past scores I've already mashed my way through some difficult files, getting 90%.
|
08-16-2021, 10:58 AM | #6 | |
✘ Forever OP✘
Join Date: Dec 2008
Location: Canada,Quebec
Age: 29
Posts: 4,171
|
Re: Definition of a FFR AA
Quote:
Last edited by xXOpkillerXx; 08-16-2021 at 11:15 AM.. |
|
08-16-2021, 11:32 AM | #7 | |
FFR Veteran
Join Date: May 2014
Age: 28
Posts: 351
|
Re: Definition of a FFR AA
Quote:
Other examples: 92.8% Revolutionary Etude 90.3% A Quick Death 92.7% Grist 91.0% Magical 8bit Tour 91.0% Schmollbluk ... and more. For a 1000 notes file, a SDG equals a score of 99.51+%. Last edited by benny58624; 08-16-2021 at 11:37 AM.. |
|
08-16-2021, 11:42 AM | #8 | |
✘ Forever OP✘
Join Date: Dec 2008
Location: Canada,Quebec
Age: 29
Posts: 4,171
|
Re: Definition of a FFR AA
Quote:
|
|
08-16-2021, 01:35 PM | #9 |
✘ Forever OP✘
Join Date: Dec 2008
Location: Canada,Quebec
Age: 29
Posts: 4,171
|
Re: Definition of a FFR AA
My bad if the raw goods counts in my examples are wrong, typing quickly on phone.
The idea remains that the % for AA should be agreed on w.r.t. the average notecount to be as representative as possible. |
08-16-2021, 01:43 PM | #10 | |
The Dominator
Join Date: Sep 2005
Location: North Bay, ON
Age: 34
Posts: 8,987
|
Re: Definition of a FFR AA
Quote:
I can't see a better way than this...though you will still have those anomalous files that have a huge skill gap to go from AA -> SDG (System Doctor is a great example, very farmable as it is for skill rating lol) and then other files that you can improve drastically on with a small skill increase (stamina intensive and marathon files) I don't see anything wrong with the idea though since all we're doing is counting the AA's and not assigning ratings to them based on difficulty |
|
08-16-2021, 01:50 PM | #11 | |
✘ Forever OP✘
Join Date: Dec 2008
Location: Canada,Quebec
Age: 29
Posts: 4,171
|
Re: Definition of a FFR AA
Quote:
|
|
08-16-2021, 02:09 PM | #12 |
Forever Derbyless
Join Date: Aug 2020
Age: 32
Posts: 240
|
Re: Definition of a FFR AA
If the primary goal of introducing AA is to replace FC counts, I disagree. In other rhythm game communities, AA is simply just a grade received on your performance of the file. This can cause more confusion for new Etterna players thinking "wtf why is it so easy to get an AA on FFR lmfao?" If you really want to introduce AA, you might as well start introducing other grades like A, B, C, etc. in this definition as well.
However, any hypothetical AA, A, B, C, D, etc. is not contributive to your skill rating. It's only just letters designed to unofficially and unnecessarily validate your own skills while playing this game. I say unofficially because these grades are not factored into the skill ratings computation and I say unnecessarily because your scores should be enough to make you feel proud. If the skill ratings formula is revamped to somehow incorporate these grades, then my vote would have switched to "Yes". Right now, the AA proposal just seems like another one of millions of random stats we currently have on this website lmfao.
__________________
|
08-16-2021, 03:05 PM | #13 | |||
✘ Forever OP✘
Join Date: Dec 2008
Location: Canada,Quebec
Age: 29
Posts: 4,171
|
Re: Definition of a FFR AA
No it's not. It came from the FC discussion, but it's not related to FC at all.
Quote:
Quote:
Secondly, implying it's necessairly a pride thing is close minded: why can't people just have Fun trying to track how many files they can play decently on with a structured, automatic metric ? Quote:
|
|||
08-16-2021, 03:51 PM | #14 |
FFR Veteran
Join Date: Nov 2016
Age: 28
Posts: 69
|
Re: Definition of a FFR AA
I dont know what this adds to ffr. I am not very understanding of everything, but ffr is a aaa game, you goal is to get a aaa, not a aa, so adding a aa type of score feels like its not ffr.
|
08-16-2021, 03:58 PM | #15 |
✘ Forever OP✘
Join Date: Dec 2008
Location: Canada,Quebec
Age: 29
Posts: 4,171
|
Re: Definition of a FFR AA
Just like tokens, skill tokens, tier points, badges or any other secondary element of FFR that is not the main skill measure, AA would give another optional metric to track/work towards.
|
08-16-2021, 04:18 PM | #16 |
FFR Veteran
Join Date: Nov 2016
Age: 28
Posts: 69
|
Re: Definition of a FFR AA
I guess, its fine, but it feels like you could just calculate it on your own? idk why getting a aa is that important for ffr.
|
08-16-2021, 04:21 PM | #17 |
D7 Elite Keymasher
Join Date: Aug 2006
Age: 33
Posts: 6,003
|
Re: Definition of a FFR AA
2% raw goods / total notes in song
__________________
Last edited by Fantasticone; 08-16-2021 at 04:50 PM.. |
08-16-2021, 04:24 PM | #18 | |
✘ Forever OP✘
Join Date: Dec 2008
Location: Canada,Quebec
Age: 29
Posts: 4,171
|
Re: Definition of a FFR AA
Quote:
It's not -important-, it's a suggestion to implement a feature which may incentivize some people to work towards instead of focusing on AAAs. Nobody asserted that it's a necessity nor that it will be relevant for all players (just like the other optional things I mentionned that FFR has). |
|
08-16-2021, 04:47 PM | #19 | |
FFR Veteran
Join Date: May 2014
Age: 28
Posts: 351
|
Re: Definition of a FFR AA
Quote:
|
|
08-16-2021, 04:59 PM | #20 | |
✘ Forever OP✘
Join Date: Dec 2008
Location: Canada,Quebec
Age: 29
Posts: 4,171
|
Re: Definition of a FFR AA
Quote:
They were only part of the game engine and not tracked anywhere, so it seems very normal that it never was interesting enough for anyone to care about. Reason why I only suggested some kind of AA equivalent is twofold: 1. On FFR, as we've discussed in this thread, you can relatively easily mash your way to a % as high as 95%-ish, because of how our judgements work. Therefore anything worse than that AA metric would converge to the same required effort to obtain for even less significance than the AA compared to AAA. 2. In some other games, AA is a very common metric for players to determine if they did decent on a file. Very rarely do we see players go for the lower grades. |
|
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
|
|