03-10-2011, 04:08 PM | #1241 | ||
stepmania archaeologist
Join Date: Aug 2005
Age: 34
Posts: 4,090
|
Re: Queue/Batch Discussion Thread v2
Quote:
Quote:
EDIT: Hey, hang on. The point of the four judges is to see what the general consensus is, right? So we *should* be eliminating clear outliers. A single very good or very bad result shouldn't affect a song's rating, because it's clear that that judge is seeing something most other people wouldn't.
__________________
Best AAA: Policy In The Sky [Oni] (81) Best SDG: PANTS (86) Best FC: Future Invasion (93) Last edited by qqwref; 03-10-2011 at 04:12 PM.. |
||
03-10-2011, 04:12 PM | #1242 |
<3 Jumpstream <3
|
Re: Queue/Batch Discussion Thread v2
Why not take the 3 highest ratings and add them up and average them out.
5-3-4-4 5+4+4= 13/3 = 4.3333333~ = Pass. Anything above a 3.5 passes. Weeee <3 or 3.7 / 3.8 |
03-10-2011, 04:13 PM | #1243 |
shots FIRED
Global Moderator, User Support, Judge
Join Date: Oct 2003
Location: Edmonton, AB
Age: 36
Posts: 8,448
|
Re: Queue/Batch Discussion Thread v2
I'll be updating the notes in a moment, and yes, you're right.
|
03-10-2011, 04:13 PM | #1244 |
stepmania archaeologist
Join Date: Aug 2005
Age: 34
Posts: 4,090
|
Re: Queue/Batch Discussion Thread v2
Maybe it would be easier to just add another symbol for the grading: [jx], which means "I don't care what the other judges think, jx should personally decide whether to accept this song or not".
__________________
Best AAA: Policy In The Sky [Oni] (81) Best SDG: PANTS (86) Best FC: Future Invasion (93) |
03-10-2011, 04:15 PM | #1245 |
Rhythm game specialist.
|
Re: Queue/Batch Discussion Thread v2
Averaging out to the minimum acceptance rating (4 out of 5) wouldn't be a bad idea in theory, actually. The only issue is when TWO judges have harsh opinions on a file (like 5/5/1/1 = 12 -> 3) and if two judges have that many notes to stack upon to give out a 1, then there might be a problem as well.
EDIT: didn't realize you were taking the highest three ratings -- that doesn't eliminate the problem at all, in fact, I think it might magnify it in the instance of two judges giving a poor rating (5/5/1/1, as mentioned before). And again, it nullifies the thoughts of the other judge, even if they were legitimate or not. It should be up to one of the head judges to choose whether or not they want to discard notes. |
03-10-2011, 04:15 PM | #1246 |
Digital Dancing!
Join Date: Feb 2006
Location: 80 billion club, NE
Age: 31
Posts: 12,981
|
Re: Queue/Batch Discussion Thread v2
Because 5/3/3/2 would be passing lol. Take out the oddball and (3+3+2)/3 = 2.6 (rightful reject)
__________________
|
03-10-2011, 04:16 PM | #1247 |
FFR Simfile Author
Join Date: May 2006
Posts: 3,213
|
Re: Queue/Batch Discussion Thread v2
Not just jx, but bmah as well. Especially if one of them was a judge in the first place of the file [example: someone in group 2 this batch wants a "jx" grading but he already was a judge for that group, it'd go to bmah instead to keep it fair.]
__________________
Glorious Morning - Misc, level 48
We Will Fly - Dance 2, level 53 =.The Ocean.= - Dance 2, level 56, collab with krunkykai22 Garden Party - Dance, level 38 |
03-10-2011, 04:17 PM | #1248 | |
<3 Jumpstream <3
|
Re: Queue/Batch Discussion Thread v2
And in that case you put the file under a "controversial" review. You take the file and send it to JX and bmah and take the mean of there ratings.
IE; TC_Halogen = 5 qqwref = 5 i love you = 1 samurai = 1 Goes to JX and bmah JX = 5 bmah = 3 Score = 4 Or any other two judges that would fit the profile so to say. Quote:
Not if the passing grade is a 4. Which is what it should be. 3.7 to be exact. |
|
03-10-2011, 04:18 PM | #1249 |
Sun and Stars
|
Re: Queue/Batch Discussion Thread v2
****in sweet, thanks bmah u da man.
that includes all simfile judges as well.
__________________
http://www.facebook.com/?ref=logo#!/Br0wnbread Check out my band profile and give it a like! :P |
03-10-2011, 04:19 PM | #1250 |
Digital Dancing!
Join Date: Feb 2006
Location: 80 billion club, NE
Age: 31
Posts: 12,981
|
Re: Queue/Batch Discussion Thread v2
5/4/3/2 would be passing, your move
__________________
|
03-10-2011, 04:20 PM | #1251 |
Rhythm game specialist.
|
Re: Queue/Batch Discussion Thread v2
Using an averaging system with a huge spread of ratings (5/5/5/1, 5/5/4/1, 5/5/1/2, w/e), you can have JX/bmah come in to add a 5th and 6th rating to help level (or lower if rightfully deserved).
That might help with files that have wild ranges. |
03-10-2011, 04:21 PM | #1252 |
<3 Jumpstream <3
|
Re: Queue/Batch Discussion Thread v2
Yeah a 5-3-3-2 file isn't passing. Put it to the calculator it equals out at = 3.6666 whatever.
Under the 3.7 passing grade it does not pass. 3-5-4 would pass with an average 4. 4-4-4 Would pass obviously with an average 4. It would make things easier to use 3.7/3.8 which would be borderline really good files. EDIT: yeah I know it would pass. But 3 is an average grade. Meaning it would pass if you look at school grades. C is average to be honest, and you pass with that. A 5 B 4 C 3 D 2 F 1 There. |
03-10-2011, 04:24 PM | #1253 |
Live a wonderful life~
Join Date: Oct 2006
Posts: 7,313
|
Re: Queue/Batch Discussion Thread v2
So getting straight B's in this judging system is considered a conditional?!
Man, getting an FFR education ain't no joke. @ Bmah, am i allow to post my notes here?
__________________
=============================== The idea that RDCP 3 may come out in the future is a fun thought to have~ =============================== |
03-10-2011, 04:24 PM | #1254 |
FFR Simfile Author
Join Date: May 2006
Posts: 3,213
|
Re: Queue/Batch Discussion Thread v2
With the whole average stuff, all of the notes written would have to be put into consideration no matter what. If a file gets 5 3 3 2 and the person who gave the 2 has fully legitimate reasons as to why they gave that rating and ways to fix it, then obviously it'd have to truly be considered. It's all conditional.
__________________
Glorious Morning - Misc, level 48
We Will Fly - Dance 2, level 53 =.The Ocean.= - Dance 2, level 56, collab with krunkykai22 Garden Party - Dance, level 38 |
03-10-2011, 04:26 PM | #1255 | |
snooches
|
Re: Queue/Batch Discussion Thread v2
Quote:
|
|
03-10-2011, 04:27 PM | #1256 |
<3 Jumpstream <3
|
Re: Queue/Batch Discussion Thread v2
You know, Byron that is the best post I've seen in a long time.
If you look at the way judging and reviews have gone in the past 3 or 4 batches, you'll see just how strict the majority of people have gotten. The file would have to be amazing to pass to be honest. This system with a 3.8 makes the files Great. Not AMAZING because to be honest, some files may be great to some and shitty to another. RATO/DP/grind2/RAN for example. Those files to some are the shittiest things ever. But to the judges it passed. And, in my opinion, not all songs have to be FANTASTIC OR AMAZING to 3/4 judges for the file to pass. It can be acceptable. |
03-10-2011, 04:40 PM | #1257 | |
Rhythm game specialist.
|
Re: Queue/Batch Discussion Thread v2
Quote:
Also, not really going to go about how to deal with the rating system; it might upset some people. All I will say is, 16 should be a borderline, but only 4/4/4/4 should pass without an appeal of any sort (4 +.'s equals consistency). |
|
03-10-2011, 04:58 PM | #1258 |
FFR Player
|
Re: Queue/Batch Discussion Thread v2
jesus christ stop your bitching
dossar stop with your butthurt bullshit everyone else stop with your butthurt bullshit DEAL WITH IT BITCHES IF YOU DONT LIKE IT SUBMIT YOUR SHIT TO ANOTHER SITE/PACK OR RELEASE AS A SINGLE
__________________
|
03-10-2011, 05:17 PM | #1259 |
shots FIRED
Global Moderator, User Support, Judge
Join Date: Oct 2003
Location: Edmonton, AB
Age: 36
Posts: 8,448
|
Re: Queue/Batch Discussion Thread v2
|
03-10-2011, 06:06 PM | #1260 |
Dark Chancellor
|
Re: Queue/Batch Discussion Thread v2
Get over your files being rejected and seek insightful ways to make your files better rather than make up excuses and try to work around the system :/
__________________
|
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
|
|