03-7-2011, 08:37 PM | #1001 |
moonchild~
|
Re: Queue/Batch Discussion Thread v2
Do you think you could get a backup judge to cover Pat's parts?
|
03-7-2011, 08:43 PM | #1002 |
Dark Chancellor
|
Re: Queue/Batch Discussion Thread v2
assuming that person would be able to judge with haste!
__________________
|
03-7-2011, 08:44 PM | #1003 |
★★★★★
|
Re: Queue/Batch Discussion Thread v2
ok it looks it's unlikely that we get notes from patashu, so quick backup judgement would be good.
My idea: splitting patashu's part into 2-3 parts. I can do one of these parts too (or if there's a judge who can do quick judgement of nearly 30 files, that's fine). |
03-7-2011, 08:48 PM | #1004 |
Rhythm game specialist.
|
Re: Queue/Batch Discussion Thread v2
Proportion the scale back to how it was with three judges, adding a fourth judge to tend to borderline files ONLY (for that group).
|
03-7-2011, 09:11 PM | #1005 |
shots FIRED
Global Moderator, User Support, Judge
Join Date: Oct 2003
Location: Edmonton, AB
Age: 36
Posts: 8,448
|
Re: Queue/Batch Discussion Thread v2
The only reason why I've suggested a possibility of only three judges is because despite the fact four judges supposedly gives some leeway in scores, even one judge profoundly affects the final outcome. In other words, I think that four judges isn't really creating a true buffer in opinions. That's what it seemed like in past batches.
|
03-7-2011, 10:00 PM | #1006 |
Live a wonderful life~
Join Date: Oct 2006
Posts: 7,313
|
Re: Queue/Batch Discussion Thread v2
Just contacted Patashu and he said that he won't be able to finish judging within the next 2 hours so we definitely need a back-up.
__________________
=============================== The idea that RDCP 3 may come out in the future is a fun thought to have~ =============================== |
03-7-2011, 10:02 PM | #1007 |
FFR Simfile Author
Join Date: May 2006
Posts: 3,213
|
Re: Queue/Batch Discussion Thread v2
If you need someone to do it quickly I can do it. I know I'm not the first choice but I'm going to be up for a while tonight and I'm available. I have a resub in that set of files though so someone else would have to judge that one.
If it's okay with you jimerax, I can go half and half with you. Let me know.
__________________
Glorious Morning - Misc, level 48
We Will Fly - Dance 2, level 53 =.The Ocean.= - Dance 2, level 56, collab with krunkykai22 Garden Party - Dance, level 38 |
03-7-2011, 10:09 PM | #1008 |
Retired Staff
All the things
|
Re: Queue/Batch Discussion Thread v2
Wouldn't splitting Patashu's up between a couple people just kinda cause issues? With the differing of experience/opinions I don't see that as being the best idea. I really think that being it's this late already just go off a 3 judge system for that group and have someone come in for the borderlines like AJ suggested. It's really not fair to the people who have been waiting to have to wait longer for someone to complete notes now.
|
03-7-2011, 10:10 PM | #1009 |
shots FIRED
Global Moderator, User Support, Judge
Join Date: Oct 2003
Location: Edmonton, AB
Age: 36
Posts: 8,448
|
Re: Queue/Batch Discussion Thread v2
lol man, if it's going to be this quickly hashed up, I'll have a harder time taking these last set of notes seriously. The quality of assessment is never the same when you compare reviews done in 2 hours compared to reviews completed in even one or two days.
I can see the idea becoming quite messy if the plan moves forward like this. |
03-7-2011, 10:12 PM | #1010 |
Retired Staff
All the things
|
Re: Queue/Batch Discussion Thread v2
Yea bmah has a really good point there too. It's kinda hard to make a good judgements in such a short period of time.
|
03-7-2011, 10:12 PM | #1011 |
Dark Chancellor
|
Re: Queue/Batch Discussion Thread v2
perhaps 3 judges notes is sufficient?
__________________
|
03-7-2011, 10:14 PM | #1012 |
shots FIRED
Global Moderator, User Support, Judge
Join Date: Oct 2003
Location: Edmonton, AB
Age: 36
Posts: 8,448
|
Re: Queue/Batch Discussion Thread v2
That's what I've been saying all along haha.
|
03-7-2011, 10:17 PM | #1013 |
FFR Simfile Author
Join Date: May 2006
Posts: 3,213
|
Re: Queue/Batch Discussion Thread v2
Whatever happens, happens. I just foresee a problem with only 3 judges..
Randomly thought of this, it may sound stupid. If only 3 judges are used for that group, of the grades received, could you possibly add the average of the 3 scores to be the 4th score? Example; a file received 4, 4, 3. Average of those is 3.67 and that or the rounded up or down of the average would be the "fourth judge". Then the total score for that file would be 14/15 depending on how you calculated it. Just a thought :/ EDIT: Thought #2 [yea, I'm full of them]. Even though this is likely what does happen already, just make the judging out of 15 instead and determine what would be accepted out of 15, which would likely be something along the lines of 12+.
__________________
Glorious Morning - Misc, level 48
We Will Fly - Dance 2, level 53 =.The Ocean.= - Dance 2, level 56, collab with krunkykai22 Garden Party - Dance, level 38 Last edited by ichliebekase; 03-7-2011 at 10:27 PM.. |
03-7-2011, 10:17 PM | #1014 |
Dark Chancellor
|
Re: Queue/Batch Discussion Thread v2
In case of tie breakers just send to other judges like was done with all the other files. This would throw off the point system though since it was based off 4 judges' scores.
__________________
|
03-7-2011, 10:28 PM | #1015 | |
Rhythm game specialist.
|
Re: Queue/Batch Discussion Thread v2
Quote:
EDIT: forgot to add something -- there would be two separate borderlines for the batch; 4 group batch would have either 15/16 and 3 would be 11/12, right? then have all judges vote on borderline files. Last edited by TC_Halogen; 03-7-2011 at 10:32 PM.. |
|
03-7-2011, 10:39 PM | #1016 |
stepmania archaeologist
Join Date: Aug 2005
Age: 34
Posts: 4,090
|
Re: Queue/Batch Discussion Thread v2
Halogen: nah, a file from the 3-judge part of the batch would need at least 17 out of 15 points to make it ingame. 16 out of 15 would be okay if people really like the file. Why would we bother changing the bar just because there are fewer judges?
Honestly I think 3 judges is no worse than 4. One judge can already ruin a file by giving it a -, and 3 judges doesn't really make that situation any better or worse.
__________________
Best AAA: Policy In The Sky [Oni] (81) Best SDG: PANTS (86) Best FC: Future Invasion (93) |
03-7-2011, 10:44 PM | #1017 |
Rhythm game specialist.
|
Re: Queue/Batch Discussion Thread v2
25/15 for [++]. no need to adjust.
|
03-7-2011, 11:23 PM | #1018 |
shots FIRED
Global Moderator, User Support, Judge
Join Date: Oct 2003
Location: Edmonton, AB
Age: 36
Posts: 8,448
|
Re: Queue/Batch Discussion Thread v2
Brenton Mah 9:58 pm
I'm sort of leaning for you to be the 4th judge then. jimerax (jimerax) is available 10:11 pm jimerax 10:12 pm fine |
03-7-2011, 11:23 PM | #1019 |
FFR Player
|
Re: Queue/Batch Discussion Thread v2
Make patashus judgements all be +. And release the notes
__________________
|
03-7-2011, 11:32 PM | #1020 |
shots FIRED
Global Moderator, User Support, Judge
Join Date: Oct 2003
Location: Edmonton, AB
Age: 36
Posts: 8,448
|
Re: Queue/Batch Discussion Thread v2
haha, that'd be awesome
|
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
|
|