11-13-2014, 10:33 PM | #9061 |
quit
Join Date: Apr 2005
Location: anywhere but here
Posts: 938
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
Because of the limited activity between batch judgments, I did end up putting Nightfall (Original Mix) and They Kidnapped the Princess (and the other four files that had been skipped over) in with the July/August batch. Sorry for not mentioning that in here earlier.
|
11-13-2014, 11:50 PM | #9062 | |
[Nobody liked that.]
Join Date: Sep 2012
Posts: 3,359
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
Quote:
|
|
11-14-2014, 06:05 PM | #9063 | |
Simfile Judge
Join Date: May 2013
Posts: 476
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
Quote:
Last edited by M0nkeyz; 11-14-2014 at 06:06 PM.. |
|
11-17-2014, 02:43 PM | #9064 |
Spun a twirly fruitcake,
Join Date: Feb 2009
Age: 31
Posts: 3,865
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
so quiet
|
11-17-2014, 03:57 PM | #9065 |
Banned
Join Date: Nov 2013
Posts: 8,563
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
Go ahead and pull odd22, having the judges play it would just be a waste of time.
|
11-17-2014, 04:37 PM | #9066 |
Batch Manager
Game Manager, Song Release Coordinator
Join Date: Mar 2008
Location: USA
Age: 29
Posts: 14,870
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
For the record: Judging for the July/August Batch started yesterday.
|
11-17-2014, 04:41 PM | #9067 |
FFR's Resident Trashpanda
Join Date: Sep 2012
Location: Michigan
Age: 29
Posts: 1,095
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
At the risk of sounding like a dick:
Could we maybe get a different sort of system in place so that we're not just now starting getting ratings for an almost 3 month old batch? |
11-17-2014, 04:52 PM | #9068 |
Snivy! Dohoho!
Join Date: Mar 2006
Age: 33
Posts: 6,161
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
Osu system~~~~~~~~~~~~~~~
|
11-17-2014, 05:08 PM | #9069 |
FFR Player
Join Date: Dec 2013
Posts: 152
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
add african anger on osu! thanks guys
|
11-17-2014, 06:22 PM | #9070 |
shots FIRED
Global Moderator, User Support, Judge
Join Date: Oct 2003
Location: Edmonton, AB
Age: 36
Posts: 8,448
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
Although I'm also complaining about the long wait, please consider that there was a transition from handing the game management from AJ to Silvuh and Dossar. A rocky start certainly affected the efficiency of the system; it is not the infrastructure of the system itself that's the issue. Recall that a lot of changes have already occurred to the judging infrastructure over the past year - not to mention a few more additions that Silvuh has implemented. It'll take some time, but I hope we can catch up quickly.
|
11-17-2014, 06:26 PM | #9071 |
Snivy! Dohoho!
Join Date: Mar 2006
Age: 33
Posts: 6,161
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
Well if you guys need any help, y'know, wink wink, squirm squirm, CHARU.
|
11-17-2014, 06:38 PM | #9072 |
FFR R1 Vaporeon
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
This should say "Hajnal 2 (FFR Pro 21)".
__________________
Last edited by bmah; 11-17-2014 at 06:41 PM.. Reason: noted and fixed :) |
11-17-2014, 07:06 PM | #9073 | |
FFR's Resident Trashpanda
Join Date: Sep 2012
Location: Michigan
Age: 29
Posts: 1,095
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
Quote:
|
|
11-17-2014, 07:33 PM | #9074 |
quit
Join Date: Apr 2005
Location: anywhere but here
Posts: 938
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
There have been discussions on here about the pros and cons of different systems, and ... I don't really remember the arguments, but it does seem like the batch system is just what works for us. "Works" relatively better, anyway.
Like, when we realized that some of the May/June files had been skipped over, I uploaded them and posted in the forum and the chat about getting extra judgments, and after a while, only one other judge had stepped up to look at them. And you all saw how it was over a month between posting May/June's initial and final results because of the passed files. When there's a group of files that no one's assigned to look at and there's no schedule, things just don't get done. And I feel like it'd just keep being like that if we tried a "judge when you want to" system. Yeah ... No one's happy that it took this long to start judging the July/August stuff. The original date for completing May/June judgments was the last day of August. Then that September happened ... I opened signups for judging the July/August batch around the end of September. I didn't expect to start judging right away, because the May/June stuff still wasn't totally settled. But I also didn't expect it to take six weeks for eight judges to sign up. And not every judge offered to look at two sets, so we don't actually have every set covered right now. I released two sets for judging on Friday so each judge would be looking at one set. And now you're probably thinking, "Why didn't you just release half the batch the moment eight slots were filled?" And ... I honestly have no idea, and I'm hitting myself about that now. I don't know. It's not something we've done before that I remember, so I just wan't thinking about it. I'm sorry. I should have thought of doing that sooner. But we'll be doing that from now on. On another note ... as part of minimizing passed files, we've started collecting hard files into fewer sets, so judges who prefer not to judge hard files can be assigned sets without them. We're also going to start doing weekly check-ins now. This should help with accountability. We've also been working on a more robust judge application process. We know we need more help, but we need to make sure that help is qualified. |
11-17-2014, 08:00 PM | #9075 |
Snivy! Dohoho!
Join Date: Mar 2006
Age: 33
Posts: 6,161
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
How to be qualified?
|
11-17-2014, 08:48 PM | #9076 |
Simfile Judge
Join Date: May 2013
Posts: 476
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
well halogen promises that the batch will be on schedule then we don't hear from you for ages and now we are 2 months behind again =/
|
11-17-2014, 10:38 PM | #9077 |
shots FIRED
Global Moderator, User Support, Judge
Join Date: Oct 2003
Location: Edmonton, AB
Age: 36
Posts: 8,448
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
As I said already, we're under new management, so to speak. That was on AJ's terms, and since he's stepping down, that guarantee is no longer there. I'd like for the schedule to be on track once Silvuh/Dossar's management settles in a bit.
|
11-17-2014, 10:50 PM | #9078 |
FFR Simfile Author
Join Date: Jun 2007
Posts: 1,195
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
Anyway it's not like the files are going anywhere fast. There are files in the queue which have been there for like over a year
edit: Hopefully this batch is at least completed by the end of the year though, so re-submissions and fixes can be in time for Nov/Dec batch. And new judge applications soon plz ty
__________________
Last edited by VisD; 11-17-2014 at 10:54 PM.. |
11-17-2014, 11:13 PM | #9079 |
Batch Manager
Game Manager, Song Release Coordinator
Join Date: Mar 2008
Location: USA
Age: 29
Posts: 14,870
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
It would also be appropriate for me to mention that I'm working towards some automation in the judging process to reduce manual work. Silvuh and I are working towards fast generation of an excel spreadsheet for adjusted ratings that is not only scalable to a batch of any size, but also can be created with scripts instead of writing stuff out by hand which takes a long time.
In the future batches will consistently be done in smaller sets when there are enough judges available as opposed to waiting for many judges for an entire batch -- judge availability is very time sensitive and the delay here can be seen as a wake-up call.
__________________
Last edited by DossarLX ODI; 11-17-2014 at 11:17 PM.. |
11-18-2014, 03:00 AM | #9080 |
Confirmed Heartbreaker
Join Date: Jul 2012
Age: 35
Posts: 5,859
|
Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
Close the batch until we catch up then reopen and start fresh
__________________
|
Currently Active Users Viewing This Thread: 3 (0 members and 3 guests) | |
Thread Tools | |
Display Modes | |
|
|