Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

Got some more supplemental judgments in last night. Only files still needing some will most likely not be getting SAP, so I can update the spreadsheet now with these numbers. Note that conditionally queued files that did not have fixes sent in have now become resubmissions.



I don't even know if PrawnSkunk ever saw that his file got conditionally queued ... So because of my own lack of communication, I'll still let his file into the queue if he sends it in again soon and doesn't want it to go through the batch again.

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

Point of clarification: why does being CQ'ed not award SAP? I would think that if the file is fixed within the given CQ window to a satisfactory standard, then SAP should be awarded. Honestly it's all kinda academic since SAP matters about as much as credits, but it's kinda strange.

For instance, if I submit a file that's worth an 8 average (like pisscord in this case), that does not preclude my file from having some obvious objective errors that I might have overlooked (due to tunneling in on the way I think a file should be stepped when there's an obviously better way or whatever). Certainly these objective errors justify some kind of penalty, but that penalty is already levied on the score a judge gives to my file.

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

That's because these files were not fixed within the CQ window. The CQ files that were fixed (For UltraPlayers, Sanctuary of pantheon, Highway Highway DESTINY, Hello, and Palace of Destruction) all received SAP.

If PISSCORD does get judged again and only gets in the 6.7-7.5 range the next time, I will consider giving it the two SAP it would have received the first time. It would be the nice thing to do, but I'm not sure if that's actually fair. Maybe I'll take the average of the two final ratings and see where that puts it. Four ratings isn't necessarily a representative sample of the whole team, but we don't really have the power to do much more in a timely manner.

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

Aite that makes a lot more sense thanks for clarify :D

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

Are there any updates with the files mentioned here:


I mean the La Triste sent e-mail I never found so I'm cool sending that in another batch, it's more the other two I'm curious about. Thanks :D

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

Because of the limited activity between batch judgments, I did end up putting Nightfall (Original Mix) and They Kidnapped the Princess (and the other four files that had been skipped over) in with the July/August batch. Sorry for not mentioning that in here earlier.

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

I'm happy to hear it :D Thanks

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

is that batch being judged atm? or hasn't judging started yet?

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

so quiet

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

Go ahead and pull odd22, having the judges play it would just be a waste of time.

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

For the record: Judging for the July/August Batch started yesterday.

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

At the risk of sounding like a dick:
Could we maybe get a different sort of system in place so that we're not just now starting getting ratings for an almost 3 month old batch?

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

Osu system~~~~~~~~~~~~~~~

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

add african anger on osu! thanks guys

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

Although I'm also complaining about the long wait, please consider that there was a transition from handing the game management from AJ to Silvuh and Dossar. A rocky start certainly affected the efficiency of the system; it is not the infrastructure of the system itself that's the issue. Recall that a lot of changes have already occurred to the judging infrastructure over the past year - not to mention a few more additions that Silvuh has implemented. It'll take some time, but I hope we can catch up quickly.

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

Well if you guys need any help, y'know, wink wink, squirm squirm, CHARU.

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

This should say "Hajnal 2 (FFR Pro 21)".

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

Understandable, but theres always several people willing to help out shown by charus post, yet rather than ask for a bit of help to keep up during/after transition, it falls behind and people say 'oops sorry' and pick back up again just to fall behind again. It seems to happen this way every couple batches and itd just be great to have it picked back up and stay that way rather than beng 2 batches late every other batch.

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

There have been discussions on here about the pros and cons of different systems, and ... I don't really remember the arguments, but it does seem like the batch system is just what works for us. "Works" relatively better, anyway.

Like, when we realized that some of the May/June files had been skipped over, I uploaded them and posted in the forum and the chat about getting extra judgments, and after a while, only one other judge had stepped up to look at them.

And you all saw how it was over a month between posting May/June's initial and final results because of the passed files. When there's a group of files that no one's assigned to look at and there's no schedule, things just don't get done. And I feel like it'd just keep being like that if we tried a "judge when you want to" system.


Yeah ... No one's happy that it took this long to start judging the July/August stuff. The original date for completing May/June judgments was the last day of August. Then that September happened ...

I opened signups for judging the July/August batch around the end of September. I didn't expect to start judging right away, because the May/June stuff still wasn't totally settled. But I also didn't expect it to take six weeks for eight judges to sign up. And not every judge offered to look at two sets, so we don't actually have every set covered right now. I released two sets for judging on Friday so each judge would be looking at one set.

And now you're probably thinking, "Why didn't you just release half the batch the moment eight slots were filled?" And ... I honestly have no idea, and I'm hitting myself about that now. I don't know. It's not something we've done before that I remember, so I just wan't thinking about it. I'm sorry. I should have thought of doing that sooner. But we'll be doing that from now on.


On another note ... as part of minimizing passed files, we've started collecting hard files into fewer sets, so judges who prefer not to judge hard files can be assigned sets without them.

We're also going to start doing weekly check-ins now. This should help with accountability.

We've also been working on a more robust judge application process. We know we need more help, but we need to make sure that help is qualified.

Re: Queue/Batch Discussion Thread v2 [Regular batch: OPEN]
 

How to be qualified?