Queue/Batch Discussion Thread v2

Collapse
This topic is closed.
X
X
 
  • Time
  • Show
Clear All
new posts
  • #1906
    FFR Originalbro
    FFR Simfile Author
    Rebirth0
    • Jun 2003
    • 8751

    Re: Queue/Batch Discussion Thread v2 (Submission Closed)

    For the sake of the argument, I don't care about the judgement on Fleeting Fantasy.

    I'm simply offering easy advice. Do not let technicality be the weighted factor in judging files. There are plenty of good files that can be made with the old school approach. If a file is offsync or notes are clearly off (bad use of rainbow syndrome) then that's one thing. But if a file isn't technical or layered enough, then it should matter.

    I don't know what to think about the judging process of today. It's hard to have a solid standard of how things should go and what mindset to use when there are 12 judges. I personally liked it back when it was just me and jimerax judging. Tass' opinions got in the way more than I would have liked and some things got rejected that shouldn't have been and vice versa

    There is a way to have a perfect judging system. Have ONE judge, PERIOD. But that judge has to be someone very very familiar with all styles and have a ton of history and knowledge of the game. I think these seasoned members should have the ability to judge correctly. There needs to be balance between technicality and fun factor. (the same shit thats been said a million times before)
    Last edited by Rebirth0; 10-17-2011, 11:14 PM.

    Comment

    • #1907
      lol happy
      FFR Simfile Author
      hi19hi19
      • Oct 2005
      • 12283

      Re: Queue/Batch Discussion Thread v2 (Submission Closed)

      I'd be most happy with all 12 judges playing every file, to be honest. The more reviews the better, especially from a wide range of skill levels and mindsets.

      Of course that's asking a little much so I feel the current system is a decent compromise.


      Comment

      • #1908
        FFR Originalbro
        FFR Simfile Author
        Rebirth0
        • Jun 2003
        • 8751

        Re: Queue/Batch Discussion Thread v2 (Submission Closed)

        I don't have any new ideas for judging. The one judge thing is the best way to do it fairly, but we've been down that road before. As the site got more popular, more submissions were made, and the workload got way too big. That's why we got to 3 judges, then 5, now 12

        Comment

        • #1909
          FFR Player
          who_cares973
          • Aug 2006
          • 15407

          Re: Queue/Batch Discussion Thread v2 (Submission Closed)

          two groups of 6 judges.

          bam problem solved

          how i judge a file:
          start with 20 points

          is it on sync? if no -12 points
          is every sound represented one way or another? if no -10 points
          is there a new technique being employed? if no -20 points
          when i close my eyes and listen to the song is the file similar to what i imagined? if no -20 points
          is it fun? if no -5 points
          Last edited by who_cares973; 10-17-2011, 11:32 PM.

          Comment

          • #1910
            stepmania archaeologist
            FFR Simfile Author
            qqwref
            • Aug 2005
            • 4096

            Re: Queue/Batch Discussion Thread v2 (Submission Closed)

            you forgot "is it by dossar? yes -15 points"
            Best AAA: Policy In The Sky [Oni] (81)
            Best SDG: PANTS (86)
            Best FC: Future Invasion (93)

            Comment

            • #1911
              ★★★★★
              FFR Simfile Author
              FFR Music Producer
              jimerax
              • Nov 2003
              • 8185

              Re: Queue/Batch Discussion Thread v2 (Submission Closed)

              btw, can someone make a point list of the last batch please (sry if I miss it)?

              Comment

              • #1912
                FFR Simfile Author
                FFR Simfile Author
                dag12
                • Dec 2004
                • 468

                Re: Queue/Batch Discussion Thread v2 (Submission Closed)

                I'll do it.

                Edit:
                Did it in an excel file, so sent it by email.
                Last edited by dag12; 10-18-2011, 04:27 AM.

                Comment

                • #1913
                  ★★★★★
                  FFR Simfile Author
                  FFR Music Producer
                  jimerax
                  • Nov 2003
                  • 8185

                  Re: Queue/Batch Discussion Thread v2 (Submission Closed)

                  Excel.. nice, thanks.

                  wow, 62 files have 13+ rating out of 97 files already.
                  I doubt we really should do voting for borderline (12) files with this acceptance rate.

                  Comment

                  • #1914
                    stepmania archaeologist
                    FFR Simfile Author
                    qqwref
                    • Aug 2005
                    • 4096

                    Re: Queue/Batch Discussion Thread v2 (Submission Closed)

                    It doesn't seem fair to throw out 12/15s just because there were a lot of good files in the batch. They were just as good as 12/15s from any other batch, and should have the same treatment.

                    I'm not really sure why you're against having a lot of files in FFR - if they truly are good files, there's nothing wrong with having more of them. There are already over 1000 public charts, so if you're worried about there being too many charts for a casual player to handle, we definitely already reached that point.
                    Best AAA: Policy In The Sky [Oni] (81)
                    Best SDG: PANTS (86)
                    Best FC: Future Invasion (93)

                    Comment

                    • #1915
                      FFR Player
                      who_cares973
                      • Aug 2006
                      • 15407

                      Re: Queue/Batch Discussion Thread v2 (Submission Closed)

                      with that many accepted files id rather have all borderline files worked on and refined instead of being voted on

                      Comment

                      • #1916
                        FFR Simfile Author
                        FFR Simfile Author
                        ichliebekase
                        • May 2006
                        • 3213

                        Re: Queue/Batch Discussion Thread v2 (Submission Closed)

                        Including the previously queued files and excluding all of the ones 12 and lower from this batch, there's now 90 charts ready (ish I should say) to go in game...

                        Batch clearing event sounds like a good idea x]
                        Last edited by ichliebekase; 10-18-2011, 12:27 PM.
                        Glorious Morning - Misc, level 48
                        We Will Fly - Dance 2, level 53
                        =.The Ocean.= - Dance 2, level 56, collab with krunkykai22
                        Garden Party - Dance, level 38

                        Comment

                        • #1917
                          ★★★★★
                          FFR Simfile Author
                          FFR Music Producer
                          jimerax
                          • Nov 2003
                          • 8185

                          Re: Queue/Batch Discussion Thread v2 (Submission Closed)

                          Overall quality of this batch might be good this time, but obviously it's does not explain the acceptance rate enough from what I've seen. Leniency in judgement, or limitation of current rating system might affect at the same time. For future batches whole judgement system definitely will be changed, anyway.

                          The concept of the judgement should be either accepting all semi-good files and go for the quantity, or accepting selected number of files and go for the quality. I'm just leaning to the latter.

                          13/15 is just a cutoff, and we have to set the cutoff to determine the borderline anyway. For this time, I'm not against having borderline vote for the consistency though.

                          Comment

                          • #1918
                            FFR Simfile Author
                            FFR Simfile Author
                            ichliebekase
                            • May 2006
                            • 3213

                            Re: Queue/Batch Discussion Thread v2 (Submission Closed)

                            Sent in fixes for We Will Fly. The new version should have 808 steps (just so this is clear as to which is the correct one).
                            Glorious Morning - Misc, level 48
                            We Will Fly - Dance 2, level 53
                            =.The Ocean.= - Dance 2, level 56, collab with krunkykai22
                            Garden Party - Dance, level 38

                            Comment

                            • #1919
                              Rhythm game specialist.
                              FFR Simfile Author
                              FFR Music Producer
                              TC_Halogen
                              • Feb 2008
                              • 19510

                              Re: Queue/Batch Discussion Thread v2 (Submission Closed)

                              There was mention in the Simfile Judgment forum by JX to use the [+] rating a bit less, yet nearly every judge had double digits. This isn't to say that the quality of files wasn't good, but there are a few files with extremely questionable ratings in this batch.

                              I'm afraid I have to agree with wc on this for batch control -- with a 60% acceptance rating, adding more files that are borderline will be an excessive amount of files.
                              Last edited by TC_Halogen; 10-18-2011, 12:35 PM.

                              Comment

                              • #1920
                                FFR Player
                                who_cares973
                                • Aug 2006
                                • 15407

                                Re: Queue/Batch Discussion Thread v2 (Submission Closed)

                                i'll use [+] less when theres a better system in place to distinguish good, kinda good, and acceptable though i dislike certain section that are stepped that ruin the flow but arent necessarily wrong

                                Comment

                                Working...