Quantumsurfer wrote:I don't like the idea of judging just one report. Ruling doesn't feel consistent because I wouldn't be comparing it with anything else except other judgings I didn't make and may not necessarily agree with. The rulings felt a little nice guy lenient to me. Some of the comments were out of sync with the actual ruling. That's not really a bad thing, especially if the idea is to celebrate a fandom and engender a sense of community. It's pretty common. But I know, no matter which report I judged, that my scores would probably be lower than the other judges. Not because I hated them...they were all decent reports...I've been in judge positions before and I know that I tend to be sort of the reverse (nice guy in the comments, but harsher in the actual scores). Knowing that ahead of time seems distinctly unfair.
Not sure what would be fair, then. Maybe choose the two highest total scores for each and scrap the third judges response where there was one? The two lowest? Two random?
I totally agree with everything you said. Even though I joked about being biased, I think I found it hard to give either Scratch or Zahru lower scores than the highest. I may actually be too soft and caring to be a judge.