PDA

View Full Version : Judges' score difference at CDS/USDF Region 7 Champs



Mardi
Oct. 11, 2010, 10:11 PM
I went to this show at Los Angeles Equestrian Center to help a friend who was showing in the upper level amateur division.
Her test scores varied by quite a bit between the two judges who scored her ride (difference was usually 3 pts per movement, sometimes more, sometimes less). We noticed the disparity, and knew that sometimes it happens.

As the weekend went on, my friend said she heard several people - trainers and amateurs - complaining to management about the difference in scores on their tests, and the especially low scores given by a particular judge. One trainer was very vocal and made a scene in the warm up ring.

Question: how far do you take your complaint ? only to show management, or up to USEF/USDF ? Does anyone up there really care anyway ? The results can't be changed....

BetterOffRed
Oct. 11, 2010, 10:22 PM
Do you have a time machine, Mardi? Did you go into the future and see what the results were going to be for the show? ;) Because Region 9 Championships aren't until November 4. I think you mean Region 7.

Tiffani B
Oct. 11, 2010, 10:24 PM
If the judging was CONSISTENT I'd say you have nothing to complain about.

joiedevie99
Oct. 11, 2010, 10:45 PM
I assume you are talking about FEI double-judged classes, where the judges were (from the sounds of it) very far apart. I would definitely fill out an evaluation form and send it in.

honeydoozy
Oct. 11, 2010, 11:42 PM
There was a lot wrong with that show, IMO. ;)

I also heard about some pretty *significant* differences (10 percentage points?!). Have they posted the results online yet? It would be interesting to see which judges created the commotion, and if it was consistent throughout the show.

Beentheredonethat
Oct. 12, 2010, 12:04 AM
There's not much you can do. Fill in an evaluation form. Welcome to politics. Hey, I got that beat. I had a 20 PERCENT difference in scores between judges at the championships (in LA no less.) One judge was the head of the FEI at the time and gave me a 65%. The other didn't like "colored" horses and gave me a 45%

FLIPPED HER HALO
Oct. 12, 2010, 12:18 AM
There was a lot wrong with that show, IMO. ;)

I also heard about some pretty *significant* differences (10 percentage points?!). Have they posted the results online yet? It would be interesting to see which judges created the commotion, and if it was consistent throughout the show.

I was there competing this weekend. It was my first year in the dressage world and first time competing at championships. Overall I wasn't impressed with the running of the show at LAEC. It was really hard to find the stabling maps etc and several of the help were snippy.

Many of the exhibitor dinners and hospitality that were listed in the premium never happened. Dinners were to be provided every night and all that happened was Little Caesars Pizza the first night. A lot of folks in the barns were upset about this as they were counting on those dinners after riding all day. There wasn't an announcement or revised premium - they just never happened. We asked and were told they didn't have sponsors for them so they canceled them. Yet they were charging people to attend and watch the show...

Lots of gorgeous horses and met some great folks. The only scores I've seen online so far are on Cornerstone. They are the grand total scores though. I'd photographed the score sheets for my class so could see the comparison on all the scores.

http://www.cornerstonedressage.com/results/2010USDF.pdf

honeydoozy
Oct. 12, 2010, 01:13 AM
We asked and were told they didn't have sponsors for them so they canceled them. Yet they were charging people to attend and watch the show...



I thought the charging of $10 *per day* was ridiculous. We need to be encouraging spectators/sponsors, not shut them out! If I were a vendor, I would be seriously upset. It's bad enough to have to pay $$ for a spot, but then to have your audience limited, is really unfortunate.

Like I said, there was a LOT wrong with this Championship show... please don't let it turn you off - I hope you had a good time anyway!!

(and thanks for posting some scores! :))

poltroon
Oct. 12, 2010, 01:39 AM
At the championships, the placing is more important than the percentage, so one judge being consistently lower should not be a big problem.

It's also worth noting that judges have different views of the action. It was interesting to watch the live scoring at WEG. Frequently, the judges gave similar marks. But, frequently, they gave marks that were quite different; I know I saw one that got 4 and 8. Sometimes the glorious extended canter from the side is way crooked from the front, etc.

ShotenStar
Oct. 12, 2010, 10:24 AM
This should not be a surprise to anyone. As we documented in our statistical analysis paper, a 10-13% point difference in scores between the high scoring judges and the low scoring judges is real. If you showed before one of the highest of the high scoring judges and one of the lowest of the low scoring judges, an even greater difference is possible.

Does this constitute a "reportable offense"? If each judge was consistent in their scoring and each class was ranked appropriately, probably not. While it is not pretty and does not do anything to advance the cause of judges as fair arbiters of dressage standards, having differences of opinion is not against any rules.

Does this wide difference constitute a problem for the dressage world? Very much yes. Lack of consistency in the application of the test standards eats away at the core of the showing process. It also calls into question the validity of all those awards that are based on achieving or exceeding a set point bar .... if you are smart and judge shop carefully, you can win a bunch of big awards yet not have the refined skills that should go with those scores.

*star*

caddym
Oct. 12, 2010, 10:39 AM
Her test scores varied by quite a bit between the two judges who scored her ride (difference was usually 3 pts per movement, sometimes more, sometimes less). We noticed the disparity, and knew that sometimes it happens..

So are you saying that for example one judge gave her "extended trot" and 8 and the other a 5 and that was consistent throughout the majority of the movements of the test?

If so I don't think that should happen.

I can see how one judge would think "7" and the other "6" and that the percentage might thus be "70" and "60", but I think a 3 point difference in the movement should be an oddity.

Mardi
Oct. 12, 2010, 09:33 PM
Do you have a time machine, Mardi? Did you go into the future and see what the results were going to be for the show? ;) Because Region 9 Championships aren't until November 4. I think you mean Region 7.

OMG. Yes, Region SEVEN.
Thanks.

Mardi
Oct. 12, 2010, 09:41 PM
So are you saying that for example one judge gave her "extended trot" and 8 and the other a 5 and that was consistent throughout the majority of the movements of the test?


Yes.

Mardi
Oct. 13, 2010, 12:51 AM
Many of the exhibitor dinners and hospitality that were listed in the premium never happened. Dinners were to be provided every night and all that happened was Little Caesars Pizza the first night. A lot of folks in the barns were upset about this as they were counting on those dinners after riding all day. There wasn't an announcement or revised premium - they just never happened. We asked and were told they didn't have sponsors for them so they canceled them.


Didn't have sponsors ? That's absurd. Who advertises an event, and THEN tries to find a sponsor ? If a sponsor can't be found, the party still goes on out of pocket. You can't take it back !! What a public relations nightmare. I know people who would have gladly sponsored one of the parties.

If anyone is going to complain to USEF about the show, another letter should be sent to the title sponsor of the USDF Regional Champs: Great American Insurance Group.

Peggy
Oct. 13, 2010, 01:07 AM
Scores for two different classes from the Reg 7/CDS Show as posted on someone's Facebook. Class and horse names cropped to protect the innocent. Don't know if Judge B and Judge C were the same for each class. Note the disparity between the two judges on the first two horses in the second class: one got 56% from C and 77% from B, while the other got 72% from C and 63% from B (percentages rounded to nearest whole number) so, at least in that case, the placings weren't consistent from judge to judge.

FLIPPED HER HALO
Oct. 13, 2010, 01:41 AM
Didn't have sponsors ? That's absurd. Who advertises an event, and THEN tries to find a sponsor ? If a sponsor can't be found, the party still goes on out of pocket. You can't take it back !! What a public relations nightmare. I know people who would have gladly sponsored one of the parties.

If anyone is going to complain to USEF about the show, another letter should be sent to the title sponsor of the USDF Regional Champs: Great American Insurance Group.

CDS sent an email today asking for our comments on the shows - both good and bad. I mentioned this among a few other things. The MEC show last year seemed to run a lot smoother.


Scores for two different classes from the Reg 7/CDS Show as posted on someone's Facebook. Class and horse names cropped to protect the innocent. Don't know if Judge B and Judge C were the same for each class. Note the disparity between the two judges on the first two horses in the second class: one got 56% from C and 77% from B, while the other got 72% from C and 63% from B (percentages rounded to nearest whole number) so, at least in that case, the placings weren't consistent from judge to judge.

Wow, some of those are pretty different. I know in my class I competed in the scorea were darn consistent. There were a few that were off by a few percents, but for my own score it was really similar between both judges.

honeydoozy
Oct. 13, 2010, 03:38 AM
Didn't have sponsors ? That's absurd. Who advertises an event, and THEN tries to find a sponsor ? If a sponsor can't be found, the party still goes on out of pocket. You can't take it back !! What a public relations nightmare. I know people who would have gladly sponsored one of the parties.

If anyone is going to complain to USEF about the show, another letter should be sent to the title sponsor of the USDF Regional Champs: Great American Insurance Group.

Yeah, I'm not really buying the "no sponsors" thing either. If you say you're going to do something - do it.

(that $10 per person/day entrance fee should have offset some of that??)

Then again, I've come to NOT expect to see the advertised "hospitality" events at the LAEC shows... they just don't really happen, and when they *do*, they seem like an afterthought and not a real attempt to appreciate and celebrate exhibitors ( who sort of make the whole thing happen, ya know?). :no:

The whole "vibe" coming from the production of that show just seemed...unfriendly.

tm
Oct. 13, 2010, 11:32 AM
If you, as a rider, received extremely disparate scores and you are not happy about it, fill out a show report.

This is the ONLY way that this information will get reviewed by the Licensed Officials Committee.

inca
Oct. 13, 2010, 11:58 AM
It's hard to believe there wasn't SOME kind of mix-up or scoring error on the test that got a 55.9% from one judge and a 77% from the other judge. I just can't fathom how 2 judges can see a test THAT differently!

MLD
Oct. 13, 2010, 01:19 PM
I attended the show. I have attended the region 7 annual show for several years in a row. First of all, I have yet to see the evening hospitality event offer up anything much better than Little Caesars Pizza.

We also need to remember the RAIN!!!! It basically rained for two days (tues and wed) straight right before the show. I think show management had a lot more things to deal with rather than if we liked the pizza. They had to reschedule classes to fit everything from 5 arenas into the usable three arenas. They had to deal with the fact that for most of the first day of the show (thurs), there was one arena and a parking lot to use for lunging and warm-up and schooling. What some of the competitors at the show seem to forget was, this was happening to ALL of the competitors and not to just their so important self. Show management was getting pounded by complaints and it isn't like they ordered the rain, they were doing the best they could with the hand that EVERYONE was dealt.

The show management is the same if the annual show is at Rancho Murrieta, LAEC or Woodside. I think we should all be counting our lucky stars that we are having the show at Rancho Murrieta instead of Woodside next year.

Mardi
Oct. 13, 2010, 07:04 PM
If LAEC and Cornerstone cannot handle 325 horses in rain (many in temporary stalls), then find a better place, like Del Mar Fairgrounds.
CDS owes it to their exhibitors, who are also their customers !

Del Mar has permanent 12 x 12 stalls for everyone, large indoor ring, a large hotel right across the street, and the village of Del Mar 10 minutes away.
If it's going to rain, it's going to rain, but at least no one will be in temporary stalls with a foot of standing water.

My friend who was showing this year and I went to the exhibitor's party. We were late, but decided to stop by to see if it was still going on. Pizzas in cardboard boxes were still available. We thought we were at the wrong place. It was certainly not worthy of a CHAMPIONSHIP show, where people have spent thousands all year to compete and qualify.

I stopped competing at Cornerstone run shows a years ago because of the poor management. I felt like an idiot spending so much money and receiving such poor value in return.

That said, it was kind of fun being there this year, and not showing. I didn't have to deal with any nonsense from management. :)

honeylips
Oct. 13, 2010, 07:18 PM
It only rained 1 day - Wednesday.
The 2 of the rings were properly rolled and prepped for the rain - and they survived - not great - but they survived.

2 of the rings were not rolled or prepped for the rain and in fact had tractors driving all over them creating huge ruts that then filled in with rain and made the rings unusable.

MLD
Oct. 13, 2010, 07:21 PM
If LAEC and Cornerstone cannont handle 325 horses in rain (many in temporary stalls), then find a better place, like Del Mar Fairgrounds.
CDS owes it to their exhibitors, who are also their customers !

Del Mar has permanent 12 x 12 stalls for everyone, large indoor ring, a large hotel right across the street, and the village of Del Mar 10 minutes away.
If it's going to rain, it's going to rain, but at least no one will be in temporary stalls with a foot of standing water.



Yes, Del Mar might be easier in rain situation but it is so easy for those of you in So Cal to forget, CDS also covers the area of No. Cal and No. Nevada. We already have to travel 10 hours each way to get there. That includes taking off two extra days from our jobs to do so.

I don't travel 10 hours to eat the pizza. I would much rather have the show management making sure I have a place to school my horse than what they provide me to stick in my mouth.

Oh and the many in temporary stalls amounted to about 50 horses at the most.

Mardi
Oct. 15, 2010, 01:06 PM
Oh and the many in temporary stalls amounted to about 50 horses at the most.

It doesn't matter if it was 10 horses or 50 !

Those exhibitors qualified and entered the show payng the same entry and show fees as those in permanent stabling. The cost of stalls was the same ($150) for both perm. and temp.

They deserve (and have paid for) adequate stabling just like those in permanent stalls.

If show management/CDS chooses not to provide that for ALL competitors,
they have trouble coming from USEF.

That's why Del Mar is the better place. Same stabling for everyone, rain or shine.