Scioly.org

bernard wrote:Here's some data you can play with. I've included the Pearson correlation coefficient comparing each event to overall team rank. This can be done for any tournament's results.

Schools arent matched with scores

windu34 wrote:

bernard wrote:Here's some data you can play with. I've included the Pearson correlation coefficient comparing each event to overall team rank. This can be done for any tournament's results.

Schools arent matched with scores

Looks like this is only in Div C though (via spellchecking a few medalists that I remember in B).

Unome wrote:

windu34 wrote:

bernard wrote:Here's some data you can play with. I've included the Pearson correlation coefficient comparing each event to overall team rank. This can be done for any tournament's results.

Schools arent matched with scores

Looks like this is only in Div C though (via spellchecking a few medalists that I remember in B).

Thanks, these scores were copied directly from the spreadsheet I use for calculating prediction contest scores but thankfully prediction contest scoring is correct as it only uses team number. I've updated the file in the original post.

chalker wrote:
Max event correlation: 0.52
Average event correlation: 0.39
Standard deviation: 0.09
Min event correlation: 0.20

Ecology had a correlation coefficient of 0.28. This means it was about 1 standard deviation below the average correlation for events. There were several events with lower correlations.

In essence, what this means is that statistically, the resulting ranks in Ecology are reasonably well aligned across all teams with the overall team ranks.

Oops.. I did this during lunch and thanks to Bernard posting his sheet I realized I did the wrong ranges. Below are the actual numbers, but the general conclusion is the same:

Max: 0.85
Average: 0.75
Std. Dev.: 0.10
Min: 0.42
Ecology: 0.57

WIDI and EV are lower than Ecology.
8 of the 23 events are under the average.

chalker wrote:

chalker wrote:
Max event correlation: 0.52
Average event correlation: 0.39
Standard deviation: 0.09
Min event correlation: 0.20

Ecology had a correlation coefficient of 0.28. This means it was about 1 standard deviation below the average correlation for events. There were several events with lower correlations.

In essence, what this means is that statistically, the resulting ranks in Ecology are reasonably well aligned across all teams with the overall team ranks.

Oops.. I did this during lunch and thanks to Bernard posting his sheet I realized I did the wrong ranges. Below are the actual numbers, but the general conclusion is the same:

Max: 0.85
Average: 0.75
Std. Dev.: 0.10
Min: 0.42
Ecology: 0.57

WIDI and EV are lower than Ecology.
8 of the 23 events are under the average.

To be fair, I don't think build events and events such as WIDI can reasonably grouped together with Ecology. I have medalled at nationals twice in EV now and if you look at my history in EV at regionals and various invites, you would never even think there would be a chance that I would rank above 20th at nationals. The smallest falter in a vehicle can mean the difference between 1st and last in this event. Ecology is a study event - if you don't know one small detail, it wont significantly inhibit you from doing well. Correlation coefficients for study events should be much higher than those for builds and inherently inconsistent events such as Widi thus if you are going to compare Ecology to anything, it should only be to other study events of a similar nature (Dynamic Planet, Remote Sensing, etc)

windu34 wrote:

chalker wrote:

chalker wrote:
Max event correlation: 0.52
Average event correlation: 0.39
Standard deviation: 0.09
Min event correlation: 0.20

Ecology had a correlation coefficient of 0.28. This means it was about 1 standard deviation below the average correlation for events. There were several events with lower correlations.

In essence, what this means is that statistically, the resulting ranks in Ecology are reasonably well aligned across all teams with the overall team ranks.

Oops.. I did this during lunch and thanks to Bernard posting his sheet I realized I did the wrong ranges. Below are the actual numbers, but the general conclusion is the same:

Max: 0.85
Average: 0.75
Std. Dev.: 0.10
Min: 0.42
Ecology: 0.57

WIDI and EV are lower than Ecology.
8 of the 23 events are under the average.

To be fair, I don't think build events and events such as WIDI can reasonably grouped together with Ecology. I have medalled at nationals twice in EV now and if you look at my history in EV at regionals and various invites, you would never even think there would be a chance that I would rank above 20th at nationals. The smallest falter in a vehicle can mean the difference between 1st and last in this event. Ecology is a study event - if you don't know one small detail, it wont significantly inhibit you from doing well. Correlation coefficients for study events should be much higher than those for builds and inherently inconsistent events such as Widi thus if you are going to compare Ecology to anything, it should only be to other study events of a similar nature (Dynamic Planet, Remote Sensing, etc)

Very true. However, I am curious as to how the other build events ranked in terms of correlation coefficients.

efeng wrote:

windu34 wrote:

chalker wrote:
Oops.. I did this during lunch and thanks to Bernard posting his sheet I realized I did the wrong ranges. Below are the actual numbers, but the general conclusion is the same:

Max: 0.85
Average: 0.75
Std. Dev.: 0.10
Min: 0.42
Ecology: 0.57

WIDI and EV are lower than Ecology.
8 of the 23 events are under the average.

To be fair, I don't think build events and events such as WIDI can reasonably grouped together with Ecology. I have medalled at nationals twice in EV now and if you look at my history in EV at regionals and various invites, you would never even think there would be a chance that I would rank above 20th at nationals. The smallest falter in a vehicle can mean the difference between 1st and last in this event. Ecology is a study event - if you don't know one small detail, it wont significantly inhibit you from doing well. Correlation coefficients for study events should be much higher than those for builds and inherently inconsistent events such as Widi thus if you are going to compare Ecology to anything, it should only be to other study events of a similar nature (Dynamic Planet, Remote Sensing, etc)

Very true. However, I am curious as to how the other build events ranked in terms of correlation coefficients.

For Division C:
Electric Vehicle: 0.57
Helicopters: 0.74
Hovercraft: 0.79
Optics: 0.67
Robot Arm: 0.69
Towers: 0.79
Wind Power: 0.81

ScottMaurer19 wrote:

bernard wrote:Here's some data you can play with. I've included the Pearson correlation coefficient comparing each event to overall team rank. This can be done for any tournament's results.

Based on these results how is WIDI still an event (only partially joking)

This was the case last year too iirc, most of the events had stdevs 0.55 or above but WIDI's was around 0.4

just gonna post them in plaintext for people to see: Interestingly 0.79 is the mode for all three data sets

kenniky wrote:

winchesetr wrote:

kenniky wrote: This is actually no different from previous nationals tests, you can check last year's or the year before's.

Jon Aros's Chemistry Lab tests are easily some of the worst quality tests at the National Tournament each year. Our strategy last year, when I got 1st, was to take the previous year's test and literally put it on our cheatsheet because he was known to reuse questions (and he did; about half of the test last year was reused). I'm honestly surprised that he didn't do that this year (from what I've heard) and I hope that this is a step in the right direction, but unfortunately until someone replaces Aros I don't see the quality of Chemistry Lab at Nationals improving significantly.

Huh. Well, the more you know. It wasn't terrible - at least it didn't have the problem of a 7-way tie. And as far as I can tell from looking at past Nats tests, he didn't reuse questions. Maybe I can see if I can volunteer to help run Chem Lab next year and change things up a bit. Who knows?

Let me know if you do and I'll come help out, a Chem Lab national champion might come in handy

I heard basically the same things y'all have said about this guy in both IN state and nationals from my teammates, and hey, I don't blame ya for it - one of the people who did it on my team last year made it to USNCO camp twice and didn't do that well at either tournament last year (4th state (...STATE!! (and even Munster didn't beat us in that event that year either)), 13th nationals)...and I almost got slated to do Chem Lab last year at nationals. I love chemistry, but I wonder if I should be glad that I didn't

Wait kenniky why were you at home during nationals this year...?

If I seem to be posting this at an ungodly hour, it's probably because of where I am right now (*cough cough* China)....I'm surprised access to the site isn't blocked here

And to anyone giving tips for emerging ES's, thanks a bunch! I've certainly had my fair share of trying it out this season, and I only hope to become better at it as time goes on!