Crime Busters - Supervisor Review
Salutations! I'm
jaspattack, and I'm incredibly grateful to have supervised for BirdSO! I had the pleasure of working on the
Crime Busters test along with
my co-ES, Claire. If you're reading this, you likely survived the exam period and I'd like to congratulate you on making it that far. This was a tough test (like many others at this invitational) and you did it! Pat yourself on the back.
Running Crime Busters in a virtual setting is difficult. Every team has their own approaches to ID, and ways they like to split up exams. Tests in normal seasons tend to err on the shorter side, allowing ample time for teams to perform tests and clean up their stations while still being able to complete a majority of the test. However, in a virtual season where information is available without having to perform tests, teams experienced at identifying unknowns can move through the test at a much faster pace than they would be able to in a normal season. As a result, this test is really, really long. Very few teams made it through the test, and those that did likely left large sections blank. Only two teams had answers for all 114* questions, and only 5 teams answered more than 100 questions.
*There were 115 questions on the Scilympiad version of the test, which included our "honor code" question at the beginning. However, the test itself only has 114 questions, which is reflected on the release document.
Stats
Points Possible: 346, with 100 possible on the analysis portion
Mean: 93 (26.8%)
Median: 88 (25.3%)
Standard Deviation: 46
The scores for this test were pretty low! The
top score was a 57%, and most teams scored much lower than that. The first three sections (powders, liquids, and metals) as well as the analysis were not graded by me so I can't speak as much on them, but I do know that the hair, soil and DNA sections were tough on teams. Plastics were also difficult, with the highest score on the plastic subsection being a 56%. Teams did well on the fingerprints section, with a lot of teams getting at least half the points possible.
My goal with the second half of the test was to write more conceptual questions to check that teams not only understand the purpose behind the use of each subject in an investigation, but also the concepts and principles that drive them. It's not enough to know how to match one DNA fingerprint to another -- you should understand why you are able to do that in the first place. A full, conceptual understanding of topics in the rules separates the top teams from the rest.
As a result, the distribution for this exam was very linear. I'm impressed with how well it separated teams; we had very few (if any, I don't quite remember) ties to break. I wish I had more to say about the powders, liquids and metals, but those sections were largely out of my control and were handled entirely by Claire. I'd like to thank her for being a wonderful co-event supervisor, since this test wouldn't exist without her.
Conclusion
Thank you to everyone who took this test, and to all of the event supervisors and tournament directors that volunteered for this invitational! This was an incredibly well-run tournament, and I don't know how I'm going to be able to supervise for any other in the future without wishing it was BirdSO. The team pulling the strings was working around the clock some days, and I know for a fact that they're an incredibly talented group that will do some fantastic things in the future. I just hope that I'll be there to see it when they do!
As always, the test and the score distribution are available in the release folder posted earlier in the thread (and in the pinned messages of the #birdso channel in the Discord server). If you take it, feel free to shoot me a message and let me know! I hope you enjoy taking it as much as I enjoyed writing it.
Until next time,
jaspattack