DonorsChoose.org - Teachers ask. You choose. Students learn.
Showing posts with label WAR. Show all posts
Showing posts with label WAR. Show all posts

Monday, May 9, 2011

W.A.R., Part 2, Building a Stats List

In developing WAST (Wins Above Substitute Teacher), it is important to remember that WAR (baseball’s Wins Above Replacement) is a composite statistic. This means that it isn’t a simple matter of measuring one area of performance and calling that the whole picture. Imagine the uproar we could cause in the baseball community if we established that the only viable statistic to judge a player is the number of triples he hit. You’d have an awful lot of slow power hitters chasing you. But, at least you’ve pissed off the slow ones and have a shot at escaping…

Anyways! In order to develop an accurate WAST we need to take the same composite approach. To do this, however, we first have to develop a set of statistics that can be used to show some aspect of teacher performance.

I have begun a list of statistics below, but need help. Please suggest whatever statistics you would use to measure a teacher in the comments field. Keep in mind, though, a good statistic must be measurable and replicable. Weighting of various stats will be debated once the list is created.

The list below is a list of ideas, not my personal feelings on what are appropriate statistics or not, that discussion can come later.

Experience
Years Teaching (YT) – Number of years the teacher has spent actually teaching in the classroom.
Years in Related Field (YR) – Number of years the teacher has spent involved in their field outside of direct teaching (research, professional experience, etc.).
Courses Taught (CT) – Number of actual courses taught, not just length of time teaching them.
Years in Courses Taught (YCT) – CT/YT – Designed to show the amount of career time dedicated to each subject.

Classroom Engagement
Course Drops (CD) – Percentage of students in class that drop the course after the first day.
Disciplinary Referrals (DR) – Percentage of class that receives disciplinary referrals (detention, principal’s office, etc.) due to disruptive behavior in the classroom.
Time as Teacher (TT) – Percentage of class days that are spent watching movies, documentaries, or other multimedia that allows the teacher to disengage.

Academic Success
Standardized Test Results (STR) – The average scores of the teacher’s classes on related standardized testing.
Matriculation Rate (MR) – The average success rate at moving students on to the next grade level at the completion of the year.
Preparation Rate (PR) – Percentage of students who fail the subsequent course.
College Enrollment Rate (CER) – Percentage of students who go on to enroll in post-secondary education.
College Graduation Rate (CGR) – Percentage of students who obtain a post-secondary degree.

Continuing Education
Bachelor’s Degree (BD) – Recognition for holding a Bachelor’s degree in a related field.
Master’s Degree (MD) – Recognition for holding a Master’s degree in a related field.
Doctoral Degree (DD) – Recognition for holding a Doctoral degree in a related field.
Professional Degree (PD) – Recognition for holding a Professional degree in a related field.
Continuing Courses Taken (CCT) – Number of related courses taken, outside of degree requirements.

That is my list so far, I’m sure there’s a lot more to add. Please send me your suggestions and comments!

Thursday, May 5, 2011

Wins Above Replacement, Part 1

What makes you the best?

It is incredible how difficult that simple question is.

For many professions, the answer does seem simple. The best businessmen make the most money. The best lawyers win the most cases. The best engineers produce the simplest, most cost-effective solutions. For nearly any profession, the best are rewarded with the best contracts, the best opportunities, the most fame. Of course, there really is no profession that works quite as hard at identifying and rewarding the best than professional sports. In particular, professional baseball.

Baseball is the statistician’s dream. Every little action in baseball is calculated, quantified, accumulated, averaged, and dissected. I guess there’s something to be said for a sport that not only provides sample sizes so huge that margins of error diminish to negligence (who else plays a game almost half of the days of the calendar year?) but also provides so frequent pauses in the action that you literally have nothing better to do than math? Scoring a baseball game during the actual event is a time honored tradition passed down from father to son for generations. When was the last time you saw a young boy at a basketball or football stadium calculating the results of each play? But I digress…

In the world of baseball statistics, there are calculations of nearly every action taken on, and sometimes even off of the field. Yet, the sole point of all of these statistics, all of the innumerable hours of calculating, are designed to answer one simple question: who is the best? ERA (Earned Run Average) tells you which pitcher is able to give up the least runs, certainly a useful skill for the guy holding the ball at the start of each play. But, is a pitcher really that good if he has to rely on amazing defensive plays by those around him to keep everyone from scoring? We look to DICE (Defense-Independent Component ERA) to show how well the pitcher pitches without the help of his teammates. Still, a pitcher that gets a lot of double plays is a pitcher that can get a ground ball in the right situation, and that’s got to be a valuable skill, right? So, why don’t we compare that pitcher to all the other pitchers in the league who’ve benefited or been hindered by the unique dimensions and quirks of a certain ballpark or league? No problem! Just use ERA+. And this is only a few of the stats kept on one of 10 baseball positions (9 in the National League, of course)!

With all this, there is one statistic that stands out to me above all others. WAR. Huh? Yeah. Good god, ya’ll, what is it good for? Well, it is good for trying to measure one player against the imaginary guy who could take his job at any minute. WAR, or Wins Against Replacement, is essentially a statistic that pits your real flesh and blood player’s statistics against a fictitious “replacement.” This statistical chimera is given a set of statistics considered to be slightly below average for a big league player, and then, through the magic of fuzzy math, you find out if your real life player is helping your team to win more games or less than some bum you just pulled out of the minors would.

What a fascinating concept! Could you imagine it being applied to any other field? I have to say that there is a small part of me that would love to slip into Dunder Mifflin and explain to Dwight that his attitude is costing his company six sales per season over the other employee they could’ve hired. Something tells me this wouldn’t sit too well on the Schrute Beet Farm.

Fortunately for us all, there really aren’t those kind of statistics out there. We don’t necessarily have the data to say to a teacher, “Your replacement would have brought three less students all the way to graduation, congrats!” But for discussion’s sake, the question of how we could ever measure that is valid. Shoot, in today’s political climate, it seems to be more important than ever to prove that a teacher is doing their job “above replacement.”

So, this is the beginning of a series of discussions about, essentially, creating a WAR for teachers, and how to stay on the positive end of the results. What statistics could be used? Where can teachers be measured, and what measurement is desirable? Are the best teachers like pornography, or can we actually find a way to define it before we see it? How do you measure the best teacher, and more importantly, how do you live up to those measurements.

A good baseball player will go to his batting coach and take some extra practice swings when he sees his batting average turn south. Is there a tool, or tools out there, that can warn a teacher when they’re off their game? Is there a teaching cage to go to for practice? Is there a coach in the wings?

This is what I want to know: what makes the “best” teacher? How do I get there? How do I stay there once I do? How can I help others along the same path?