Thursday, November 25, 2010

Everything's Amazing and Nobody's Happy

It's Thanksgiving morning and I'm thankful for my many, many blessings. Not the least of them is my freedom.

We all fail to appreciate what we have. It's simply human nature. At least one day each year, we're reminded to think about how lucky we really are, to take stock of the miracles of everyday life that surround us.

I coincidently ran across this video this morning. It's a clip from the Conan O'Brian show, an interview with a comedian I never knew by name previously. His name is Louis CK. He talks about how everyone fails to appreciate what they have. It's funny, and like all good comedy, it makes a point.

It really gets rolling when he talks about "the crappiest generation" becoming frustrated when they don't get an immediate response on their cell phone, and it peaks when he talks about the guy in the airplane who gets pissed because he lost his internet connection at 35,000 feet above the earth.



I wish you all a grateful Thanksgiving

Wednesday, November 24, 2010

Judges Gone Wild

CAUTION: This post contains plots corrected in Judges Gone Wild, Revised.

As I work on the summary chapter for my monograph Regarding the Rate of Wrongful Conviction, I keep finding new stories in all the data I've compiled and created. I frequently find myself in awe of what is unfolding before me. I'm still wrestling with the significance of the figure I displayed in Burden of Proof As a Legal Fiction. The one I am about to show you is equally revealing and equally troubling.

I wanted a way to display the odds an innocent person faces when tried for a crime. I knew the numbers Bruce Spencer calculated from the NCSC judge-jury agreement data. (He only had one number for the judge and one number for the jury, since the NCSC data were not broken down by crime.) I also had a sense of the numbers I had for the jury on a crime-by-crime basis. I had derived them from the Kaven-Zeisel judge-jury agreement data. My jury numbers (plural) corresponded reasonably well to Spencer's jury number (singular).

I only recently (as in today) got around to deriving my judge numbers from the Kalven-Zeisel data.

Whoa!

Here you go. Click to enlarge. We'll talk after you pick yourself up off the floor.

Professor of Statistics Bruce Spencer calculated you stand a 25% chance of being convicted by a jury if you are innocent. That value corresponds to the bottom of the green horizontal bar. My calculations show that the value is sensitive to the type of crime, and is slightly less than Spencer predicted. My values are indicated by the bottom of the brown vertical bars. They range from a high of 32% for drugs to a low of 14% for forcible rape. For a substantial majority of the trials, excluding drugs, the number is around 16%. That's one chance in six. That's bad enough, but better than the one chance in four predicted by Spencer.

Bruce Spencer and I, however, disagree on the risk an innocent party faces at the hands of a judge. Spencer predicts that judges (during bench trials) convict 37% of the innocents who come before them. That's horrible, but not nearly as horrible as I calculate. My calculations indicate that those people wrongfully charged with murder are convicted in 73% of the bench trials. Instead of slightly more than one time out of three, I calculate they are convicted three times out of four.

I'm discouraged.

The best of a bad crime-category lot is forcible rape. I calculate that judges convict "only" 35% of those people wrongfully charged with and tried for forcible rape. The judges' performance for every other crime category is worse.

Worse than a 35% chance of convicting an innocent person.

Worse.

As bad as a 73% chance of convicting an innocent person.

ERRATA: This post contains plots corrected in Judges Gone Wild, Revised

Sunday, November 21, 2010

Burden of Proof as a Legal Fiction

In this post, I intend to prove to you beyond a reasonable doubt that the concept of "proof beyond a reasonable doubt" is nothing more than a legal fiction. This shouldn't take too long.

I begin by asking you to consider the burden of proof in a civil case. That burden is usually described as the "preponderance of the evidence."  It's a 50-50 type decision. If the evidence favors the plaintiff even by a  teensy weensy bit, the jury is to find in favor of the plaintiff. If, on the other hand, the evidence favors the defense even by a smidgeon, then the jury is to find in favor of the defense. It's so simple.

I present the idealized concept of preponderance of the evidence in the figure below. Click to enlarge.
Matters are a little more confusing for jurors in a criminal case. They are asked to decide if the evidence proves the State's case beyond a reasonable doubt. The jurors must figure out how heavily the evidence favors the prosecution AND they must figure out what the hell the term reasonable doubt means AND they must decide whether the weight of the evidence provided by the prosecution exceeds the reasonable doubt threshold.

Courts are of almost no help in determining the meaning of reasonable doubt. One thing they absolutely will not do is apply any numeric value to reasonable doubt. They never suggest anything such as "you must be 90% certain."

Never. Ever.

Not now. Not ever.

Instead, they give you a reasonable doubt instruction something along the line of:
The question naturally is what is a reasonable doubt. The words almost define themselves. It is a doubt based upon reason and common sense. It is a doubt that a reasonable person has after carefully weighing all of the evidence. It is a doubt which would cause a reasonable person to hesitate to act in a matter of importance in his or her personal life. Proof beyond a reasonable doubt must be proof of such a convincing character that a reasonable person would not hesitate to rely and act upon it in the most important of his own affairs.
There you go. I'm sure that clarified things.

Legal scholars, and I've been reading a lot of their scholarly work on this issue recently, recognized that if you are to quantify the number, it should be greater than 50%. That after all is the standard for civil cases, and the burden of proof in criminal cases is supposed to be substantially greater. Legal scholars tend to throw out a value of 90% as a starting point. This corresponds roughly to William Blackstone's 250 year old claim that it is "better that ten guilty persons escape than that one innocent suffer."

That traditional view is portrayed in the figure below.
Those legal scholars who believe that figure portrays reality are full of scholarly beans.

When Rita Simon and Linda Mahon asked 106 judges to put a non-legally-binding number to proof beyond a reasonable doubt, those judges gave a number (presumably on average) of 89%. Since that's almost identical to the number the full-of-beans legal scholars provided, I declare that judges too are full of judicial beans, at least with respect to this concept.

Simon and Mahon also asked 25 jurors to put a number to the concept. Those jurors put the number at 79%. That number is not far from a couple other studies I've seen where jurors put the number around 75%, assuming they are asked before they deliberate in a mock trial. If they are asked after they deliberate, the put the number closer to 55%. The suggestion is that they wanted to convict, the evidence didn't support conviction at even a 75% standard, so they reduced the standard.

Even though the students eventually put the standard just barely above a civil suit "preponderance of the evidence" standard, I declare my fellow jurors to be full of deliberative beans, at least with respect to this issue.

I'll allow the judges and jurors to make my point for me. During the NCSC judge-jury agreement study used by Bruce Spencer to establish a wrongful conviction rate around 10%, the judges and jurors were asked to provide their estimate of the strength of the evidence used to convict (or acquit) a defendant. I'll simply provide a summary plot of the results below, and move away from the keyboard a bit as you study the plot and say "What the hell?" Click to enlarge.
Okay. I'm back. The first thing the Skeptical Spouse said when I showed her this plot was "That's not right!!?"  She was pointing to the portion where the jurors voted more frequently to convict when the strength of evidence was 1 than when it was 2. I replied with something equally as scholarly, something along the lines of "Screw that. They're voting to convict a third of the time when by their own admission the evidence strongly favors the defense."

Even when the evidence favors neither the prosecution nor the defense, both judge and jury are voting two out of three times to convict. Anyone who studies the chart for more than a minute and  still believes that we presume defendants to be innocent, or that we burden the prosecution with proof beyond a reasonable doubt, is full of blog-reading beans.

This one simple plot, based directly on data provided by judges and juries, demolishes dozens of scholarly works I've read regarding quantifying reasonable doubt. This plot causes me to propose an alternative hypothesis of jury behavior. It may not be scholarly, but it better explains the data. Here goes.


Besides destroying much scholarly work and putting the lie to some of the most fundamental principles of our judicial system, the plot also tells you that those who guess and those who divide are pretty much wrong when they arrive at wrongful conviction rates of 1 or 2 or 3%. There is no way that the behavior portrayed in the chart would result in such low error rates.

I'll add one final chart, then I'll step away from the keyboard. In the chart below, I simply overlay the idealized and realized worlds of proof beyond a reasonable doubt. I'll allow the chart to speak for itself.

Thursday, November 18, 2010

Michael Ledford: An Overview

Stuarts Draft, Virginia
October / November 1999

One month after an apartment fire took the life of his one-year-old son and seriously burned his wife, Michael Ledford signed a document stating:
Around 8:00 P.M. we put Zach to bed then Elise went to bed at 8:30 P.M. I told Elise that I was going to put gas in the car and put my name on the EVAC sheet at the firehouse then write the check for Pied Piper then go to bed. Before I left, I lit a candle and threw it in the chair. I never wanted to hurt my family. I was tired of trying to live up to Elise's parents' standards. I now wish I had took my mom's advice and moved back to Pennsylvania. I agree I need help, and willing to get -- and willing to get help. I just hope my family and friends and God can forgive me.
Two fire investigators confirmed the arson.

A jury convicted Michael Ledford of first-degree murder and arson of an occupied dwelling.

A judge sentenced him to 45 years for the murder and 5 years for the arson. The sentences are to be served consecutively. There is no parole or early release in Virginia.

The appellate courts either affirmed the verdict or disallowed each appeal on technical grounds. Michael has no appeals left to him.

Michael's wife, having been informed that he confessed to setting the fire that burned her and took the life of her son, divorced him.

<<>>

Pat Ledford has been working to free her son Michael for eleven years. Despite the bleak outlook, she won't give up. Despite more than a decade of discouragement, she won't give up.

I started speaking with Pat in August. I asked if she would be willing to provide every scrap of information she had on the case. She agreed. It turned out she had a lot of scraps; it took me a month or so to go through everything. During that time, we communicated only as necessary to have more and more information sent my way.

She never balked. I consider that a good sign. I won't work with someone who wants to control the data I can see. For me it's all about the data, at least in the beginning. That way, it's not as painful when I decline to help a mother (and it seems usually to be the mother) who is trying to free a son or daughter.

I don't work to free people from prison unless I am convinced they are factually innocent. When I begin, I don't know the people involved. I cannot take them at their word; I must see the data. I must have time to go over the data, to absorb it, sleep with it, wear it, and breathe it until it becomes part of me.

I have been through that process with the Michael Ledford case. I am absolutely confident that Michael  is factually innocent of the crimes for which he was convicted. I realize the outlook is bleak. Nonetheless, I hope I'll be able to help.

I'll discuss Michael's case in an extended series of posts here, in this blog. There will be lots of time for details later. Right now, in this first post, there is something more important to address than the details of the fire.

A child died that night, a woman was seriously burned, and a man lost his freedom. Parents lost a child, and grandparents lost a grandchild. It is too late to be of any good, but I offer my condolences to all parties personally affected by this tragedy.

The ex-wife and her parents have good reason to hold Michael responsible for all that has transpired. Michael confessed, and two fire investigators confirmed that the fire was arson consistent with that confession. I have no desire to cause the ex-wife and her parents any further distress.

I believe, however, that a grave injustice has been done to all those personally touched by the fire and its aftermath. I expect I will be able to show that Michael's confession was false, that the fire reports were tainted by that false confession, and that the fire started as a result of an electrical problem in the apartment.

Join me.

Tuesday, November 16, 2010

On the Rate of Wrongful Conviction: Summary Plot for Your Consideration

Here's a summary plot I've been working on for the last chapter in my impending monograph Regarding The Rate of Wrongful Conviction. It's my third try. I rejected my first, the Skeptical Spouse rejected the second, and I'm giving you, my faithful readers, the opportunity to reject or commend the third.

Constructive criticisms, blathering praise, and cleverly worded slams would all be appreciated. Append your comments to the bottom of this post. I'll consider them all.

Click on the image to enlarge.


ADDENDUM

I've generated a fourth version.  I include it below.