18 thoughts on “What does “beyond a reasonable doubt” practically mean?”

Yesterday, in leading Swedish tabloid Aftonbladet (http://www.aftonbladet.se/sportbladet/spel/article14969125.ab), we learned that “Det är 15 procents chans att gå vidare till kvartsfinal, vilket nästan är en omöjlighet”. In English translation: “The chance of reaching quarter final is 15% – a near impossibility”.

It means that p-value is less than alpha, where alpha is an acceptable upper limit to the magnitude of type I error. In the criminal justice context, the type I error is a conviction of an innocent person.

זו טעות נפוצה.
“ספק סביר” הוא רף הראיות הנדרש להרשעה.
מבלי לדעת מה היא ההסתברות האפריורית לאשמה אין לך יכולת לומר דבר על ההסתברות האפוסטריורית להרשעת שווא.
ראו: מרדכי הלפרט ובועז סנג’רו, מכֶּשֶל החלפת ההתניות להרשעה מוטעית על סמך הודאה http://www.hezkathaput.org/SangeroHalpert2010.pdf

without knowing anything about the prior probability of the null hypothesis you cannot say anything about its posterior probability.
See: “The Earth Is Round (p < 0.05)" http://www.citeulike.org/user/mdreid/article/2643653

I think that if you want to measure it in probabilities, we need to know how often such “events” happen. If it is in, say, data transmissions, and the probabilities you list is for the probability that a bit is flipped, then none of your options are “beyond reasonable doubt”.

This is of course a question of values, but to answer it one has to estimate the tradeoff between the false positive and false negative rates. I suspect that these are very different for different crimes. For instance in ‘he said she said’ kind of crimes (like the one our beloved former president commited) I suspect that if you insist on a confidence of less than a few percent you will never convict anyone and people would be able to commit these crimes with immunity. On the other hand crimes that typically leave physical evidence (like say financial crimes) I would have liked a confidence of 0.001 or lower.

I think it should be obvious that p-value is irrelevant due to Lindley’s Paradox. Relying on p-values can lead to the conclusion that someone who is guilty with a probability of one in a million is guilty beyond reasonable doubt.
By the way, Gil, your title (and apparently the possible answers you have in mind) is about “what does *beyond* reasonable doubt mean “, whereas your question asks about “reasonable doubt”, which I guess is the complimentary.

I don’t see Lindley’s Paradox as necessarily implying that p-value is irrelevant. One can interpret this paradox as saying that the Bayesian approach is problematic due to its sensitivity to the choice of H1, the alternative hypothesis (i.e., the choice of the prior). However, there is always the issue of base rates: a person having the exact DNA sequence that was found in the crime scene and that is shared by only 1/1,000,000 of the population does not have a 1/1,000,000 probability to be innocent, especially if his name was drawn in search for a DNA match from a computer archive containing the DNA sequences of the 10M residents of the city…

בבואנו לבחון מה שיעורו של הספק הסביר עלינו להבחין בין המצוי לרצוי.

באשר למצוי, העובדה שרובם המכריע של הכרעות הדין בישראל מתבסס על הודאה (בעסקת טיעון או הודאה “וולונטרית”) ללא הליך של בירור ראיות (כ 93%, כמעט כמו בארה”ב), המשמעות היא שסף הראיות הנדרש להרשעה נמוך מאוד.
למי שחושב שממילא כל החשודים אשמים אין בעייה עם זה. אשרי המאמין.

באשר לרצוי, לדעתי יש לדרוש בירור ראיות בכל מקרה של הודאה.
במשרד המשפטים, הפרקליטות, המשרד לבטחון פנים, הנהלת בתי המשפט וכו’ סוברים אחרת.
בישיבות בוועדת החוקה, חוק ומשפט על הצעת חוק עסקאות הטיעון, נציגיהם מתנגדים אפילו להצעתו של שופט בית המשפט העליון בדימוס אליהו מצא: “לדעתי טוב יעשה המחוקק אם בגיבוש נוסחו הסופי של החוק יסמיך את בית המשפט במפורש להתנות את החלטתו, ביחס להסדר הטיעון המוגש לו, בהסכמת הצדדים להעמיד לעיונו את חומר הראיות שברשותם.” ראו: http://www.hasanegor.co.il/AllSites/263/Assets/maamar171.pdf

One interesting comment I heard was about people who were asked to answer certain yes/no questions and to indicate how certain they are about the answers. 100% certainty was a fairly common answer. Then they were further asked to estimate in how many questions where they gave 100% certainty their answer was correct. The estimates were around 80%.

Sure. We should actually be before we say such things. The standards of justice should be greater than scrutiny of medicine, because some people have the view when people with good intentions and finite resources have been allowed to revoke fundamental freedoms of individuals who were possibly innocent, the world is hardly a place suitable for civilized beings. The standard should be instead the possibility of innocence is required for freedom. How many people in this world have been unfairly punished by people with good intentions doing the best they can with limited resources and time? The same philosophy and approach relates to many other aspects of public policy, and incidentally, the funding of academic resource and questions of computer science. We must focus on positive affirmative outcomes, and processes. Our current justice system says “punish the guilty” and it needs to be saying “protect the innocent”. A system where the old “beyond a reasonable doubt” standard were replaced by a “sure of the possibility of innocence” standard for freedom would be one more fitting for the survival of human beings. The fundamental form of the approach adapted to physics, or mathematics, would help us to continue to innovate and expand out our capabilities, and improve the quality of life for all people. We are an intelligent species, but we need to listen more to anyone who wants to be heard at any time. Astrophysicists should be listening to small town car mechanics. Top universities should require open door policies for the contributions of ideas from outsiders. We require a good to better outline of our futures. If we recognize these goals and accept the responsibilities, the future will be opened to us and we will see we may be able to do things we have only dreamed of in the past, such as discovering new and exciting ways to interact with the universe, share information, and make discoveries. The solution to to the questions of computer science requires these
positive affirmative outcomes, and the same principles must be adapted to physics to continue to innovate and expand out our capabilities.

Yesterday, in leading Swedish tabloid Aftonbladet (http://www.aftonbladet.se/sportbladet/spel/article14969125.ab), we learned that “Det är 15 procents chans att gå vidare till kvartsfinal, vilket nästan är en omöjlighet”. In English translation: “The chance of reaching quarter final is 15% – a near impossibility”.

Amazing…

Olle-good luck tonight!

It means that p-value is less than alpha, where alpha is an acceptable upper limit to the magnitude of type I error. In the criminal justice context, the type I error is a conviction of an innocent person.

Thanks Yosi, but what IS the value of alpha (in the criminal justice context)?

זו טעות נפוצה.

“ספק סביר” הוא רף הראיות הנדרש להרשעה.

מבלי לדעת מה היא ההסתברות האפריורית לאשמה אין לך יכולת לומר דבר על ההסתברות האפוסטריורית להרשעת שווא.

ראו: מרדכי הלפרט ובועז סנג’רו, מכֶּשֶל החלפת ההתניות להרשעה מוטעית על סמך הודאה

http://www.hezkathaput.org/SangeroHalpert2010.pdf

For the English version of this article please follow:

http://www.clb.ac.il/uploads/sangero1.pdf

without knowing anything about the prior probability of the null hypothesis you cannot say anything about its posterior probability.

See: “The Earth Is Round (p < 0.05)" http://www.citeulike.org/user/mdreid/article/2643653

I think that if you want to measure it in probabilities, we need to know how often such “events” happen. If it is in, say, data transmissions, and the probabilities you list is for the probability that a bit is flipped, then none of your options are “beyond reasonable doubt”.

Dear Trala, I mainly think about “beyond a reasonable doubt” as a legal term.

The question is of course what it actually is, and not what it should be. The introduction of DNA analysis in forensics showed the number to be much higher than what most people would have believed (or find acceptable)

http://www.theatlantic.com/magazine/archive/2007/08/innocents-in-prison/6148/ indicate

Thanks, Udi. What do you think it should be?

This is of course a question of values, but to answer it one has to estimate the tradeoff between the false positive and false negative rates. I suspect that these are very different for different crimes. For instance in ‘he said she said’ kind of crimes (like the one our beloved former president commited) I suspect that if you insist on a confidence of less than a few percent you will never convict anyone and people would be able to commit these crimes with immunity. On the other hand crimes that typically leave physical evidence (like say financial crimes) I would have liked a confidence of 0.001 or lower.

I think it should be obvious that p-value is irrelevant due to Lindley’s Paradox. Relying on p-values can lead to the conclusion that someone who is guilty with a probability of one in a million is guilty beyond reasonable doubt.

By the way, Gil, your title (and apparently the possible answers you have in mind) is about “what does *beyond* reasonable doubt mean “, whereas your question asks about “reasonable doubt”, which I guess is the complimentary.

I don’t see Lindley’s Paradox as necessarily implying that p-value is irrelevant. One can interpret this paradox as saying that the Bayesian approach is problematic due to its sensitivity to the choice of H1, the alternative hypothesis (i.e., the choice of the prior). However, there is always the issue of base rates: a person having the exact DNA sequence that was found in the crime scene and that is shared by only 1/1,000,000 of the population does not have a 1/1,000,000 probability to be innocent, especially if his name was drawn in search for a DNA match from a computer archive containing the DNA sequences of the 10M residents of the city…

בבואנו לבחון מה שיעורו של הספק הסביר עלינו להבחין בין המצוי לרצוי.

באשר למצוי, העובדה שרובם המכריע של הכרעות הדין בישראל מתבסס על הודאה (בעסקת טיעון או הודאה “וולונטרית”) ללא הליך של בירור ראיות (כ 93%, כמעט כמו בארה”ב), המשמעות היא שסף הראיות הנדרש להרשעה נמוך מאוד.

למי שחושב שממילא כל החשודים אשמים אין בעייה עם זה. אשרי המאמין.

באשר לרצוי, לדעתי יש לדרוש בירור ראיות בכל מקרה של הודאה.

במשרד המשפטים, הפרקליטות, המשרד לבטחון פנים, הנהלת בתי המשפט וכו’ סוברים אחרת.

בישיבות בוועדת החוקה, חוק ומשפט על הצעת חוק עסקאות הטיעון, נציגיהם מתנגדים אפילו להצעתו של שופט בית המשפט העליון בדימוס אליהו מצא: “לדעתי טוב יעשה המחוקק אם בגיבוש נוסחו הסופי של החוק יסמיך את בית המשפט במפורש להתנות את החלטתו, ביחס להסדר הטיעון המוגש לו, בהסכמת הצדדים להעמיד לעיונו את חומר הראיות שברשותם.” ראו: http://www.hasanegor.co.il/AllSites/263/Assets/maamar171.pdf

One interesting comment I heard was about people who were asked to answer certain yes/no questions and to indicate how certain they are about the answers. 100% certainty was a fairly common answer. Then they were further asked to estimate in how many questions where they gave 100% certainty their answer was correct. The estimates were around 80%.

Sure. We should actually be before we say such things. The standards of justice should be greater than scrutiny of medicine, because some people have the view when people with good intentions and finite resources have been allowed to revoke fundamental freedoms of individuals who were possibly innocent, the world is hardly a place suitable for civilized beings. The standard should be instead the possibility of innocence is required for freedom. How many people in this world have been unfairly punished by people with good intentions doing the best they can with limited resources and time? The same philosophy and approach relates to many other aspects of public policy, and incidentally, the funding of academic resource and questions of computer science. We must focus on positive affirmative outcomes, and processes. Our current justice system says “punish the guilty” and it needs to be saying “protect the innocent”. A system where the old “beyond a reasonable doubt” standard were replaced by a “sure of the possibility of innocence” standard for freedom would be one more fitting for the survival of human beings. The fundamental form of the approach adapted to physics, or mathematics, would help us to continue to innovate and expand out our capabilities, and improve the quality of life for all people. We are an intelligent species, but we need to listen more to anyone who wants to be heard at any time. Astrophysicists should be listening to small town car mechanics. Top universities should require open door policies for the contributions of ideas from outsiders. We require a good to better outline of our futures. If we recognize these goals and accept the responsibilities, the future will be opened to us and we will see we may be able to do things we have only dreamed of in the past, such as discovering new and exciting ways to interact with the universe, share information, and make discoveries. The solution to to the questions of computer science requires these

positive affirmative outcomes, and the same principles must be adapted to physics to continue to innovate and expand out our capabilities.