ICFIS 2023

The 11th International Conference on Forensic Inference and Statistics, or ICFIS 2023, is set for June 12-15 of this year. It will be held at the Faculty of Law (Juridicum) of Lund University, Lund, Sweden. While I am saddened that I cannot attend this particular meeting, several years ago I had the pleasure of going to the 2014 International Conference on Forensic Inference and Statistics, or ICFIS which was the 9th iteration of the conference. I wrote a blog post about that meeting some time ago.

I can say, based on past experience alone, that this meeting is well worth attending. That’s particularly true if you are interested in the logical approach to evidence evaluation, but it would benefit any forensic scientist. You will not find a better collection of brilliant people all focused on forensic inference, in the broadest sense.

Forensic scientists, lawyers, academics—they will all be there.

Read more

Three principles

Three principles… that’s all.

There are three simple principles1 necessary to ensure proper application of the logical approach to evidence evaluation. Yet, despite this elegant simplicity, some examiners feel the logical approach is too complicated, or confusing, to be used in our work.

Now, to be fair, real-world case things can be a bit complex and challenging from time to time , but that isn’t unique to the logical approach. It is simply a reflection of the nature of forensic document examination. Our work is difficult and challenging at the best of times and every properly trained document examiner must be able to deal with, and explain, complex topics to laypersons. It is the reason why forensic handwriting examination (FHE) expertise is necessary in a court of law.

When one applies the logical approach, that inherent complexity is more exposed… and that is a good thing.

In my opinion, a very strong argument can be made that the logical approach is simpler and easier than any other alternative, even in its most complicated form. That is certainly true once you get over the initial hurdle of comprehension. In my opinion, the real issue for examiners, and for others who argue against the use of the logical approach, is their lack of understanding coupled with a failure to appreciate what the logical approach does to clarify our reasoning processes, how it functions to guide those processes, and how it assists us in explaining and defending our opinions.

Perhaps most important of all, the logical approach demands a different view of the evidence and what it means. Ultimately, it also demands a different view of the role of the examiner. Hence, some people find it difficult to come to terms with the process and what it requires of them.2

I’m often asked for a simple overview or summary of the process — a short-hand description or ‘briefer’ version that explains the basics. Well, here it is…

Read more

But doesn’t that mean it is ‘more likely than not’?

When an examiner expresses an opinion along the lines of ‘the findings support one proposition over another proposition’, a question often follows. Specifically, does that opinion mean ‘it is more likely than not that the favoured proposition actually happened’?1 The short answer is “no, it does not mean that.” At least, not necessarily.

In order to reach such a conclusion one must consider information that goes beyond the FDE evidence. As a rule, any opinion I provide will be constrained to the probability of the findings/observations in terms of one of at least two possible explanations.2 Ultimately, equating the two statements is inappropriate because they are not equivalent.3Read more

Science, experimentation & forensic examination

People sometimes question whether forensic work is scientific in nature. Given that the overall discipline is called ‘forensic science’ this is an interesting, if rather meaningless, question. I say ‘meaningless’ because, practically speaking, it is a non-issue.

Why? Simply because a court may choose to admit anyone as an expert, whether their expertise is scientific, purely experiential, or something else entirely. Nonetheless, it is interesting to consider the issue, if only because forensic document examination is one of those disciplines where this is a common challenge — does it involve any “science” at all?

As a result, this topic is worth some discussion.

Read more

Is Absolute Uniqueness Necessary?

Many years ago I came across an interesting, if limited, discussion in a blog post entitled “Expert testimony in pattern evidence cases – is absolute uniqueness necessary?”1,2 That post is dated Sept 4, 2009, shortly after the publication of National Academy of Science’s report “Strengthening Forensic Science in the United States: a Path Forward”.3 But the basic question posed in it is still relevant today. I would say that most forensic practitioners today would answer the question about the necessity of ‘absolute uniqueness’ in the negative. However, their individual reason(s) for their answer will still vary.

For many people, ‘absolute uniqueness’ is mainly a ‘forbidden’ concept because of some policy they must follow, or because of a more personal recognition of an (often vague) issue relating to the ‘limits of science’. For other people the matter is a well-defined issue in science and logic dictated by the nature and limits of information (knowledge), what information can really tell us about the world, and how information can and should be used to update beliefs about the world. For the latter group (which is steadily increasing in size as awareness and understanding improves), the concept of ‘absolute uniqueness’ is neither required, nor even beneficial in forensic work.

There has been a LOT of discussion about this in recent years, but I found the blog post interesting at the time even though it focused mainly on latent print examination. I feel that not much has changed since then so, even now, it deserves recognition and consideration.  Since the blog itself is no longer active, I have reposted the complete series of messages here (pulling them from archive.org).

The topic started with a post from the moderator (Barry Fisher) who wrote:

Expert testimony in pattern evidence cases – is absolute uniqueness necessary?
What information is needed to form a conclusion about an identification? Do conclusions require statistical data, as in DNA cases, to offer an opinion? Is it possible to state that two items of evidence come from a sole source? What may an expert opine when no statistical data is readily available and only experience suggests a conclusion? The National Academy report raises some profound questions and some intriguing research possibilities. But in the interim, while we wait for academics to study the multitude of pattern evidence forensic scientists encounter in their day to day work, who may report cases and testify in court? Readers are invited to speak to these issues.

Read more

Human Factors in Forensic Handwriting Examination

EWGHFHE cover

One of the projects I had the pleasure to be involved in was the “Expert Working Group for Human Factors in Handwriting Examination”. The WG was convened in 2015 to conduct a scientific assessment of the effects of Human Factors in Forensic Handwriting Examination, with the support of the National Institute of Justice (NIJ) Office of Investigative and Forensic Sciences (OIFS) and the National Institute of Standards and Technology (NIST) Special Programs Office.

It was a lengthy process involving a lot of people drawn from many different domains. The authors of the report included Melissa K. Taylor, Carolyne Bird, Brett Bishop, Ted Burkes, Michael P. Caligiuri, Bryan Found, Wesley P. Grose, Lauren R. Logan, Kenneth E. Melson, Mara L. Merlino, Larry S. Miller, Linton Mohammed, Jonathan Morris, John Paul Osborn, Nikola Osborne, Brent Ostrum, Christopher P. Saunders, Scott A. Shappell, H. David Sheets, Sargur N. Srihari, Reinoud D. Stoel, Thomas W. Vastrick, Heather E. Waltke, and Emily J. Will.

Read more

David H. Kaye’s “Forensic Science, Statistics & the Law” Blog

David H. Kaye (DHK) is one of my favourite writers. He is truly prolific and always manages to provide great insights for the reader. His grasp of statistics, logic, and the law is second-to-none, and his ability to communicate those very challenging topics to his audience is equally impressive.

As a mini introduction, David “…is Distinguished Professor, and Weiss Family Scholar in the School of Law, a graduate faculty member of Penn State’s Forensic Science Program, and a Regents’ Professor Emeritus, ASU.” If you would like to see a list of his publications check out http://personal.psu.edu/dhk3/cv/cv_pubs.html 

Yes, DHK has written many things on many topics.1  But I would like to focus on his less formal writings from his blog  Forensic Science, Statistics & the Law.

Read more

Interesting and Useful Stuff

Pen scribble image

Forensic Document Examination is a complex area involving many different topics and abilities. I am always looking for useful resources that can help me do this work and some of that information can be found online.

In time I would like to provide a more fulsome list of online resources pertaining to the different facets of this work but that is going to take a while to compile and it will be an ongoing project. Still there are already a few websites I consider to be particularly interesting and useful. I’ve compiled them into a list to serve as a starting point for a more complete and general list.

Some of these relate to Forensic Document Examination, some to logic and reasoning, and some pertain to programming and statistics (i.e., my main areas of interest). They are not listed in any particular order. Other categories, and more sites, may be added from time to time. In the meantime, I hope that you find them as interesting and useful as I have. If you know of other sites that you think might be included here, please let me know via the contact page. Enjoy!!

Read more

Prior odds — their meaning and significance

The concepts of ‘prior odds’, a.k.a., prior probabilities or simply priors, and ‘posterior odds’ come up in most discussions about the evaluation of evidence. The significance and meaning of both terms becomes clear when viewed in the context of a “Bayesian approach”, or the logical approach, to evidence evaluation. That approach has been discussed at length elsewhere and relates to the updating of one’s belief about events based upon new information. A key aspect is that some existing belief, encapsulated as the ‘prior odds’ of two competing possibilities or events, will be updated on the basis of new information, encapsulated in the ‘likelihood-ratio’1 (another term you will undoubtedly have seen), to produce some new belief, encapsulated as ‘posterior odds’ about those same competing possibilities.

But what precisely do these terms, ‘prior odds’ and ‘posterior odds’, mean and how do they relate to the work of a forensic examiner?
Read more