When an examiner expresses an opinion along the lines of ‘the findings support one proposition over another proposition’, a question often follows. Specifically, does that opinion mean ‘it is more likely than not that the favored proposition actually happened’?1 The short answer is “no, it does not mean that.” At least, not necessarily.
In order to reach such a conclusion one must consider information that goes beyond the FDE evidence. As a rule, any opinion I provide will be constrained to the probability of the findings/observations in terms of one of at least two possible explanations.2 Ultimately, equating the two statements is inappropriate because they are not equivalent.
Most people think that all examiners use a standardized opinion scale. Reality is a bit more complicated than one might expect. I discuss this in more detail elsewhere (here and here, among other places, and I do not intend to repeat all of the history or discussions that have happened over time).
Suffice it to say that there are two different approaches generally taken by examiners; one embodied in the SWGDOC Standard Terminology for Expressing Conclusions of Forensic Document Examiner and another that conforms to the ENFSI Guideline for Evaluative Reporting (or the one recommended and endorsed by the National Institute of Forensic Science in Australia (ANZPAA NIFS), or the Document Section of the Canadian Society of Forensic Science).
The former (SWGDOC) approach is the historical/traditional approach used in many labs wherein an examiner does their evaluation and formulates an opinion that speaks to the probability of a particular proposition; that is, it is a statement of belief about what actually happened to cause the observed evidence/findings.
The latter (ENFSI) approach has, in recent decades, been recognized as more logically sound than the traditional approach, insofar as it constrains the resulting opinion to a statement about the relative probability of the observed evidence/findings if one of several (at least two) competing propositions is true. This approach does not speak directly to whatever may have actually happened to produce the evidence/findings (i.e., the propositions); only to the degree of support provided by the evidence/findings in favour of one proposition rather than another (or others).3
Without going into detail, there are a few inter-related reasons why, in my opinion, the latter is preferable for handwriting comparisons addressing issues of authorship.
First, the examiner clearly has knowledge that permits an opinion about the evidence, but they lack certain requisite knowledge or information required to convert that belief into one about what happened. That additional requisite knowledge relates to other aspects of the matter that lie outside the examiner’s domain of expertise.
Second, that ‘other’ knowledge is often known to other parties involved; specifically, the trier of fact (and, to a lesser degree, the counsel or lawyers involved in making arguments to the trier). Furthermore, it is the role and responsibility of the trier to make a determination about ‘what happened’ as they decide about issues of guilt/innocence, or liability.
Third, it is the examiner’s role (as an expert) to assist the trier in their determinations by explaining and clarifying the meaning and value of evidence that falls within the examiner’s domain. However, the examiner must never present their opinion or belief in a manner that could be overly influential in the proceedings. Their role is to assist the trier, not usurp the latter’s role by making statements about ‘what happened’.4
This distinction leads to the question from a client that appears at the start of this post. They ask because they 1) may never have encountered an opinion based on evaluative reasoning (what I call the ‘logical approach’), and 2) believe an examiner should be able to tell them ‘what happened’ in a given matter.
To formalize the situation, a properly formed and logically sound opinion speaks only to the findings and the probability of observing the findings under each of at least two propositions. Any opinion that speaks to the probability of the propositions (singly or in contrast to one another) is very different.
Ultimately, I don’t know anything about ’what happened’ because 1) I don’t have all the requisite information needed to make that assessment, and 2) more importantly, decisions about such things fall in the domain of the trier. Such decisions are not mine to make. The logical approach is aimed, in part, at ensuring the expert does not, either accidentally or intentionally, overstep their bounds as an expert in a way that might (even potentially) usurp the role of the trier.
Now, lawyers or barristers (or clients, in general) can reach their own conclusion — one based on their overall knowledge of the matter. In fact, it could be argued that a barrister should, and must, be doing exactly that to fulfill their role in the situation. After all, they have to argue their side or their perspective on the matter to the trier. To do that, they need to consider all the evidence they have (including that provided the examiner/expert) and present their argument for a particular outcome based on the evidence, including the FDE evidence.
The examiner, despite what others may expect, is not in a position to do that sort of thing. Unfortunately, for decades that is exactly what they have done—unwittingly, for the most part. But past behaviour does not make this sort of thing either correct or proper.
If, during testimony, the Court insists that an expert give this type of opinion, the situation changes a bit. I recommend strongly that the expert respond by saying that 1) they don’t have the necessary information, 2) they would have to apply their own personal threshold for any such decision (which anyone can do just as well since it doesn’t involve actual expertise), and 3) the reason for the conclusion format and wording is aimed at avoiding the potential of over-stepping the bounds or scope of an expert. Then, should the court still insist on an answer in that form, the expert can give whatever they like as an opinion.
Personally, I would continue to refrain, asking for guidance from the Court with respect to 1) the utility equation I should be applying (i.e., what cost-benefit function be should used to assess each potential outcome), plus 2) the appropriate threshold to apply for each possible level of outcome. Note that these points are just an extension of the ones outlined above.
Since the court is unlikely to provide either of those, the matter should come to an end simply because I cannot do what they ask without that information.
To be clear, the reason for doing things this way is to 1) ensure the trier understands the limits of expert opinion (which they should already know, but clearly don’t at that point), and 2) provide the involved parties with the opportunity to object (and/or appeal) any outcome that results from improper, or incomplete, court guidance/direction.
All of this might seem inappropriate for a witness but, in reality, doing so simply ensures that the examiner fulfills their role as an expert while not going beyond the bounds of that role.
Footnotes
- The opinion might be expressed with a strength that varies from limited/weak to extremely strong (link to opinion scale), but the strength does not matter.
- There are select types of examinations that permit an opinion about the propositions, but those are rare.
- There are many types of examinations, usually for non-authorship issues, that are done by Forensic Document Examiners and which do not result in this type of opinion.
- Any concern about an examiner ‘usurping’ the court may seem silly to some but, in reality, individuals designated as an ‘expert’ are often viewed with great respect and given much deference by both judges and juries. The potential (if not reality) that an examiner’s opinion might be given too much weight simply because it comes from an ‘expert’ is very real. And such an outcome must be avoided.