Settlement Perspectives

Thoughts on how to resolve disputes and get your deal done.

print

8 PerspectivesJuly 3, 2009

Advanced Decision Tree Analysis in Litigation: An Interview With Marc Victor, Part I

A .pdf version of this advanced decision tree is available here.

Decision Tree Analysis isn’t new to litigation, and it isn’t new to this site either — we discussed the basics and more a few months ago.  But when you’re ready for an advanced take on the subject, where do you turn?  All roads lead to Marc B. Victor, Esq., who pioneered the application of decision tree analysis to litigation in the 1970s.

Through his company, Litigation Risk Analysis, Inc., Marc has taught decision tree analysis in the litigation context to over 10,000 senior legal professionals, some of whom no doubt had a hand in the American College of Civil Trial Mediators awarding Marc their Education Award of Excellence in 2003.  Marc was kind enough to guide me a bit when we began our series on decision trees a few months ago, and I have wanted to flesh out some of the details with him since those initial discussions.  The Q&A below is the result of our recent follow-up interview.

How did you first put together litigation management and the decision tree concept?

It was truly fortuitous.  I was a joint JD/MBA student at Stanford in the mid-1970s and had a summer job for a company bringing an antitrust suit against IBM.  I happened to have lunch with one of our lawyers the same day the president had asked him if $10 million would be a reasonable settlement.  As our lawyer walked me through what might happen if we went to trial — “if the judge rules for us on issue 1, and the jury then finds for us on issues 2 and 3, and then believes our expert on issues 4 and 5, we’ll win a lot of money; on the other hand, if . . .” — my Decision Analysis course at Stanford came to mind.  I started sketching the tree that fit his description of the twists and turns the case could take.  Over the next few weeks, we worked with outside counsel to finish the evaluation, presented the tree and the results to the president, and the matter settled soon thereafter.

What are the primary ways lawyers and clients are using decision tree analysis in litigation?

I believe there are a few ways:  (i) to be sure the lawyers have a clearer understanding of the key issues, uncertainties and exposure presented by a case; (ii) to gain settlement authority from the client; (iii) to convince the other side to accept a given settlement; (iv) to persuade a mediator or settlement conference judge of the rationale of their position; and (v) to plan a cost-effective litigation strategy.

Have you seen decision trees used effectively in mediation?

I have been asked to present decision trees as an advocate in mediation, and it certainly helps show the mediator that my client and I have a reasoned basis for our settlement position. I have also been retained by mediators on several occasions in large cases to help the mediation process by getting the parties to agree on the appropriate decision trees, discuss arguments, and assess probabilities and verdict ranges.  These cases have typically involved hundreds of millions of dollars, and by way of example include the $1.1 billion class action settlement of the Microsoft antitrust claims in California a few years ago.

What is the mistake lawyers and clients most often make as they learn to use decision trees in litigation?

The first is making just a one-node “we win overall/we lose overall” tree, and another is failing to do thorough “Lists of Reasons” before coming up with probabilities in the case.

Let’s take each of those in turn.  What’s the issue with a “one node” tree?

Some people limit their tree to a simple “we win/we lose,” despite the fact that there may be multiple underlying questions the jury or judge will deal with that will influence the ultimate outcome of the case — evidentiary rulings, alternative causes of action, potential defenses, and other uncertainties.  The parties and their lawyers would end up with a better evaluation of their overall chances of winning and losing if they would model these underlying issues and influences in a larger tree and then use probability arithmetic to arrive at the overall result.  [Editor's Note:  More on the process can be found in Marc's article, "Interpreting a Decision Tree Analysis of a Lawsuit," available on the articles page at litigationrisk.com.]

And what do you mean when you say that some users fail to generate “Lists of Reasons”?

Too many novice users of decision trees jump immediately from building the tree to filling in their probabilities.  But a probability that’s thrown onto the tree without first thinking rigorously about what the judge or jury will be weighing at trial won’t be as good as one made after doing so.  The “List of Reasons” is a summary of factors — pro and con — that the judge or jury will consider in deciding who should win each of the uncertainties represented on the decision tree.  This might be information on hand, such as key documents already in the file, but it might also include facts that could be uncovered in discovery, as well as witness strength, sympathy of the parties, and more.  [Editor's Note:  For more on Lists of Reasons, see pages 12-8 to 12-9 in "Evaluating Legal Risks and Costs with Decision Tree Analysis," which is reprinted available on the articles page at litigationrisk.com; it also appears in the ACC's Successful Partnering Between Inside and Outside Counsel.]

As a case progresses, how often should the parties update their decision trees?

The decision tree should be updated whenever there are new developments that would cause a significant change either to the structure of the tree itself (such as when a new cause of action is plead) or to the probabilities (because of what’s learned as discovery progresses, for example).  In addition, it’s usually a good idea to review and update your analysis prior to making a settlement decision or prior to a mediation.

Where can I find a good example of an advanced decision tree?

Those are almost always privileged and highly confidential, but the one on page 2 of my paper “Interpreting a Decision Tree Analysis of a Lawsuit” is a good start.  [Editor's note:  This article is available here and a .pdf of that analysis is available on Settlement Perspectives by clicking here.]

And what is the mistake people most often make as their decision tree skills advance?

As users become more advanced, I often see them putting multiple causes of action in separate trees when they should be in one tree or, if they know they should be in one tree, linking the causes of action together incorrectly.  Either of these mistakes will cause the calculation of case value to be wrong.  I also sometimes see them making trees more complicated — more academic — than they should be, forgetting that an effective decision tree should mirror the more streamlined, simpler approach juries often take when presented with complicated cases.

If I have a working knowledge of litigation decision trees, do you have any tips on how to advance my skill set?

I link to 7 articles on my website, and continue to offer training by appointment.  In addition, I work as a consultant to counsel and their clients on significant litigation matters.

Is there a software product out there you recommend?

I use TreeAge Pro exclusively.  It was co-founded by Morris Raker, a Boston lawyer, after attending one of my seminars in the 1980s, and it can ship with a manual I wrote for litigators.   [Editor's Note:  Additional providers of decision analysis software are listed within the comments to our first post on decision tree analysis in litigation.]

Come back next week for more of our interview of Marc Victor.  You’ll be glad you did.

[UPDATE:  For for more on Decision Tree Analysis, Settlement Perspectives' series on decision trees includes:

  1. Decision Tree Analysis in Litigation:  The Basics;
  2. Why Should You Try a Decision Tree in Your Next Dispute?;
  3. Advanced Decision Tree Analysis in Litigation:  An Interview with Marc Victor, Part I (this post);
  4. Advanced Decision Tree Analysis in Litigation:  An Interview With Marc Victor, Part II;
  5. Decision Trees in Mediation:  A Few Examples; and
  6. Avoiding the Limitations of Decision Trees:  A Few Tips from Mediators Who Use Them.]

Categories: Decision Trees,Negotiation,Settlement

8 Perspectives:

michael websterMonday, July 6, 2009 8:25 pm

Marc gave a lecture, probably one of many, to the Stanford Law negotiating class, when Bob Mnookin was teaching.

I was also in Vancouver when Marc gave his presentation to the ABA Franchising Forum.

My overall sense is that attorneys are comfortable with ordinal concepts of risk like: good, no chance, lock, and not so good.

But, for the most part, attorneys resist being cast in the role of bookmakers – quite correctly in my opinion.

I wonder if Marc shares my opinion about this being an important obstacle to use of decision analysis?

Because there are certainly many obstacles!

John DeGrooteMonday, July 6, 2009 10:05 pm

Michael–

Thanks for your comment. You are right that it’s easier for lawyers and the rest of us to respond with concepts like “good, no chance, lock, and not so good,” but one of the key uses of decision tree analysis in my experience has been its ability to highlight the importance of a real risk assessment on a given issue — for example, “What’s our likelihood of winning summary judgment on our breach of contract claim?” I can’t take “not so good” back to my client, so I often use the decision tree as a collaborative tool to highlight to my counsel what hinges on each decision — what paths each answer might take us to. With that analysis we can consider, and arrive at, those probability estimates together.

You’re right that we aren’t bookmakers, but as a client I don’t mind asking for a little more than “your chances are good” or “not so good,” either.

Thanks again for your thoughts on this, Michael–

JD

Jacob RuytenbeekThursday, July 9, 2009 11:32 am

I agree with much of what Marc said above, especially for large, complex, or high value cases. However, I’d add that one of the main barriers to adoption in smaller cases, other than what Michael Webster said above is the cost/benefit of performing a detailed analysis in a mediation context. In short, a detailed risk analysis is not always practical.

Performing a detailed risk analysis can take a lot of time. In some cases, attorneys who use decision trees have said that the process has taken a half-day or more to really work through all the relevant issues. That can’t always be done in a smaller mediation. Because it takes so long, attorneys don’t want to spend the money, and mediators shy away from spending time using decision tree analysis. This also leads to the use of “one node” trees. I’ve seen mediators utilize this type of tree far more often than a detailed risk analysis and the most common reason I’ve heard for doing so is that its quick and easy to do.

PaperChace.com was created to make decision tree analysis more accessible for mediation. It provides mediators with a templated interface that is more powerful than single node trees but much quicker and easier to use than TreeAge. It was built specifically for the mediation of disputes where it simply isn’t cost effective to perform a detailed risk analysis. You can see more about it at http://www.paperchace.com/decision-trees-for-mediators.html

John DeGrooteThursday, July 9, 2009 1:54 pm

Jacob–

Thanks for your thoughts on this. My first reaction is that, if Decision Tree Analysis is the catalyst for a half-day review of a case (or even more), that might not be a bad thing. An hour-long debate about whether the expert’s testimony will be admissible or whether the fraud counterclaim has any merit has benefits in itself, and if the decision tree process encourages a detailed review of the case earlier in the dispute, so be it.

That said, if the mechanics of mapping out the tree are an impediment in smaller cases, then by all means we should find an expedited workaround. I’ll take a look at PaperChace soon and pass along any thoughts I might have.

Thanks again for your comment–

JD

Patrick Hofer, Troutman SandersThursday, July 9, 2009 2:08 pm

I am a former student of Marc Victor’s and a big fan. I have successfully used decision trees to settle dozens of cases, primarily insurance coverage matters, using all kinds of trees, from relatively simple trees to trees with 10^75 hypothetical nodes (and which of course could only be mathematically modeled, not calculated). I have used them to convince opponents of the reasonableness of my client’s deal–from in-house counsel at a large multi-national conglomerate, who viewed themselves as God’s gift to the law, to the owner of a dry-cleaner who didn’t have a high school diploma. In every case I settled using a decision tree, the deal stuck and did not come unglued or get retraded, because both sides saw the value in the deal they made. Decision trees are amazingly effective, efficient and powerful tools to get parties to settle their differences.

That said, I have been confounded by how often other lawyers have resisted the notion of doing a decision-tree analysis of their cases. Sometimes this is client-driven, but usually clients love decision trees. Rather, it is outside counsel that resist, generally on the ground that “the law can’t be reduced to a number.” These lawyers cannot be shaken from this view by any argument–that a decision tree is tool to aid judgment; that legal uncertainties, like every uncertainty, can be bounded by probabilistic parameters; that discomfort about “picking a number” can be addressed by picking a probable range of numbers (and performing a Monte Carlo simulation) or using sensitivity analyses. Instead, these lawyers would rather trust their gut. Don’t get me wrong: a lawyer’s gut is an great thing. But a well-focused, analytical, ordered and methodical gut is even better.

And some of this resistance may be skills-driven. Doing a decision tree properly takes getting over a learning curve on the logic of the method, which for some may be steep. Doing a complex tree requires, in addition, facility with computer applications (either products like TreeAge Pro or Excel, for really complex trees). Not many lawyers are willing or able to acquire those skills.

So more power to Marc Victor, John DeGroote and this blog. Hopefully the word will spread, and resistance will start to fade.

John DeGrooteThursday, July 9, 2009 9:18 pm

Patrick–

It’s great to hear from one of Marc’s former students, and I appreciate the perspective you bring as a practitioner with years of advanced decision tree experience.

While several of the things you said deserve reemphasis, one really caught my eye. You said: “In every case I settled using a decision tree, the deal stuck and did not come unglued or get retraded, because both sides saw the value in the deal they made.”

I hadn’t thought of that before, but in hindsight you’re right, and this gives us yet another reason to use a decision tree in our next dispute. Thanks for your help, Patrick–

JD

Greg Dent — Tuesday, July 28, 2009 6:23 pm

I was fortunate enough to take a course with Mark Victor. At that time, I was one of four regional managers for a large commercial insurance company’s Staff Counsel program. We were so impressed with Victor’s aproach that we began to use it nationwide with both our law offices and claims offices. The majority of our cases were not huge complex ones, however we found that DTA was a very effective tool even on the run of the mill slip and fall cases. Often these were clear liability but the tree was useful in helping us value the dispute over causal relationship of the injury, etc. I agree that spending this time on analysis is not a waste. Once you have a good tree with estimates of probability on the real issues, it forms the framework around which reasonable minds can evaluate the value of a disputed matter.

John DeGrooteWednesday, July 29, 2009 6:01 am

Greg–

Thanks for your real-world perspective on Decision Tree Analysis, and let me know if you ever want to share some of the stories about how you used Marc Victor’s approach in practice. I’m sure our readers would really enjoy reading about them.

Thanks again for your comment–

John DeGroote

Sorry, the comment form is closed at this time.

Settlement Perspectives
is the professional weblog
of John DeGroote.

I created this site to help clients and their counsel navigate the challenges that inevitably result from disputes, settlement efforts, impasse, and negotiation in general. The perspectives I bring are based on my experience, summarized in this abbreviated bio. If you have any questions or thoughts about this site, or an issue you’d like to see addressed, please email me at:

Categories

Search This Site

Sign Up for Our Newsletter

Please enter your email below to get semi-regular updates on the latest from Settlement Perspectives. Your email will not be distributed.

Selected Posts

Subscribe to my RSS feed.

  • View johndegroote's profile on slideshare
  • LinkedIn.com
  • twitter
  • American Registry Peer Rating for John DeGroote