Eliciting and Analyzing Expert Judgment: A Practical Guide

Selecting which questions to ask an expert is a slow and evolutionary process. As the question list evolves, however, the selection process seems clearer in retrospect. In this chapter, we illustrate the steps involved in selecting the questions: (1) definition of the project's purpose, (2) selection of the general question areas, and (3) identification of the specific questions. In particular, information is given on which persons clients, data gatherers (interviewers and knowledge engineers), analysts, or experts can help with each of these steps and how. In addition, this chapter covers when selecting and motivating the external experts (chapter 6) needs to be done in parallel with the steps mentioned below. The process continues in chapter 5, which deals with how to refine the questions.
Selecting which questions to ask the expert comprises only one of a sequence of steps in which the information from one step permits the completion of the next, more detailed step. The steps are summarized as follows:
Step 1. Defining the project's purpose or goals. The project's purpose is simply what the project should accomplish. For instance, the purpose of the reactor risk project, NUREG-1150, was to examine the risk...