Utility of Event-Based Knowledge Elicitation

Using event-based knowledge elicitation, we obtained differences between respondents based on their experience level, providing some empirical evidence for the validity of the approach. The technique requires significant preparation time compared with other approaches, but because expectations can be developed, it may greatly simplify the data analysis. This is especially true if focused information is sough and the analyst plans to collect data from a number of experts.

Besides fulfilling a role in the knowledge elicitation process, other applications are possible. Because differences were obtained based on experience, a variation of the technique may serve a training purpose. We can also envision a testing application. For example, a point made by Zachary, Ryder, and Hicinbothom (in press) is that over time, there may be differences in the way experts perform a task as a result of factors such as the introduction of new tactics, techniques, and procedures and the introduction of equipment changes. Thus event-based knowledge elicitation could be used to establish a baseline of expert responses and then to periodically test operators to determine if there have been changes in the way job tasks are being performed. Such testing may be necessary, for example, if decision aids or expert systems are being used. These and other applications could be explored in future efforts.