A performance evaluation tool for multi-sensor classification systems
R.N. Carvalho and KC. Chang
Multi-sensor fusion is founded on the principle that combining information from different sensors will enable a better understanding of the surroundings. However, it would be desirable to evaluate how much one gains by combining different sensors in a fusion system, even before implementing it. This paper presents a tool that allows a user to evaluate the classification performance of a multisensor fusion system modeled by a Bayesian network. Specifically, the system is designed to answer questions such as: (i) What is the probability of correct classification of a given target using a specific sensor individually? (ii) What if a specific set of sensors together are used instead? (iii) What is the performance gain by adding another sensor to this set? and (iv) Which sensors provide a better cost/benefit ratio? These questions are answered based on the probability of correct classification that can be analytically estimated using Bayesian inference with the given sensor models defined by confusion matrices. The principle that combining information enhances the understanding of the surroundings is also supported by the analysis made in an example model for air target tracking and classification using the developed tool.
R.N. Carvalho and KC. Chang, “A performance evaluation tool for multi-sensor classification systems,” Proceedings of the 12th International Conference on Information Fusion, Seattle, Washington, USA: 2009, pp. 1123-1130.