Abstract
The current protocols in fire debris analysis rely on ignitable liquid pattern recognition and the identification of target compounds. These practices allow fire debris analysts to determine whether a sample contains or is absent of ignitable liquid residue and to classify that type of ignitable liquid based upon subjective thresholds. A statistical approach using computationally mixed datasets was devised in this research to generate an objective approach to the classification of fire debris samples and to determine error rates. Quadratic, linear, and partial least squares linear discriminant analysis (QDA, LDA, and PLS-DA) models were developed and evaluated to determine the effects of different population distributions and the overall performance on known and unknown ground-truth fire debris samples. The evaluation of the method performance was determined by generating receiver operator characteristic (ROC) curves and calculating an area under the curve (AUC) based on log-likelihood ratios (LLR) scores. The Substrate Database was also expanded within this work to aid fire debris analysts in casework and to provide a more relevant population when generating statistical models. The most optimal population distribution was determined to consist of a uniform population of equal contribution of substrate and ignitable liquids, with each ignitable liquid class represented. The QDA model performed the best when evaluating the cross validation datasets, calculating an AUC of 0.975 ± 0.005. The PLS-DA model calculated the highest AUC for a limited validation 16 known ground-truth dataset (0.991 AUC) in comparison to the other models. All models were evaluated by determining an analyst's threshold for large scale burn data of unknown ground-truth. All models determined a conservative threshold (LLR = 1) as a cutoff score by the informed analyst.
Notes
If this is your thesis or dissertation, and want to learn how to access it or for more information about readership statistics, contact us at STARS@ucf.edu
Graduation Date
2019
Semester
Summer
Advisor
Sigman, Michael
Degree
Doctor of Philosophy (Ph.D.)
College
College of Sciences
Department
Chemistry
Degree Program
Chemistry
Format
application/pdf
Identifier
CFE0008072; DP0023211
URL
https://purls.library.ucf.edu/go/DP0023211
Language
English
Release Date
2-15-2021
Length of Campus-only Access
1 year
Access Status
Doctoral Dissertation (Open Access)
STARS Citation
Allen, Alyssa, "The Evaluation of Classifier Performance on the Forensic Analysis of Fire Debris and the Expansion of the Substrate Database" (2019). Electronic Theses and Dissertations. 6839.
https://stars.library.ucf.edu/etd/6839