Close
Help




JOURNAL

Biomedical Informatics Insights

77,252 Journal Article Views | Journal Analytics

Three Hybrid Classifiers for the Detection of Emotions in Suicide Notes

Submit a Paper



Publication Date: 30 Jan 2012

Type: Original Research

Journal: Biomedical Informatics Insights

Citation: Biomedical Informatics Insights 2012:5 (Suppl. 1) 175-184

doi: 10.4137/BII.S8967

Abstract

We describe our approach for creating a system able to detect emotions in suicide notes. Motivated by the sparse and imbalanced data as well as the complex annotation scheme, we have considered three hybrid approaches for distinguishing between the different categories. Each of the three approaches combines machine learning with manually derived rules, where the latter target very sparse emotion categories. The first approach considers the task as single label multi-class classification, where an SVM and a CRF classifier are trained to recognise fifteen different categories and their results are combined. Our second approach trains individual binary classifiers (SVM and CRF) for each of the fifteen sentence categories and returns the union of the classifiers as the final result. Finally, our third approach is a combination of binary and multi-class classifiers (SVM and CRF) trained on different subsets of the training data. We considered a number of different feature configurations. All three systems were tested on 300 unseen messages. Our second system had the best performance of the three, yielding an F1 score of 45.6% and a Precision of 60.1% whereas our best Recall (43.6%) was obtained using the third system.


Downloads

PDF  (579.75 KB PDF FORMAT)

RIS citation   (ENDNOTE, REFERENCE MANAGER, PROCITE, REFWORKS)

BibTex citation   (BIBDESK, LATEX)

XML






What Your Colleagues Say About Biomedical Informatics Insights
The publication process was efficient and well-organized. I am pleased with my decision to submit my manuscript to Biomedical Informatics Insights and highly recommend others to submit their work to the journal.
Dr Mindy Ross (University of California, San Diego, CA, USA)
More Testimonials

Quick Links


New article and journal news notification services