Biomedical Informatics Insights

Three Hybrid Classifiers for the Detection of Emotions in Suicide Notes

Submit a Paper

Biomedical Informatics Insights 2012:5 (Suppl. 1) 175-184

Original Research

Published on 30 Jan 2012

DOI: 10.4137/BII.S8967

Further metadata provided in PDF

Sign up for email alerts to receive notifications of new articles published in Biomedical Informatics Insights


We describe our approach for creating a system able to detect emotions in suicide notes. Motivated by the sparse and imbalanced data as well as the complex annotation scheme, we have considered three hybrid approaches for distinguishing between the different categories. Each of the three approaches combines machine learning with manually derived rules, where the latter target very sparse emotion categories. The first approach considers the task as single label multi-class classification, where an SVM and a CRF classifier are trained to recognise fifteen different categories and their results are combined. Our second approach trains individual binary classifiers (SVM and CRF) for each of the fifteen sentence categories and returns the union of the classifiers as the final result. Finally, our third approach is a combination of binary and multi-class classifiers (SVM and CRF) trained on different subsets of the training data. We considered a number of different feature configurations. All three systems were tested on 300 unseen messages. Our second system had the best performance of the three, yielding an F1 score of 45.6% and a Precision of 60.1% whereas our best Recall (43.6%) was obtained using the third system.




BibTex citation   (BIBDESK, LATEX)


What Your Colleagues Say About Biomedical Informatics Insights
It's a great experience publishing with Biomedical Informatics Insights. I am particularly impressed with the in-depth and constructive comments provided by the reviewers within such a short time-frame. The typesetting was not only prompt, but most importantly, effective. In fact, this was among the very few publication experiences that I have had when no correction was needed in the author proofs. I highly recommend Biomedical Informatics Insights to both readers and prospective ...
Dr Chun Hsi Huang (Computer Science and Engineering, University of Connecticut)
More Testimonials

Quick Links

New article and journal news notification services