Authors

Hojin Choi

Type

Text

Type

Thesis

Advisor

Zelinsky, Gregory | Samaras, Dimitris | Das, Samir.

Date

2014-12-01

Keywords

Cocaine addiction, Emotion recognition, Facial expression, Late positive potential | Computer science

Department

Department of Computer Science.

Language

en_US

Source

This work is sponsored by the Stony Brook University Graduate School in compliance with the requirements for completion of degree.

Identifier

http://hdl.handle.net/11401/77275

Publisher

The Graduate School, Stony Brook University: Stony Brook, NY.

Format

application/pdf

Abstract

With the advancement of affective computing technologies, spontaneous and complex emotions that were difficult or even impossible to recognize in the past are rapidly becoming the focus of many research. One intriguing example of these non-basic emotions is drug craving, a sophisticated concept which neuroscientists have studied for a long time. Nevertheless, it is not yet known whether craving is accompanied by a characteristic expressive behavior when it occurs, and only little work has been done on exploring the relationship between craving and facial expressions. In this thesis, we assume that drug-related stimuli can induce craving-related emotional states in drug users, and study the neurobiological and expressive behavior during these states by means of event-related potential (ERP) analysis and facial expression recognition. We design a passive image viewing task where cocaine users and control subjects watch neutral, drug-related, and non-drug emotional images. We record both electroencephalography (EEG) signals and the frontal face in real time to acquire a dataset that contains the subjects' response to multiple emotional cues. We first aim to establish a baseline y showing that there is a meaningful difference in ERP values between the emotional categories. Individuals with cocaine use disorder (CUD) are expected to display higher magnitude of ERP for cocaine-related cues that for neutral cues. We show that, although to a weaker degree than previous studies, cocaine users react somewhat differently from healthy individuals when exposed to drug stimuli. After that, we use person-specific tracking algorithm to register various facial points of interest. We extract geometric and appearance features from the tracked points and shape ot build feature vectors that can capture the possible occurrence of craving-related behavior. We use several methods of classification and try to distinguish drug cue-induced facial response from other facial expressions. Finally, we discuss the limitations of the current task design and the video dataset. Our results on ERP and facial activity show that our search for the possible expressive behavior correlated with craving is still inconclusive. We propose how the experiment could be improved in order to set a starting point for future research and make the task of facial expression recognition easier. | 50 pages

Share

COinS
 
 

To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.