Facial Expression Recognition using Neural Network for Dyadic Interaction

dc.contributor.advisorOzcinar, Cagri
dc.contributor.advisorTikka, Pia
dc.contributor.advisorAnbarjafari, Gholamreza
dc.contributor.authorSham, Abdallah Hussein
dc.contributor.otherTartu Ülikool. Loodus- ja täppisteaduste valdkondet
dc.contributor.otherTartu Ülikool. Tehnoloogiainstituutet
dc.date.accessioned2021-05-31T08:47:36Z
dc.date.available2021-05-31T08:47:36Z
dc.date.issued2020
dc.description.abstractComputers are machines that don’t share emotions as humans do. With the help of Machine Learning (ML) and Artificial Intelligence (AI), social robots can become a reality. These robots are currently capable of interacting with people at a certain level, but not exactly as a person would do. For them to reach that level, they would need to understand more about how people interact daily and to learn from the dyadic interaction of two people would be a good option. Participants’ facial expressions are the main features that can be retrieved from dyadic interaction and this can be done using a trained Deep Neural Network (DNN) model. The DNN model, known as the Mini-Xception, is trained in this thesis using a dataset that has been pre-processed and can then be tested on images. Using a face detector algorithm, the model will be able to detect a person’s facial expression on the image. After successful image results, the model can be tested using a different medium. First, the tests are carried out using a webcam, then videos with more than one participant. Since people react to expressions, their reactions can also be caused by a context in which, for example, sad news would be the reason for sad emotion. The results of the tests will, therefore, be used for analysis where a correlation can be constructed between facial expressions and context.en
dc.identifier.urihttp://hdl.handle.net/10062/72122
dc.language.isoenget
dc.publisherTartu Ülikoolet
dc.rightsopenAccesset
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International*
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0/*
dc.subjectMachine Learningen
dc.subjectArtificial Intelligenceen
dc.subjectDeep Neural Networken
dc.subjectSocial Roboten
dc.subjectMini-Xceptionen
dc.subjectface detector algorithmen
dc.subjectfacial expression recognitionen
dc.subjectmasinõpeet
dc.subjectTehisintellektet
dc.subjectsügav närvivõrket
dc.subjectsotsiaalne robotet
dc.subjectnäotuvastusalgoritmet
dc.subjectnäoilme tuvastuset
dc.subject.othermagistritöödet
dc.titleFacial Expression Recognition using Neural Network for Dyadic Interactionen
dc.title.alternativeNäoilmetuvastus kaksiksuhtluses kasutades tehisnärvivõrkuet
dc.typeinfo:eu-repo/semantics/masterThesiset

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Sham_MSc2020.pdf
Size:
6.94 MB
Format:
Adobe Portable Document Format
Description:
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.67 KB
Format:
Item-specific license agreed upon to submission
Description: