ݺߣ

ݺߣShare a Scribd company logo
Seminar Presentation on
Sentiment Analysis on Human with special Concentration on infants’
emotional face using Machine Learning Techniques.
Presented By-
Takrim Ul Islam Laskar
Roll No. 170302005
M.Tech 3rd Sem
Gauhati University Institute of Science And Technology
Dept. of Information Technology,Gauhati University
Contents
• Introduction
• Problem Statement
• Background Study
• Motivation
• Applications
• Action Plan
• Tools, Environment and Experimental Plateform
• Emotion Detection System
• Face Detection Stage
• Feature Extraction stage
• Emotion Classification Stage
• Conclusion
• References
Introduction
Emotion is psychological and physiological state which is subjective to different
conditions. Broadly classifying happyness, sadness, anger, disgust, surprise and fear
are some of them.
We are to devolope a software to detect the emotion of child/infant using openCV
and Machine Learning.
The project falls under the domains Artificial Intellegence and Digital Image
Processing.
Problem Statement
Pose, speech, facial expression, behaviour, etc convey emotions of
individuals .
There’s an old proverb “Face is the index of mind”. All the inner
emotions reflect on the face of an individual .
So the idea is to read the face and detect the emotional state of the
subject as it is easily perceptible and it has higher accuracy.
In this project our focus would be to do the same with special
concentration on children and infants.
Background study
• Wathsala Nayomi widanagamaachchi[1] in his research ‘Facial
Emotion Recognition with a Neural Network Approach’ established
the fact that Neural Network provides better accuracy than Naive
Bayes classifier, which is a probabilistic classifier based on Bayes
Theorem.
• Andreea Pascu under guidance of Prof. Ross King[3] in there research
‘Facial Recognition System’ found a strong accuracy of 86% using
Machine Learning.
Motivation
• Projects have been done earlier on Emotion Detection with precision.
But we have taken up the task of focusing more on infants and
children who cannot talk to express their feelings .
Applications
• This can be used for medical purposes to detect infants’ emotions.
• This can be used as a facial language recognition system.
Action Plan
Date Milestone
End September
2018
Problem Statement
End October 2018 Literature review &
Preprocessing
End December 2018 Feature extraction &
Phase 1 Project Report
End of march 2019 Data set training
Data set testing
End of May 2019 Implementation &
Phase 2 Project Report
Face recognition system can also be
collected and proceeded to feature
extraction.
Tools/Environment/Experimental Plateform
• Tools – openCV 3.1.0, Python 2.7.12, Artificial Neural Network.
• Operating System- Linux based plateform (e.g Ubuntu 16.04 ).
• Hardware- RAM 4 GB, Intel Core i5 7th Gen.
Emotion Detection System
Fig 1. Emotion Detection System
Stages in Emotion Detection:
1. Face Detection Stage.
2. Feature Extraction Stage.
3. Emotion Classification Stage.
Face Detection
Feature invariant Approach would be implemented .
• It would work based on the skin colour.
• It is in focus currently as skin colour resides in a small colour range in
different colour spaces irrespective of race.
Feature Extraction Stage
1. Feature Region Extraction:
From the face detected, further processing gives eye, eyebrows, mouth, etc.
2. Feature Point Extraction
From the regions the corner points are extracted .
Emotion Classification Stage
The feature points are then inputed to the neural network.
Neural Network would be used to train a Data Set. This Data Set would
be used to classify the emotions inputed.
In doing so, a huge amount of facial expressions of different individuals
would have to be collected.
Conclusion
The application would be able to detect the mental and physiological
state of an individual especially the infant . This can be used to provide
appropriate care to the infant.
References
[1] Wathsala Nayomi Widanagamaachchi. Facial Emotion Recognition with a Neural
Network Approach. 2009.
[2] G.Hemalatha and C.P Samathi, ‘A Study of Techniques for Facial Detection and
Expression Classification’, IJCSES Vol.5, April 2014
[3] Andreea Pascu and Prof. Ross King, ‘Facial Expression Recognition System’, University of
Manchester, April 2015.
[4] M. Pantic, L. J. M. Rothkrantz, and H. Koppelaar. Automation of nonverbal
communication of facial expressions. In in: EUROMEDIA 98, SCS International, pages 86{93,
1998.
[5] T. Pham and M. Worring. Face detection methods: A critical evaluation. ISIS Technical
Report Series, University of Amsterdam, 11, 2000.
[6] T. V. Pham, M. Worring, and A. W. M. Smeulders. Face detection by aggregated bayesian
network classifiers. Pattern Recogn. Lett., 23(4):451{461, 2002.
Thank You

More Related Content

Similar to Sentiment Analysis on Human with special Concentration on infants’ emotional face using Machine Learning Techniques. (20)

Quantum Lab White Paper
Quantum Lab White PaperQuantum Lab White Paper
Quantum Lab White Paper
Bartosz Rychlicki
Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...
Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...
Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...
Sana Nasar
Mind Reading Computer
Mind Reading ComputerMind Reading Computer
Mind Reading Computer
Rashmi Hemadri
Mind reading computer
Mind reading computerMind reading computer
Mind reading computer
sri vidya college of engineering and technology
IRJET- An Innovative Approach for Interviewer to Judge State of Mind of an In...
IRJET- An Innovative Approach for Interviewer to Judge State of Mind of an In...IRJET- An Innovative Approach for Interviewer to Judge State of Mind of an In...
IRJET- An Innovative Approach for Interviewer to Judge State of Mind of an In...
IRJET Journal
IRJET - Automatic Emotion Recognition using Facial Expression: An Overview
IRJET - Automatic Emotion Recognition using Facial Expression: An OverviewIRJET - Automatic Emotion Recognition using Facial Expression: An Overview
IRJET - Automatic Emotion Recognition using Facial Expression: An Overview
IRJET Journal
Artificial Intelligence And Face Detection
Artificial Intelligence And Face DetectionArtificial Intelligence And Face Detection
Artificial Intelligence And Face Detection
MuhammadAdnanBashir5
Facial Expression Recognition System using Deep Convolutional Neural Networks.
Facial Expression Recognition  System using Deep Convolutional Neural Networks.Facial Expression Recognition  System using Deep Convolutional Neural Networks.
Facial Expression Recognition System using Deep Convolutional Neural Networks.
Sandeep Wakchaure
SCiL Poster
SCiL PosterSCiL Poster
SCiL Poster
Mabel Y Wong
Facial expression recognition system : survey
Facial expression recognition system : surveyFacial expression recognition system : survey
Facial expression recognition system : survey
Mohamed Alhmdany
SenseTheClassroom Live at EC-TEL 2022
SenseTheClassroom Live at EC-TEL 2022SenseTheClassroom Live at EC-TEL 2022
SenseTheClassroom Live at EC-TEL 2022
Daniele Di Mitri
Mental Health Monitor using facial expression
Mental Health Monitor using facial expressionMental Health Monitor using facial expression
Mental Health Monitor using facial expression
hightech12
Face expression recognition using Scaled-conjugate gradient Back-Propagation ...
Face expression recognition using Scaled-conjugate gradient Back-Propagation ...Face expression recognition using Scaled-conjugate gradient Back-Propagation ...
Face expression recognition using Scaled-conjugate gradient Back-Propagation ...
IJMER
Facial Emoji Recognition
Facial Emoji RecognitionFacial Emoji Recognition
Facial Emoji Recognition
ijtsrd
Ijsrdv8 i10424
Ijsrdv8 i10424Ijsrdv8 i10424
Ijsrdv8 i10424
aissmsblogs
Mind reading ppt
Mind reading pptMind reading ppt
Mind reading ppt
OECLIB Odisha Electronics Control Library
271_AI Lect Notes.pdf
271_AI Lect Notes.pdf271_AI Lect Notes.pdf
271_AI Lect Notes.pdf
kaxeca4096
Eigenface based recognition of emotion variant faces
Eigenface based recognition of emotion variant facesEigenface based recognition of emotion variant faces
Eigenface based recognition of emotion variant faces
Alexander Decker
Mind Reading Computer
Mind Reading ComputerMind Reading Computer
Mind Reading Computer
Dev Ashish
Research Methods Cheat Sheet
Research Methods Cheat SheetResearch Methods Cheat Sheet
Research Methods Cheat Sheet
Prime Decision
Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...
Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...
Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...
Sana Nasar
IRJET- An Innovative Approach for Interviewer to Judge State of Mind of an In...
IRJET- An Innovative Approach for Interviewer to Judge State of Mind of an In...IRJET- An Innovative Approach for Interviewer to Judge State of Mind of an In...
IRJET- An Innovative Approach for Interviewer to Judge State of Mind of an In...
IRJET Journal
IRJET - Automatic Emotion Recognition using Facial Expression: An Overview
IRJET - Automatic Emotion Recognition using Facial Expression: An OverviewIRJET - Automatic Emotion Recognition using Facial Expression: An Overview
IRJET - Automatic Emotion Recognition using Facial Expression: An Overview
IRJET Journal
Artificial Intelligence And Face Detection
Artificial Intelligence And Face DetectionArtificial Intelligence And Face Detection
Artificial Intelligence And Face Detection
MuhammadAdnanBashir5
Facial Expression Recognition System using Deep Convolutional Neural Networks.
Facial Expression Recognition  System using Deep Convolutional Neural Networks.Facial Expression Recognition  System using Deep Convolutional Neural Networks.
Facial Expression Recognition System using Deep Convolutional Neural Networks.
Sandeep Wakchaure
Facial expression recognition system : survey
Facial expression recognition system : surveyFacial expression recognition system : survey
Facial expression recognition system : survey
Mohamed Alhmdany
SenseTheClassroom Live at EC-TEL 2022
SenseTheClassroom Live at EC-TEL 2022SenseTheClassroom Live at EC-TEL 2022
SenseTheClassroom Live at EC-TEL 2022
Daniele Di Mitri
Mental Health Monitor using facial expression
Mental Health Monitor using facial expressionMental Health Monitor using facial expression
Mental Health Monitor using facial expression
hightech12
Face expression recognition using Scaled-conjugate gradient Back-Propagation ...
Face expression recognition using Scaled-conjugate gradient Back-Propagation ...Face expression recognition using Scaled-conjugate gradient Back-Propagation ...
Face expression recognition using Scaled-conjugate gradient Back-Propagation ...
IJMER
Facial Emoji Recognition
Facial Emoji RecognitionFacial Emoji Recognition
Facial Emoji Recognition
ijtsrd
271_AI Lect Notes.pdf
271_AI Lect Notes.pdf271_AI Lect Notes.pdf
271_AI Lect Notes.pdf
kaxeca4096
Eigenface based recognition of emotion variant faces
Eigenface based recognition of emotion variant facesEigenface based recognition of emotion variant faces
Eigenface based recognition of emotion variant faces
Alexander Decker
Mind Reading Computer
Mind Reading ComputerMind Reading Computer
Mind Reading Computer
Dev Ashish
Research Methods Cheat Sheet
Research Methods Cheat SheetResearch Methods Cheat Sheet
Research Methods Cheat Sheet
Prime Decision

More from Takrim Ul Islam Laskar (6)

Facial Emotion Detection on Children's Emotional Face
Facial Emotion Detection on Children's Emotional FaceFacial Emotion Detection on Children's Emotional Face
Facial Emotion Detection on Children's Emotional Face
Takrim Ul Islam Laskar
Facial emotion detection on babies' emotional face using Deep Learning.
Facial emotion detection on babies' emotional face using Deep Learning.Facial emotion detection on babies' emotional face using Deep Learning.
Facial emotion detection on babies' emotional face using Deep Learning.
Takrim Ul Islam Laskar
Indian Sign Language Recognition Method For Deaf People
Indian Sign Language Recognition Method For Deaf PeopleIndian Sign Language Recognition Method For Deaf People
Indian Sign Language Recognition Method For Deaf People
Takrim Ul Islam Laskar
Introduction to Apache Hive(Big Data, Final Seminar)
Introduction to Apache Hive(Big Data, Final Seminar)Introduction to Apache Hive(Big Data, Final Seminar)
Introduction to Apache Hive(Big Data, Final Seminar)
Takrim Ul Islam Laskar
Big data- HDFS(2nd presentation)
Big data- HDFS(2nd presentation)Big data- HDFS(2nd presentation)
Big data- HDFS(2nd presentation)
Takrim Ul Islam Laskar
Big data(1st presentation)
Big data(1st presentation)Big data(1st presentation)
Big data(1st presentation)
Takrim Ul Islam Laskar
Facial Emotion Detection on Children's Emotional Face
Facial Emotion Detection on Children's Emotional FaceFacial Emotion Detection on Children's Emotional Face
Facial Emotion Detection on Children's Emotional Face
Takrim Ul Islam Laskar
Facial emotion detection on babies' emotional face using Deep Learning.
Facial emotion detection on babies' emotional face using Deep Learning.Facial emotion detection on babies' emotional face using Deep Learning.
Facial emotion detection on babies' emotional face using Deep Learning.
Takrim Ul Islam Laskar
Indian Sign Language Recognition Method For Deaf People
Indian Sign Language Recognition Method For Deaf PeopleIndian Sign Language Recognition Method For Deaf People
Indian Sign Language Recognition Method For Deaf People
Takrim Ul Islam Laskar
Introduction to Apache Hive(Big Data, Final Seminar)
Introduction to Apache Hive(Big Data, Final Seminar)Introduction to Apache Hive(Big Data, Final Seminar)
Introduction to Apache Hive(Big Data, Final Seminar)
Takrim Ul Islam Laskar

Recently uploaded (20)

Revolutionizing-Government-Communication-The-OSWAN-Success-Story
Revolutionizing-Government-Communication-The-OSWAN-Success-StoryRevolutionizing-Government-Communication-The-OSWAN-Success-Story
Revolutionizing-Government-Communication-The-OSWAN-Success-Story
ssuser52ad5e
Brave Browser Crack 1.45.133 Activated 2025
Brave Browser Crack 1.45.133 Activated 2025Brave Browser Crack 1.45.133 Activated 2025
Brave Browser Crack 1.45.133 Activated 2025
kherorpacca00126
Technology use over time and its impact on consumers and businesses.pptx
Technology use over time and its impact on consumers and businesses.pptxTechnology use over time and its impact on consumers and businesses.pptx
Technology use over time and its impact on consumers and businesses.pptx
kaylagaze
UiPath Automation Developer Associate Training Series 2025 - Session 1
UiPath Automation Developer Associate Training Series 2025 - Session 1UiPath Automation Developer Associate Training Series 2025 - Session 1
UiPath Automation Developer Associate Training Series 2025 - Session 1
DianaGray10
Inside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar Patturaj
Inside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar PatturajInside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar Patturaj
Inside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar Patturaj
ScyllaDB
Endpoint Backup: 3 Reasons MSPs Ignore It
Endpoint Backup: 3 Reasons MSPs Ignore ItEndpoint Backup: 3 Reasons MSPs Ignore It
Endpoint Backup: 3 Reasons MSPs Ignore It
MSP360
FinTech - US Annual Funding Report - 2024.pptx
FinTech - US Annual Funding Report - 2024.pptxFinTech - US Annual Funding Report - 2024.pptx
FinTech - US Annual Funding Report - 2024.pptx
Tracxn
A Framework for Model-Driven Digital Twin Engineering
A Framework for Model-Driven Digital Twin EngineeringA Framework for Model-Driven Digital Twin Engineering
A Framework for Model-Driven Digital Twin Engineering
Daniel Lehner
AIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramento
AIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramentoAIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramento
AIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramento
Alessandro Bogliolo
World Information Architecture Day 2025 - UX at a Crossroads
World Information Architecture Day 2025 - UX at a CrossroadsWorld Information Architecture Day 2025 - UX at a Crossroads
World Information Architecture Day 2025 - UX at a Crossroads
Joshua Randall
Field Device Management Market Report 2030 - TechSci Research
Field Device Management Market Report 2030 - TechSci ResearchField Device Management Market Report 2030 - TechSci Research
Field Device Management Market Report 2030 - TechSci Research
Vipin Mishra
SMART SENTRY CYBER THREAT INTELLIGENCE IN IIOT
SMART SENTRY CYBER THREAT INTELLIGENCE IN IIOTSMART SENTRY CYBER THREAT INTELLIGENCE IN IIOT
SMART SENTRY CYBER THREAT INTELLIGENCE IN IIOT
TanmaiArni
Q4_TLE-7-Lesson-6-Week-6.pptx 4th quarter
Q4_TLE-7-Lesson-6-Week-6.pptx 4th quarterQ4_TLE-7-Lesson-6-Week-6.pptx 4th quarter
Q4_TLE-7-Lesson-6-Week-6.pptx 4th quarter
MariaBarbaraPaglinaw
UiPath Automation Developer Associate Training Series 2025 - Session 2
UiPath Automation Developer Associate Training Series 2025 - Session 2UiPath Automation Developer Associate Training Series 2025 - Session 2
UiPath Automation Developer Associate Training Series 2025 - Session 2
DianaGray10
BoxLang JVM Language : The Future is Dynamic
BoxLang JVM Language : The Future is DynamicBoxLang JVM Language : The Future is Dynamic
BoxLang JVM Language : The Future is Dynamic
Ortus Solutions, Corp
Both Feet on the Ground - Generative Artificial Intelligence
Both Feet on the Ground - Generative Artificial IntelligenceBoth Feet on the Ground - Generative Artificial Intelligence
Both Feet on the Ground - Generative Artificial Intelligence
Pete Nieminen
UiPath Agentic Automation Capabilities and Opportunities
UiPath Agentic Automation Capabilities and OpportunitiesUiPath Agentic Automation Capabilities and Opportunities
UiPath Agentic Automation Capabilities and Opportunities
DianaGray10
EaseUS Partition Master Crack 2025 + Serial Key
EaseUS Partition Master Crack 2025 + Serial KeyEaseUS Partition Master Crack 2025 + Serial Key
EaseUS Partition Master Crack 2025 + Serial Key
kherorpacca127
Cloud of everything Tech of the 21 century in Aviation
Cloud of everything Tech of the 21 century in AviationCloud of everything Tech of the 21 century in Aviation
Cloud of everything Tech of the 21 century in Aviation
Assem mousa
DevNexus - Building 10x Development Organizations.pdf
DevNexus - Building 10x Development Organizations.pdfDevNexus - Building 10x Development Organizations.pdf
DevNexus - Building 10x Development Organizations.pdf
Justin Reock
Revolutionizing-Government-Communication-The-OSWAN-Success-Story
Revolutionizing-Government-Communication-The-OSWAN-Success-StoryRevolutionizing-Government-Communication-The-OSWAN-Success-Story
Revolutionizing-Government-Communication-The-OSWAN-Success-Story
ssuser52ad5e
Brave Browser Crack 1.45.133 Activated 2025
Brave Browser Crack 1.45.133 Activated 2025Brave Browser Crack 1.45.133 Activated 2025
Brave Browser Crack 1.45.133 Activated 2025
kherorpacca00126
Technology use over time and its impact on consumers and businesses.pptx
Technology use over time and its impact on consumers and businesses.pptxTechnology use over time and its impact on consumers and businesses.pptx
Technology use over time and its impact on consumers and businesses.pptx
kaylagaze
UiPath Automation Developer Associate Training Series 2025 - Session 1
UiPath Automation Developer Associate Training Series 2025 - Session 1UiPath Automation Developer Associate Training Series 2025 - Session 1
UiPath Automation Developer Associate Training Series 2025 - Session 1
DianaGray10
Inside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar Patturaj
Inside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar PatturajInside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar Patturaj
Inside Freshworks' Migration from Cassandra to ScyllaDB by Premkumar Patturaj
ScyllaDB
Endpoint Backup: 3 Reasons MSPs Ignore It
Endpoint Backup: 3 Reasons MSPs Ignore ItEndpoint Backup: 3 Reasons MSPs Ignore It
Endpoint Backup: 3 Reasons MSPs Ignore It
MSP360
FinTech - US Annual Funding Report - 2024.pptx
FinTech - US Annual Funding Report - 2024.pptxFinTech - US Annual Funding Report - 2024.pptx
FinTech - US Annual Funding Report - 2024.pptx
Tracxn
A Framework for Model-Driven Digital Twin Engineering
A Framework for Model-Driven Digital Twin EngineeringA Framework for Model-Driven Digital Twin Engineering
A Framework for Model-Driven Digital Twin Engineering
Daniel Lehner
AIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramento
AIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramentoAIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramento
AIXMOOC 2.3 - Modelli di reti neurali con esperimenti di addestramento
Alessandro Bogliolo
World Information Architecture Day 2025 - UX at a Crossroads
World Information Architecture Day 2025 - UX at a CrossroadsWorld Information Architecture Day 2025 - UX at a Crossroads
World Information Architecture Day 2025 - UX at a Crossroads
Joshua Randall
Field Device Management Market Report 2030 - TechSci Research
Field Device Management Market Report 2030 - TechSci ResearchField Device Management Market Report 2030 - TechSci Research
Field Device Management Market Report 2030 - TechSci Research
Vipin Mishra
SMART SENTRY CYBER THREAT INTELLIGENCE IN IIOT
SMART SENTRY CYBER THREAT INTELLIGENCE IN IIOTSMART SENTRY CYBER THREAT INTELLIGENCE IN IIOT
SMART SENTRY CYBER THREAT INTELLIGENCE IN IIOT
TanmaiArni
Q4_TLE-7-Lesson-6-Week-6.pptx 4th quarter
Q4_TLE-7-Lesson-6-Week-6.pptx 4th quarterQ4_TLE-7-Lesson-6-Week-6.pptx 4th quarter
Q4_TLE-7-Lesson-6-Week-6.pptx 4th quarter
MariaBarbaraPaglinaw
UiPath Automation Developer Associate Training Series 2025 - Session 2
UiPath Automation Developer Associate Training Series 2025 - Session 2UiPath Automation Developer Associate Training Series 2025 - Session 2
UiPath Automation Developer Associate Training Series 2025 - Session 2
DianaGray10
BoxLang JVM Language : The Future is Dynamic
BoxLang JVM Language : The Future is DynamicBoxLang JVM Language : The Future is Dynamic
BoxLang JVM Language : The Future is Dynamic
Ortus Solutions, Corp
Both Feet on the Ground - Generative Artificial Intelligence
Both Feet on the Ground - Generative Artificial IntelligenceBoth Feet on the Ground - Generative Artificial Intelligence
Both Feet on the Ground - Generative Artificial Intelligence
Pete Nieminen
UiPath Agentic Automation Capabilities and Opportunities
UiPath Agentic Automation Capabilities and OpportunitiesUiPath Agentic Automation Capabilities and Opportunities
UiPath Agentic Automation Capabilities and Opportunities
DianaGray10
EaseUS Partition Master Crack 2025 + Serial Key
EaseUS Partition Master Crack 2025 + Serial KeyEaseUS Partition Master Crack 2025 + Serial Key
EaseUS Partition Master Crack 2025 + Serial Key
kherorpacca127
Cloud of everything Tech of the 21 century in Aviation
Cloud of everything Tech of the 21 century in AviationCloud of everything Tech of the 21 century in Aviation
Cloud of everything Tech of the 21 century in Aviation
Assem mousa
DevNexus - Building 10x Development Organizations.pdf
DevNexus - Building 10x Development Organizations.pdfDevNexus - Building 10x Development Organizations.pdf
DevNexus - Building 10x Development Organizations.pdf
Justin Reock

Sentiment Analysis on Human with special Concentration on infants’ emotional face using Machine Learning Techniques.

  • 1. Seminar Presentation on Sentiment Analysis on Human with special Concentration on infants’ emotional face using Machine Learning Techniques. Presented By- Takrim Ul Islam Laskar Roll No. 170302005 M.Tech 3rd Sem Gauhati University Institute of Science And Technology Dept. of Information Technology,Gauhati University
  • 2. Contents • Introduction • Problem Statement • Background Study • Motivation • Applications • Action Plan • Tools, Environment and Experimental Plateform • Emotion Detection System • Face Detection Stage • Feature Extraction stage • Emotion Classification Stage • Conclusion • References
  • 3. Introduction Emotion is psychological and physiological state which is subjective to different conditions. Broadly classifying happyness, sadness, anger, disgust, surprise and fear are some of them. We are to devolope a software to detect the emotion of child/infant using openCV and Machine Learning. The project falls under the domains Artificial Intellegence and Digital Image Processing.
  • 4. Problem Statement Pose, speech, facial expression, behaviour, etc convey emotions of individuals . There’s an old proverb “Face is the index of mind”. All the inner emotions reflect on the face of an individual . So the idea is to read the face and detect the emotional state of the subject as it is easily perceptible and it has higher accuracy. In this project our focus would be to do the same with special concentration on children and infants.
  • 5. Background study • Wathsala Nayomi widanagamaachchi[1] in his research ‘Facial Emotion Recognition with a Neural Network Approach’ established the fact that Neural Network provides better accuracy than Naive Bayes classifier, which is a probabilistic classifier based on Bayes Theorem. • Andreea Pascu under guidance of Prof. Ross King[3] in there research ‘Facial Recognition System’ found a strong accuracy of 86% using Machine Learning.
  • 6. Motivation • Projects have been done earlier on Emotion Detection with precision. But we have taken up the task of focusing more on infants and children who cannot talk to express their feelings .
  • 7. Applications • This can be used for medical purposes to detect infants’ emotions. • This can be used as a facial language recognition system.
  • 8. Action Plan Date Milestone End September 2018 Problem Statement End October 2018 Literature review & Preprocessing End December 2018 Feature extraction & Phase 1 Project Report End of march 2019 Data set training Data set testing End of May 2019 Implementation & Phase 2 Project Report Face recognition system can also be collected and proceeded to feature extraction.
  • 9. Tools/Environment/Experimental Plateform • Tools – openCV 3.1.0, Python 2.7.12, Artificial Neural Network. • Operating System- Linux based plateform (e.g Ubuntu 16.04 ). • Hardware- RAM 4 GB, Intel Core i5 7th Gen.
  • 10. Emotion Detection System Fig 1. Emotion Detection System Stages in Emotion Detection: 1. Face Detection Stage. 2. Feature Extraction Stage. 3. Emotion Classification Stage.
  • 11. Face Detection Feature invariant Approach would be implemented . • It would work based on the skin colour. • It is in focus currently as skin colour resides in a small colour range in different colour spaces irrespective of race.
  • 12. Feature Extraction Stage 1. Feature Region Extraction: From the face detected, further processing gives eye, eyebrows, mouth, etc. 2. Feature Point Extraction From the regions the corner points are extracted .
  • 13. Emotion Classification Stage The feature points are then inputed to the neural network. Neural Network would be used to train a Data Set. This Data Set would be used to classify the emotions inputed. In doing so, a huge amount of facial expressions of different individuals would have to be collected.
  • 14. Conclusion The application would be able to detect the mental and physiological state of an individual especially the infant . This can be used to provide appropriate care to the infant.
  • 15. References [1] Wathsala Nayomi Widanagamaachchi. Facial Emotion Recognition with a Neural Network Approach. 2009. [2] G.Hemalatha and C.P Samathi, ‘A Study of Techniques for Facial Detection and Expression Classification’, IJCSES Vol.5, April 2014 [3] Andreea Pascu and Prof. Ross King, ‘Facial Expression Recognition System’, University of Manchester, April 2015. [4] M. Pantic, L. J. M. Rothkrantz, and H. Koppelaar. Automation of nonverbal communication of facial expressions. In in: EUROMEDIA 98, SCS International, pages 86{93, 1998. [5] T. Pham and M. Worring. Face detection methods: A critical evaluation. ISIS Technical Report Series, University of Amsterdam, 11, 2000. [6] T. V. Pham, M. Worring, and A. W. M. Smeulders. Face detection by aggregated bayesian network classifiers. Pattern Recogn. Lett., 23(4):451{461, 2002.