際際滷

際際滷Share a Scribd company logo
1
Are you playing with me?Are you playing with me?
Towards Vois: A persuasive
e-learning system that
provides socially
contextualised information as
an aide and reference for
people with emotion
recognition difficulties
Councillor Jonathan Bishop
BSc(Hons), MSc, LLM, MIEEE, MBCS, CITP
Emotion and Emotion Recognition DifficultyEmotion and Emotion Recognition Difficulty
 Emotion
 an油expression油of油a油feeling油through油either油internally油
or油externally油orientated油bodily油means油that油
motivates油a油further油response油from油oneself油or油
others
 Emotion Recognition Difficulty
 an油impairment油in油ones油ability油to油recognise油and油
respond油to油the油emotions油of油others
2
The Solution: The Versatile
Ontological Imitation System (Vois)
The Solution: The Versatile
Ontological Imitation System (Vois)
 Recognises emotion in speech, facial
expression and dialogue
 Existing algorithms: SAR, FAR
 New algorithm: Dialogue affect recognition
(DAR)
 Recommends appropriate responses
 Natural language (inc. AIML, PAIGE)
The MethodologyThe Methodology
Follows my adapted 2005/7 development model
 User Experience Analysis
 Questionnaires and Regression Analysis
 Technical Development
 Q-sort and Q-method factor analysis
 Prototyping and Clinical testing
 Logging actual use and ANOVA
 Market and Competition Analyses
 Earlier Questionnaire and cluster analysis
 SWOT Analysis
3
Data Flow of StudiesData Flow of Studies
ConclusionsConclusions
 People with ERDs shouldnt be forced to
overcome their disability
 Technology should take the strain of
stimuli processing and not the person with
an ERD
 Even with aides such as Vois, others
should think about how they express
themselves to people with ERDs
4
Any Questions?Any Questions?
 Emotion Recognition Difficulties
 Vois
 Doctoral Research Methodology
 Other

More Related Content

Similar to Are you playing with me? - Towards Vois (20)

Emotion Ontology and Affective Neuroscience
Emotion Ontology and Affective NeuroscienceEmotion Ontology and Affective Neuroscience
Emotion Ontology and Affective Neuroscience
Janna Hastings
What is NLP? (Neurolinguistic Programming)
What is NLP? (Neurolinguistic Programming)What is NLP? (Neurolinguistic Programming)
What is NLP? (Neurolinguistic Programming)
Jacob Laguerre
iMotions White Paper: Validation of Emotion Evaluation System embedded in Att...
iMotions White Paper: Validation of Emotion Evaluation System embedded in Att...iMotions White Paper: Validation of Emotion Evaluation System embedded in Att...
iMotions White Paper: Validation of Emotion Evaluation System embedded in Att...
iMotionsEyeTracking
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine LearningThelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
mlaij
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine LearningThelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
mlaij
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine LearningThelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
mlaij
Language of Influence
Language of InfluenceLanguage of Influence
Language of Influence
Zsuzsanna Vida
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Rasa Technologies
Depression Screening in Humans With AI and Deep Learning Techniques.pdf
Depression Screening in Humans With AI and Deep Learning Techniques.pdfDepression Screening in Humans With AI and Deep Learning Techniques.pdf
Depression Screening in Humans With AI and Deep Learning Techniques.pdf
OKOKPROJECTS
Ac tsumugu 20170712
Ac tsumugu 20170712Ac tsumugu 20170712
Ac tsumugu 20170712
leverages_event
A New Model: Advancing Organizational Security Through Peacebuilding-1st draft
A New Model: Advancing Organizational Security Through Peacebuilding-1st draftA New Model: Advancing Organizational Security Through Peacebuilding-1st draft
A New Model: Advancing Organizational Security Through Peacebuilding-1st draft
Michele Chubirka
Impact of Emotion on Prosody Analysis
Impact of Emotion on Prosody AnalysisImpact of Emotion on Prosody Analysis
Impact of Emotion on Prosody Analysis
IOSR Journals
[Webinar] Applying Neuroscience to Communications Research
[Webinar] Applying Neuroscience to Communications Research[Webinar] Applying Neuroscience to Communications Research
[Webinar] Applying Neuroscience to Communications Research
InsightInnovation
ODN_NYC_Maltbia_3.26.15_Audience
ODN_NYC_Maltbia_3.26.15_AudienceODN_NYC_Maltbia_3.26.15_Audience
ODN_NYC_Maltbia_3.26.15_Audience
Dr. Terrence E. Maltbia
Projective Technique
Projective TechniqueProjective Technique
Projective Technique
University of Cebu
HBO - Emotional Intelligence
HBO - Emotional IntelligenceHBO - Emotional Intelligence
HBO - Emotional Intelligence
master publicadmin
Sri-Pratap-College-Department-of-Information-Technology Presentation.pptx
Sri-Pratap-College-Department-of-Information-Technology Presentation.pptxSri-Pratap-College-Department-of-Information-Technology Presentation.pptx
Sri-Pratap-College-Department-of-Information-Technology Presentation.pptx
TAHIRZAMAN81
Basic Question Evaluation
Basic Question EvaluationBasic Question Evaluation
Basic Question Evaluation
Jessica Speer
Personality, Leadership, and Emotional Intelligence: Strategies and Assessments
Personality, Leadership, and Emotional Intelligence: Strategies and AssessmentsPersonality, Leadership, and Emotional Intelligence: Strategies and Assessments
Personality, Leadership, and Emotional Intelligence: Strategies and Assessments
Career Communications Group
Literature Review On: Speech Emotion Recognition Using Deep Neural Network
Literature Review On: Speech Emotion Recognition Using Deep Neural NetworkLiterature Review On: Speech Emotion Recognition Using Deep Neural Network
Literature Review On: Speech Emotion Recognition Using Deep Neural Network
IRJET Journal
Emotion Ontology and Affective Neuroscience
Emotion Ontology and Affective NeuroscienceEmotion Ontology and Affective Neuroscience
Emotion Ontology and Affective Neuroscience
Janna Hastings
What is NLP? (Neurolinguistic Programming)
What is NLP? (Neurolinguistic Programming)What is NLP? (Neurolinguistic Programming)
What is NLP? (Neurolinguistic Programming)
Jacob Laguerre
iMotions White Paper: Validation of Emotion Evaluation System embedded in Att...
iMotions White Paper: Validation of Emotion Evaluation System embedded in Att...iMotions White Paper: Validation of Emotion Evaluation System embedded in Att...
iMotions White Paper: Validation of Emotion Evaluation System embedded in Att...
iMotionsEyeTracking
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine LearningThelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
mlaij
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine LearningThelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
mlaij
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine LearningThelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
Thelxino谷: Recognizing Human Emotions Using Pupillometry and Machine Learning
mlaij
Language of Influence
Language of InfluenceLanguage of Influence
Language of Influence
Zsuzsanna Vida
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Beyond Sentiment Analysis: Creating Engaging Conversational Experiences throu...
Rasa Technologies
Depression Screening in Humans With AI and Deep Learning Techniques.pdf
Depression Screening in Humans With AI and Deep Learning Techniques.pdfDepression Screening in Humans With AI and Deep Learning Techniques.pdf
Depression Screening in Humans With AI and Deep Learning Techniques.pdf
OKOKPROJECTS
A New Model: Advancing Organizational Security Through Peacebuilding-1st draft
A New Model: Advancing Organizational Security Through Peacebuilding-1st draftA New Model: Advancing Organizational Security Through Peacebuilding-1st draft
A New Model: Advancing Organizational Security Through Peacebuilding-1st draft
Michele Chubirka
Impact of Emotion on Prosody Analysis
Impact of Emotion on Prosody AnalysisImpact of Emotion on Prosody Analysis
Impact of Emotion on Prosody Analysis
IOSR Journals
[Webinar] Applying Neuroscience to Communications Research
[Webinar] Applying Neuroscience to Communications Research[Webinar] Applying Neuroscience to Communications Research
[Webinar] Applying Neuroscience to Communications Research
InsightInnovation
HBO - Emotional Intelligence
HBO - Emotional IntelligenceHBO - Emotional Intelligence
HBO - Emotional Intelligence
master publicadmin
Sri-Pratap-College-Department-of-Information-Technology Presentation.pptx
Sri-Pratap-College-Department-of-Information-Technology Presentation.pptxSri-Pratap-College-Department-of-Information-Technology Presentation.pptx
Sri-Pratap-College-Department-of-Information-Technology Presentation.pptx
TAHIRZAMAN81
Basic Question Evaluation
Basic Question EvaluationBasic Question Evaluation
Basic Question Evaluation
Jessica Speer
Personality, Leadership, and Emotional Intelligence: Strategies and Assessments
Personality, Leadership, and Emotional Intelligence: Strategies and AssessmentsPersonality, Leadership, and Emotional Intelligence: Strategies and Assessments
Personality, Leadership, and Emotional Intelligence: Strategies and Assessments
Career Communications Group
Literature Review On: Speech Emotion Recognition Using Deep Neural Network
Literature Review On: Speech Emotion Recognition Using Deep Neural NetworkLiterature Review On: Speech Emotion Recognition Using Deep Neural Network
Literature Review On: Speech Emotion Recognition Using Deep Neural Network
IRJET Journal

More from Jonathan Bishop (8)

Classroom 2.0 and Beyond: Education, Health, Economic and Justice Policies fo...
Classroom 2.0 and Beyond: Education, Health, Economic and Justice Policies fo...Classroom 2.0 and Beyond: Education, Health, Economic and Justice Policies fo...
Classroom 2.0 and Beyond: Education, Health, Economic and Justice Policies fo...
Jonathan Bishop
Learning from the Credit Crunch: Towards Fiscal Prudence in European Union In...
Learning from the Credit Crunch: Towards Fiscal Prudence in European Union In...Learning from the Credit Crunch: Towards Fiscal Prudence in European Union In...
Learning from the Credit Crunch: Towards Fiscal Prudence in European Union In...
Jonathan Bishop
Sex and age biases in Tweets relating to the 2015 migration crisis
Sex and age biases in Tweets relating to the 2015 migration crisis Sex and age biases in Tweets relating to the 2015 migration crisis
Sex and age biases in Tweets relating to the 2015 migration crisis
Jonathan Bishop
Godliness next to Anonymous: Anti-establishment rhetoric in Robin Hood ballad...
Godliness next to Anonymous: Anti-establishment rhetoric in Robin Hood ballad...Godliness next to Anonymous: Anti-establishment rhetoric in Robin Hood ballad...
Godliness next to Anonymous: Anti-establishment rhetoric in Robin Hood ballad...
Jonathan Bishop
The misrepresentation of Digital Teens as trolls
The misrepresentation of Digital Teens as trollsThe misrepresentation of Digital Teens as trolls
The misrepresentation of Digital Teens as trolls
Jonathan Bishop
Crowd-funding WordPress Plugins
Crowd-funding WordPress PluginsCrowd-funding WordPress Plugins
Crowd-funding WordPress Plugins
Jonathan Bishop
YouTube if you want to - the Lady's not for blogging: Using 'bleasures' and '...
YouTube if you want to - the Lady's not for blogging: Using 'bleasures' and '...YouTube if you want to - the Lady's not for blogging: Using 'bleasures' and '...
YouTube if you want to - the Lady's not for blogging: Using 'bleasures' and '...
Jonathan Bishop
Social change in organic and virtual communities
Social change in organic and virtual communitiesSocial change in organic and virtual communities
Social change in organic and virtual communities
Jonathan Bishop
Classroom 2.0 and Beyond: Education, Health, Economic and Justice Policies fo...
Classroom 2.0 and Beyond: Education, Health, Economic and Justice Policies fo...Classroom 2.0 and Beyond: Education, Health, Economic and Justice Policies fo...
Classroom 2.0 and Beyond: Education, Health, Economic and Justice Policies fo...
Jonathan Bishop
Learning from the Credit Crunch: Towards Fiscal Prudence in European Union In...
Learning from the Credit Crunch: Towards Fiscal Prudence in European Union In...Learning from the Credit Crunch: Towards Fiscal Prudence in European Union In...
Learning from the Credit Crunch: Towards Fiscal Prudence in European Union In...
Jonathan Bishop
Sex and age biases in Tweets relating to the 2015 migration crisis
Sex and age biases in Tweets relating to the 2015 migration crisis Sex and age biases in Tweets relating to the 2015 migration crisis
Sex and age biases in Tweets relating to the 2015 migration crisis
Jonathan Bishop
Godliness next to Anonymous: Anti-establishment rhetoric in Robin Hood ballad...
Godliness next to Anonymous: Anti-establishment rhetoric in Robin Hood ballad...Godliness next to Anonymous: Anti-establishment rhetoric in Robin Hood ballad...
Godliness next to Anonymous: Anti-establishment rhetoric in Robin Hood ballad...
Jonathan Bishop
The misrepresentation of Digital Teens as trolls
The misrepresentation of Digital Teens as trollsThe misrepresentation of Digital Teens as trolls
The misrepresentation of Digital Teens as trolls
Jonathan Bishop
Crowd-funding WordPress Plugins
Crowd-funding WordPress PluginsCrowd-funding WordPress Plugins
Crowd-funding WordPress Plugins
Jonathan Bishop
YouTube if you want to - the Lady's not for blogging: Using 'bleasures' and '...
YouTube if you want to - the Lady's not for blogging: Using 'bleasures' and '...YouTube if you want to - the Lady's not for blogging: Using 'bleasures' and '...
YouTube if you want to - the Lady's not for blogging: Using 'bleasures' and '...
Jonathan Bishop
Social change in organic and virtual communities
Social change in organic and virtual communitiesSocial change in organic and virtual communities
Social change in organic and virtual communities
Jonathan Bishop

Recently uploaded (9)

Meffier_Infra.pdfssssssssssssssssssssssssss
Meffier_Infra.pdfssssssssssssssssssssssssssMeffier_Infra.pdfssssssssssssssssssssssssss
Meffier_Infra.pdfssssssssssssssssssssssssss
ashutoshpropertyinin
Lenskart final about comparing the analysis
Lenskart final about comparing the analysisLenskart final about comparing the analysis
Lenskart final about comparing the analysis
YugamKejriwal1
Word Processing - Module 1.pptx to become
Word Processing - Module 1.pptx to becomeWord Processing - Module 1.pptx to become
Word Processing - Module 1.pptx to become
steveparker9990sp
Computer Hardware and its classification .pptx
Computer Hardware and its classification .pptxComputer Hardware and its classification .pptx
Computer Hardware and its classification .pptx
leonsaifullah
Etendue of microLED: fundamental theory and applications
Etendue of microLED: fundamental theory and applicationsEtendue of microLED: fundamental theory and applications
Etendue of microLED: fundamental theory and applications
Brian Kim, PhD
International Discussion of Law Presentation CISG.pptx
International Discussion of Law Presentation CISG.pptxInternational Discussion of Law Presentation CISG.pptx
International Discussion of Law Presentation CISG.pptx
charleschukwuogor
Instrucciones en manual de amplificador de audio k8060 en pdf
Instrucciones en manual de amplificador de audio k8060 en pdfInstrucciones en manual de amplificador de audio k8060 en pdf
Instrucciones en manual de amplificador de audio k8060 en pdf
MariaNievesPrez
Materials, Sensors and Actuators in MEMS technology evolution.pptx
Materials, Sensors and Actuators in MEMS technology evolution.pptxMaterials, Sensors and Actuators in MEMS technology evolution.pptx
Materials, Sensors and Actuators in MEMS technology evolution.pptx
DhamodharanSrinivasa1
P N 11 @ FDSF SDF SFSF SDFSDFSDFSDFDFDDDDDDDDDDDDDDD
P N 11 @ FDSF SDF SFSF SDFSDFSDFSDFDFDDDDDDDDDDDDDDDP N 11 @ FDSF SDF SFSF SDFSDFSDFSDFDFDDDDDDDDDDDDDDD
P N 11 @ FDSF SDF SFSF SDFSDFSDFSDFDFDDDDDDDDDDDDDDD
LuthMnh54
Meffier_Infra.pdfssssssssssssssssssssssssss
Meffier_Infra.pdfssssssssssssssssssssssssssMeffier_Infra.pdfssssssssssssssssssssssssss
Meffier_Infra.pdfssssssssssssssssssssssssss
ashutoshpropertyinin
Lenskart final about comparing the analysis
Lenskart final about comparing the analysisLenskart final about comparing the analysis
Lenskart final about comparing the analysis
YugamKejriwal1
Word Processing - Module 1.pptx to become
Word Processing - Module 1.pptx to becomeWord Processing - Module 1.pptx to become
Word Processing - Module 1.pptx to become
steveparker9990sp
Computer Hardware and its classification .pptx
Computer Hardware and its classification .pptxComputer Hardware and its classification .pptx
Computer Hardware and its classification .pptx
leonsaifullah
Etendue of microLED: fundamental theory and applications
Etendue of microLED: fundamental theory and applicationsEtendue of microLED: fundamental theory and applications
Etendue of microLED: fundamental theory and applications
Brian Kim, PhD
International Discussion of Law Presentation CISG.pptx
International Discussion of Law Presentation CISG.pptxInternational Discussion of Law Presentation CISG.pptx
International Discussion of Law Presentation CISG.pptx
charleschukwuogor
Instrucciones en manual de amplificador de audio k8060 en pdf
Instrucciones en manual de amplificador de audio k8060 en pdfInstrucciones en manual de amplificador de audio k8060 en pdf
Instrucciones en manual de amplificador de audio k8060 en pdf
MariaNievesPrez
Materials, Sensors and Actuators in MEMS technology evolution.pptx
Materials, Sensors and Actuators in MEMS technology evolution.pptxMaterials, Sensors and Actuators in MEMS technology evolution.pptx
Materials, Sensors and Actuators in MEMS technology evolution.pptx
DhamodharanSrinivasa1
P N 11 @ FDSF SDF SFSF SDFSDFSDFSDFDFDDDDDDDDDDDDDDD
P N 11 @ FDSF SDF SFSF SDFSDFSDFSDFDFDDDDDDDDDDDDDDDP N 11 @ FDSF SDF SFSF SDFSDFSDFSDFDFDDDDDDDDDDDDDDD
P N 11 @ FDSF SDF SFSF SDFSDFSDFSDFDFDDDDDDDDDDDDDDD
LuthMnh54

Are you playing with me? - Towards Vois

  • 1. 1 Are you playing with me?Are you playing with me? Towards Vois: A persuasive e-learning system that provides socially contextualised information as an aide and reference for people with emotion recognition difficulties Councillor Jonathan Bishop BSc(Hons), MSc, LLM, MIEEE, MBCS, CITP Emotion and Emotion Recognition DifficultyEmotion and Emotion Recognition Difficulty Emotion an油expression油of油a油feeling油through油either油internally油 or油externally油orientated油bodily油means油that油 motivates油a油further油response油from油oneself油or油 others Emotion Recognition Difficulty an油impairment油in油ones油ability油to油recognise油and油 respond油to油the油emotions油of油others
  • 2. 2 The Solution: The Versatile Ontological Imitation System (Vois) The Solution: The Versatile Ontological Imitation System (Vois) Recognises emotion in speech, facial expression and dialogue Existing algorithms: SAR, FAR New algorithm: Dialogue affect recognition (DAR) Recommends appropriate responses Natural language (inc. AIML, PAIGE) The MethodologyThe Methodology Follows my adapted 2005/7 development model User Experience Analysis Questionnaires and Regression Analysis Technical Development Q-sort and Q-method factor analysis Prototyping and Clinical testing Logging actual use and ANOVA Market and Competition Analyses Earlier Questionnaire and cluster analysis SWOT Analysis
  • 3. 3 Data Flow of StudiesData Flow of Studies ConclusionsConclusions People with ERDs shouldnt be forced to overcome their disability Technology should take the strain of stimuli processing and not the person with an ERD Even with aides such as Vois, others should think about how they express themselves to people with ERDs
  • 4. 4 Any Questions?Any Questions? Emotion Recognition Difficulties Vois Doctoral Research Methodology Other