On the Impact of Personality in Massive Open Online Learning
1 like588 views
A presentation given in the ACM User Modeling, Adaptation and Personalization (2016) conference in July 2016, describing the impact of personality in massive open online learning environment.
On the Impact of Personality in Massive Open Online Learning
- 1. On the Impact of Personality in Massive Open Online Learning Guanliang Chen, Dan Davis, Claudia Hauff, Geert-Jan Houben Web Information Systems, TU Delft
- 2. Whythis research? Personality MOOC-based learning Classroom-based learning - Conscientious learners are likely to succeed. - matters MOOCs
- 3. Whythis research? Personality MOOC-based learning Classroom-based learning - Conscientious learners are likely to succeed. - matters Do learners' personalities impact their learning & learning behaviour in the MOOC setting? MOOCs
- 5. Whatresearch questions? 1 Does personality impact learner engagement, learner behaviour and learner success in the context of MOOCs?
- 6. Whatresearch questions? 1 Does personality impact learner engagement, learner behaviour and learner success in the context of MOOCs? Can learners' personalities be predicted based on their behaviour exhibited on a MOOC platform?2
- 9. Method Data Gathering Feature Engineering Correlation Analysis Prediction Big Five Personality Test Extraversion Conscientiousness Being organised, disciplined and achievement-oriented A high degree of sociability and assertiveness Agreeableness Being helpful to others, cooperative and sympathetic Neuroticism Emotional stability, the level of anxiety and impulse control Openness Being intellectual curious and prefer variety and novelty
- 10. Method Data Gathering Feature Engineering Correlation Analysis Prediction Big Five Personality Test Extraversion Conscientiousness Being organised, disciplined and achievement-oriented A high degree of assertiveness Agreeableness Being cooperative Neuroticism Emotional stability, anxiety Openness Being prefer
- 11. Method Data Gathering Feature Engineering Correlation Analysis Prediction Big Five Personality Test Extraversion Conscientiousness Being and A high degree of assertiveness Agreeableness Being cooperative Neuroticism Emotional stability, anxiety Openness Being intellectual curious and prefer variety and novelty
- 13. Method Data Gathering Feature Engineering Correlation Analysis Prediction Video-based features - Time watching video material - # videos skipped - Quiz-based features - Time solving quizzes - # Questions learners attempted to solve - Forum-based features - # New forum questions - # Forum replies -
- 14. Method Data Gathering Feature Engineering Correlation Analysis Prediction Video-based features - Time watching video material - # videos skipped - Quiz-based features - Time solving quizzes - # Questions learners attempted to solve - Forum-based features - # New forum questions - # Forum replies - In total, there are 20 features.
- 16. Method Data Gathering Feature Engineering Correlation Analysis Prediction Low prior- knowledge group High prior- knowledge group Learners
- 17. Method Data Gathering Feature Engineering Correlation Analysis Prediction 18 features 5 personality traits Spearmans rank correlation analysis Low prior- knowledge group High prior- knowledge group Learners
- 19. Method Data Gathering Feature Engineering Correlation Analysis Prediction Learning features Personality traits Input Regression Model Output Gaussian Processes Ramdom Forests
- 21. Prediction Accuracy Results Correlation Analysis Low prior-knowledge group E A C N O Time watching video material (in min.) 0.00 -0.04 0.15 0.03 -0.18 Time solving quizes (in min.) -0.02 0.02 0.07 0.02 -0.18 # Questions learners attempted to solve -0.04 -0.04 0.15 0.03 -0.17 # New forum questions 0.07 0.04 0.01 0.04 0.00 # Forum replies 0.12 0.12 0.00 0.01 0.03 # Total forum postings 0.11 0.10 0.03 0.03 0.02 Forum browsing time -0.10 0.00 0.06 -0.04 -0.13 Forum accesses -0.11 -0.04 0.06 -0.05 -0.16 # Forum interactions 0.10 0.11 0.03 0.04 0.03 Total time on-site -0.02 -0.03 0.12 0.01 -0.19 Average time responded to videos 0.09 -0.04 -0.04 -0.06 -0.1 Average time responded to quizs 0.03 0 -0.14 -0.1 -0.15 # Videos skipped 0.02 0.07 -0.14 -0.04 0.18 # Videos sped up 0.00 -0.03 0.10 -0.01 -0.02 Maximum session time -0.02 -0.05 0.10 0.00 -0.17 Average session time 0.00 -0.03 0.05 -0.01 -0.08 Standard deviation session time 0.04 -0.01 0.11 0.02 -0.16 Average between-quizzes time 0.03 0.10 0.00 0.02 -0.10 Standard deviation between-quizzes time 0.01 0.06 0.04 0.01 -0.14 Final score -0.06 -0.07 0.12 0.07 -0.15
- 22. Prediction Accuracy Results Correlation Analysis Low prior-knowledge group E A C N O Time watching video material (in min.) 0.00 -0.04 0.15 0.03 -0.18 Time solving quizes (in min.) -0.02 0.02 0.07 0.02 -0.18 # Questions learners attempted to solve -0.04 -0.04 0.15 0.03 -0.17 # New forum questions 0.07 0.04 0.01 0.04 0.00 # Forum replies 0.12 0.12 0.00 0.01 0.03 # Total forum postings 0.11 0.10 0.03 0.03 0.02 Forum browsing time -0.10 0.00 0.06 -0.04 -0.13 Forum accesses -0.11 -0.04 0.06 -0.05 -0.16 # Forum interactions 0.10 0.11 0.03 0.04 0.03 Total time on-site -0.02 -0.03 0.12 0.01 -0.19 Average time responded to videos 0.09 -0.04 -0.04 -0.06 -0.1 Average time responded to quizs 0.03 0 -0.14 -0.1 -0.15 # Videos skipped 0.02 0.07 -0.14 -0.04 0.18 # Videos sped up 0.00 -0.03 0.10 -0.01 -0.02 Maximum session time -0.02 -0.05 0.10 0.00 -0.17 Average session time 0.00 -0.03 0.05 -0.01 -0.08 Standard deviation session time 0.04 -0.01 0.11 0.02 -0.16 Average between-quizzes time 0.03 0.10 0.00 0.02 -0.10 Standard deviation between-quizzes time 0.01 0.06 0.04 0.01 -0.14 Final score -0.06 -0.07 0.12 0.07 -0.15 Only openness to experience and conscientiousness are signi鍖cantly correlated with a number of features.
- 23. Prediction Accuracy Results Correlation Analysis Low prior-knowledge group E A C N O Time watching video material (in min.) 0.00 -0.04 0.15 0.03 -0.18 Time solving quizes (in min.) -0.02 0.02 0.07 0.02 -0.18 # Questions learners attempted to solve -0.04 -0.04 0.15 0.03 -0.17 # New forum questions 0.07 0.04 0.01 0.04 0.00 # Forum replies 0.12 0.12 0.00 0.01 0.03 # Total forum postings 0.11 0.10 0.03 0.03 0.02 Forum browsing time -0.10 0.00 0.06 -0.04 -0.13 Forum accesses -0.11 -0.04 0.06 -0.05 -0.16 # Forum interactions 0.10 0.11 0.03 0.04 0.03 Total time on-site -0.02 -0.03 0.12 0.01 -0.19 Average time responded to videos 0.09 -0.04 -0.04 -0.06 -0.1 Average time responded to quizs 0.03 0 -0.14 -0.1 -0.15 # Videos skipped 0.02 0.07 -0.14 -0.04 0.18 # Videos sped up 0.00 -0.03 0.10 -0.01 -0.02 Maximum session time -0.02 -0.05 0.10 0.00 -0.17 Average session time 0.00 -0.03 0.05 -0.01 -0.08 Standard deviation session time 0.04 -0.01 0.11 0.02 -0.16 Average between-quizzes time 0.03 0.10 0.00 0.02 -0.10 Standard deviation between-quizzes time 0.01 0.06 0.04 0.01 -0.14 Final score -0.06 -0.07 0.12 0.07 -0.15 Only openness to experience and conscientiousness are signi鍖cantly correlated with a number of features. Conscientious learners (self-disciplined, striving for success) are likely to be more engaged with more learning materials.
- 24. Prediction Accuracy Results Correlation Analysis Low prior-knowledge group E A C N O Time watching video material (in min.) 0.00 -0.04 0.15 0.03 -0.18 Time solving quizes (in min.) -0.02 0.02 0.07 0.02 -0.18 # Questions learners attempted to solve -0.04 -0.04 0.15 0.03 -0.17 # New forum questions 0.07 0.04 0.01 0.04 0.00 # Forum replies 0.12 0.12 0.00 0.01 0.03 # Total forum postings 0.11 0.10 0.03 0.03 0.02 Forum browsing time -0.10 0.00 0.06 -0.04 -0.13 Forum accesses -0.11 -0.04 0.06 -0.05 -0.16 # Forum interactions 0.10 0.11 0.03 0.04 0.03 Total time on-site -0.02 -0.03 0.12 0.01 -0.19 Average time responded to videos 0.09 -0.04 -0.04 -0.06 -0.1 Average time responded to quizs 0.03 0 -0.14 -0.1 -0.15 # Videos skipped 0.02 0.07 -0.14 -0.04 0.18 # Videos sped up 0.00 -0.03 0.10 -0.01 -0.02 Maximum session time -0.02 -0.05 0.10 0.00 -0.17 Average session time 0.00 -0.03 0.05 -0.01 -0.08 Standard deviation session time 0.04 -0.01 0.11 0.02 -0.16 Average between-quizzes time 0.03 0.10 0.00 0.02 -0.10 Standard deviation between-quizzes time 0.01 0.06 0.04 0.01 -0.14 Final score -0.06 -0.07 0.12 0.07 -0.15 Only openness to experience and conscientiousness are signi鍖cantly correlated with a number of features. Learners with high openness (being intellectually curious, prefer variety) are less likely to spend time on the learning material. Conscientious learners (self-disciplined, striving for success) are likely to be more engaged with more learning materials.
- 25. Prediction Accuracy Correlation Analysis Results High prior-knowledge group E A C N O Time watching video material (in min.) -0.08 -0.07 0.09 0.05 -0.01 Time solving quizes (in min.) -0.09 -0.10 0.10 0.04 -0.03 # Questions learners attempted to solve -0.13 -0.08 0.08 0.00 -0.03 # New forum questions -0.04 0.04 0.10 -0.03 0.03 # Forum replies -0.02 0.03 0.15 0.08 0.03 # Total forum postings -0.03 0.02 0.15 0.02 0.03 Forum browsing time -0.11 -0.04 0.02 -0.03 -0.06 Forum accesses -0.14 -0.06 0.03 -0.04 -0.04 # Forum interactions -0.02 0.02 0.15 0.03 0.03 Total time on-site -0.07 -0.07 0.11 0.04 -0.03 Average time responded to videos 0.05 -0.02 -0.01 0.06 0.03 Average time responded to quizs 0.03 -0.05 0 0.05 0.02 # Videos skipped 0.09 0.08 -0.09 -0.04 0.00 # Videos sped up 0.03 0.00 0.06 0.09 0.06 Maximum session time -0.04 -0.04 0.11 0.04 -0.04 Average session time 0.06 -0.05 0.03 0.06 -0.04 Standard deviation session time -0.03 -0.07 0.12 0.04 -0.04 Average between-quizzes time 0.00 -0.06 0.09 0.06 0.00 Standard deviation between-quizzes time -0.03 -0.07 0.09 0.07 0.00 Final score -0.12 -0.05 0.07 0.01 -0.01
- 26. Prediction Accuracy Correlation Analysis Results High prior-knowledge group E A C N O Time watching video material (in min.) -0.08 -0.07 0.09 0.05 -0.01 Time solving quizes (in min.) -0.09 -0.10 0.10 0.04 -0.03 # Questions learners attempted to solve -0.13 -0.08 0.08 0.00 -0.03 # New forum questions -0.04 0.04 0.10 -0.03 0.03 # Forum replies -0.02 0.03 0.15 0.08 0.03 # Total forum postings -0.03 0.02 0.15 0.02 0.03 Forum browsing time -0.11 -0.04 0.02 -0.03 -0.06 Forum accesses -0.14 -0.06 0.03 -0.04 -0.04 # Forum interactions -0.02 0.02 0.15 0.03 0.03 Total time on-site -0.07 -0.07 0.11 0.04 -0.03 Average time responded to videos 0.05 -0.02 -0.01 0.06 0.03 Average time responded to quizs 0.03 -0.05 0 0.05 0.02 # Videos skipped 0.09 0.08 -0.09 -0.04 0.00 # Videos sped up 0.03 0.00 0.06 0.09 0.06 Maximum session time -0.04 -0.04 0.11 0.04 -0.04 Average session time 0.06 -0.05 0.03 0.06 -0.04 Standard deviation session time -0.03 -0.07 0.12 0.04 -0.04 Average between-quizzes time 0.00 -0.06 0.09 0.06 0.00 Standard deviation between-quizzes time -0.03 -0.07 0.09 0.07 0.00 Final score -0.12 -0.05 0.07 0.01 -0.01 Again, no signi鍖cant correlation between behavioural features and agreeableness and neuroticism can be observed.
- 27. Prediction Accuracy Correlation Analysis Results High prior-knowledge group E A C N O Time watching video material (in min.) -0.08 -0.07 0.09 0.05 -0.01 Time solving quizes (in min.) -0.09 -0.10 0.10 0.04 -0.03 # Questions learners attempted to solve -0.13 -0.08 0.08 0.00 -0.03 # New forum questions -0.04 0.04 0.10 -0.03 0.03 # Forum replies -0.02 0.03 0.15 0.08 0.03 # Total forum postings -0.03 0.02 0.15 0.02 0.03 Forum browsing time -0.11 -0.04 0.02 -0.03 -0.06 Forum accesses -0.14 -0.06 0.03 -0.04 -0.04 # Forum interactions -0.02 0.02 0.15 0.03 0.03 Total time on-site -0.07 -0.07 0.11 0.04 -0.03 Average time responded to videos 0.05 -0.02 -0.01 0.06 0.03 Average time responded to quizs 0.03 -0.05 0 0.05 0.02 # Videos skipped 0.09 0.08 -0.09 -0.04 0.00 # Videos sped up 0.03 0.00 0.06 0.09 0.06 Maximum session time -0.04 -0.04 0.11 0.04 -0.04 Average session time 0.06 -0.05 0.03 0.06 -0.04 Standard deviation session time -0.03 -0.07 0.12 0.04 -0.04 Average between-quizzes time 0.00 -0.06 0.09 0.06 0.00 Standard deviation between-quizzes time -0.03 -0.07 0.09 0.07 0.00 Final score -0.12 -0.05 0.07 0.01 -0.01 Again, no signi鍖cant correlation between behavioural features and agreeableness and neuroticism can be observed. Conscientious learners are likely to be active in forum discussion, while extraneous leaners not.
- 28. Prediction Accuracy Correlation Analysis Results High prior-knowledge group E A C N O Time watching video material (in min.) -0.08 -0.07 0.09 0.05 -0.01 Time solving quizes (in min.) -0.09 -0.10 0.10 0.04 -0.03 # Questions learners attempted to solve -0.13 -0.08 0.08 0.00 -0.03 # New forum questions -0.04 0.04 0.10 -0.03 0.03 # Forum replies -0.02 0.03 0.15 0.08 0.03 # Total forum postings -0.03 0.02 0.15 0.02 0.03 Forum browsing time -0.11 -0.04 0.02 -0.03 -0.06 Forum accesses -0.14 -0.06 0.03 -0.04 -0.04 # Forum interactions -0.02 0.02 0.15 0.03 0.03 Total time on-site -0.07 -0.07 0.11 0.04 -0.03 Average time responded to videos 0.05 -0.02 -0.01 0.06 0.03 Average time responded to quizs 0.03 -0.05 0 0.05 0.02 # Videos skipped 0.09 0.08 -0.09 -0.04 0.00 # Videos sped up 0.03 0.00 0.06 0.09 0.06 Maximum session time -0.04 -0.04 0.11 0.04 -0.04 Average session time 0.06 -0.05 0.03 0.06 -0.04 Standard deviation session time -0.03 -0.07 0.12 0.04 -0.04 Average between-quizzes time 0.00 -0.06 0.09 0.06 0.00 Standard deviation between-quizzes time -0.03 -0.07 0.09 0.07 0.00 Final score -0.12 -0.05 0.07 0.01 -0.01 Again, no signi鍖cant correlation between behavioural features and agreeableness and neuroticism can be observed. Overall, behavioural features extracted from MOOC log traces are less correlated with personality traits than lexical or behavioural features extracted from social media traces. Conscientious learners are likely to be active in forum discussion, while extraneous leaners not.
- 29. Prediction Accuracy Correlation Analysis Results Evaluation: Spearman rank correlation coef鍖cient
- 30. Prediction Accuracy Correlation Analysis Results Evaluation: Spearman rank correlation coef鍖cient Signi鍖cant correlations (indicating usable predictions) are achieved for 4 of the 5 personality traits.
- 31. Prediction Accuracy Correlation Analysis Results Evaluation: Spearman rank correlation coef鍖cient Signi鍖cant correlations (indicating usable predictions) are achieved for 4 of the 5 personality traits. The correlation coef鍖cients tend to increase with increasing course weeks.
- 32. Prediction Accuracy Correlation Analysis Results Evaluation: Spearman rank correlation coef鍖cient Signi鍖cant correlations (indicating usable predictions) are achieved for 4 of the 5 personality traits. The correlation coef鍖cients tend to increase with increasing course weeks. Extraversion and neuroticism achieve the highest prediction accuracy.
- 33. Summary
- 34. Summary 1 Various learning features are correlated with the personality traits of conscientiousness and openness.
- 35. Summary 1 Various learning features are correlated with the personality traits of conscientiousness and openness. The predictions are statistically signi鍖cant for 4 out of the 5 personality traits and improve as more data becomes available.2