ºÝºÝߣ

ºÝºÝߣShare a Scribd company logo
Identifying Warning Behaviors of Violent Lone
O?enders in Written Communication
1Amendra Shrestha
1 Lisa Kaati 2 Tony Sardella
1Uppsala University
2Washington University
December 12, 2016
Outline Introduction Countering VLOs Data Experiments Conclusion
1 Introduction
Example
Violent lone o?enders
2 Countering VLOs
VLOs
LIWC
3 Data
4 Experiments
5 Conclusion
- 1 -
Outline Introduction Countering VLOs Data Experiments Conclusion
Example
School shootings
https://everytownresearch.org/school-shootings/
- 2 -
Outline Introduction Countering VLOs Data Experiments Conclusion
Example
Lone actor terrorist attacks
- 3 -
Outline Introduction Countering VLOs Data Experiments Conclusion
Example
Mass murderers
- 4 -
Outline Introduction Countering VLOs Data Experiments Conclusion
Violent lone o?enders
Violent Lone O?enders (VLO)
? VLOs : school shooters, lone actor terrorists, mass murderers
? wide factors : social status, ideology, mental health,
personality type
? rare events
? pose a serious security threat to a society
? shows sign of psychological warning behaviours
? challenging to detect prior to an event
? challenge to identify, target and arrest
? common that they leave digital trace prior to attack
- 5 -
Outline Introduction Countering VLOs Data Experiments Conclusion
Violent lone o?enders
Mass murderer : Dylan Roof
? killed 9 persons in a church shooting in Charleston, South
Carolina
? published a manifesto on a website supporting white
supremacy
- 6 -
Outline Introduction Countering VLOs Data Experiments Conclusion
Violent lone o?enders
Lone actor terrorist: Anders Breivik
? killed 8 people by detonating a van bomb in Oslo
? shot dead 69 participants of a Workers¡¯ Youth League
? distributed a compendium of texts describing his militant
ideology
- 7 -
Outline Introduction Countering VLOs Data Experiments Conclusion
VLOs
Countering VLOs
? analyze and understanding potential signals in written
communication
? can be used to stop these attacks
? combine weak signals and gain informations about intentions
? weak signals
? signs of an individuals radical beliefs and extreme hate
? knowledge about how to produce homemade explosives
? interest in ?rearms and signs of rehearsal
? signs of warning behaviours from written text
- 8 -
Outline Introduction Countering VLOs Data Experiments Conclusion
VLOs
- 9 -
Investigate possibilities to identify potential
violent lone o?enders based on written
communication using machine learning
Outline Introduction Countering VLOs Data Experiments Conclusion
VLOs
- 10 -
? Electronic and written text
(manifestos, letters, blogs, etc.)
?
comparision
¡û?????¡ú
Pro?le of VLOs text Pro?le of non-VLOs users text
Outline Introduction Countering VLOs Data Experiments Conclusion
LIWC
LIWC
- 11 -
? Linguistic Inquiry and Word Count
? a computerized word counting tool
? counts words in psychologically meaningful categories
Outline Introduction Countering VLOs Data Experiments Conclusion
LIWC
- 12 -
Psychologist User
Outline Introduction Countering VLOs Data Experiments Conclusion
LIWC
- 13 -
Outline Introduction Countering VLOs Data Experiments Conclusion
LIWC
- 14 -
Outline Introduction Countering VLOs Data Experiments Conclusion
LIWC
- 15 -
Outline Introduction Countering VLOs Data Experiments Conclusion
LIWC
LIWC Categories
- 16 -
Outline Introduction Countering VLOs Data Experiments Conclusion
Data
- 17 -
Figure : Jose Reyes¡¯s Letters
Outline Introduction Countering VLOs Data Experiments Conclusion
Data
? VLOs
? manifesto, personal letter, suicide letter written by school
shooters, mass murderers and lone o?enders
? 32 violent lone o?enders : 46 documents
? Non-VLOs
? 54 blogs written about personal interests, news, fashion and
photography
? 108 stormfront users and their posts
? 108 boards.ie users and their posts
- 18 -
Outline Introduction Countering VLOs Data Experiments Conclusion
Experiment Setup
? Feature selection : Mahalanobis relevance estimate
? Synthetic Minority Over-sampling Technique (SMOTE)
? Leave-One-Out Cross-Validation (LOOCV)
? Adaboost
? Java and R
- 19 -
Outline Introduction Countering VLOs Data Experiments Conclusion
Experiment 1: Weak signals of warning behavior
? if it is possible to separate texts written by VLO
? combined lone o?enders into one set
? combined blogs, Stormfront and Boards.ie data into one set
? 11 important features used
? results :
? Accuracy : 0.8766
? Blogs + Forums : 254 out of 270 are correctly classi?ed
? VLO : 33 out of 46 are correctly classi?ed
- 20 -
Outline Introduction Countering VLOs Data Experiments Conclusion
Experiment 2: Bloggers
? possibility to identify lone o?enders from bloggers
? 12 important features used
? results : blog vs VLO
? Accuracy : 0.89
? Blogs : 50 out of 54 are correctly classi?ed
? VLO : 39 out of 46 are correctly classi?ed
- 21 -
Outline Introduction Countering VLOs Data Experiments Conclusion
Experiment 3: Stormfront users
? identify lone o?enders from Stormfront users
? 10 important features used
? results : Stormfront vs VLO
? Accuracy : 0.9026
? Forum : 100 out of 108 are correctly classi?ed
? LO : 33 out of 35 are correctly classi?ed
- 22 -
Outline Introduction Countering VLOs Data Experiments Conclusion
Experiment 4: Boards.ie users
? identify lone o?enders from boards.ie users
? 10 important features used
? results : boards.ie vs VLO
? Accuracy : 0.9221
? Forum : 100 out of 108 are correctly classi?ed
? LO : 42 out of 46 are correctly classi?ed
- 23 -
Outline Introduction Countering VLOs Data Experiments Conclusion
Conclusion
? machine learning can be use to identify texts written by
violent lone o?enders
? consider ethical issues
? aid for human analyst
- 24 -
Outline Introduction Countering VLOs Data Experiments Conclusion
- 25 -
Thank You

More Related Content

Identifying Warning Behaviors of Violent Lone Offenders in Written Communication

  • 1. Identifying Warning Behaviors of Violent Lone O?enders in Written Communication 1Amendra Shrestha 1 Lisa Kaati 2 Tony Sardella 1Uppsala University 2Washington University December 12, 2016
  • 2. Outline Introduction Countering VLOs Data Experiments Conclusion 1 Introduction Example Violent lone o?enders 2 Countering VLOs VLOs LIWC 3 Data 4 Experiments 5 Conclusion - 1 -
  • 3. Outline Introduction Countering VLOs Data Experiments Conclusion Example School shootings https://everytownresearch.org/school-shootings/ - 2 -
  • 4. Outline Introduction Countering VLOs Data Experiments Conclusion Example Lone actor terrorist attacks - 3 -
  • 5. Outline Introduction Countering VLOs Data Experiments Conclusion Example Mass murderers - 4 -
  • 6. Outline Introduction Countering VLOs Data Experiments Conclusion Violent lone o?enders Violent Lone O?enders (VLO) ? VLOs : school shooters, lone actor terrorists, mass murderers ? wide factors : social status, ideology, mental health, personality type ? rare events ? pose a serious security threat to a society ? shows sign of psychological warning behaviours ? challenging to detect prior to an event ? challenge to identify, target and arrest ? common that they leave digital trace prior to attack - 5 -
  • 7. Outline Introduction Countering VLOs Data Experiments Conclusion Violent lone o?enders Mass murderer : Dylan Roof ? killed 9 persons in a church shooting in Charleston, South Carolina ? published a manifesto on a website supporting white supremacy - 6 -
  • 8. Outline Introduction Countering VLOs Data Experiments Conclusion Violent lone o?enders Lone actor terrorist: Anders Breivik ? killed 8 people by detonating a van bomb in Oslo ? shot dead 69 participants of a Workers¡¯ Youth League ? distributed a compendium of texts describing his militant ideology - 7 -
  • 9. Outline Introduction Countering VLOs Data Experiments Conclusion VLOs Countering VLOs ? analyze and understanding potential signals in written communication ? can be used to stop these attacks ? combine weak signals and gain informations about intentions ? weak signals ? signs of an individuals radical beliefs and extreme hate ? knowledge about how to produce homemade explosives ? interest in ?rearms and signs of rehearsal ? signs of warning behaviours from written text - 8 -
  • 10. Outline Introduction Countering VLOs Data Experiments Conclusion VLOs - 9 - Investigate possibilities to identify potential violent lone o?enders based on written communication using machine learning
  • 11. Outline Introduction Countering VLOs Data Experiments Conclusion VLOs - 10 - ? Electronic and written text (manifestos, letters, blogs, etc.) ? comparision ¡û?????¡ú Pro?le of VLOs text Pro?le of non-VLOs users text
  • 12. Outline Introduction Countering VLOs Data Experiments Conclusion LIWC LIWC - 11 - ? Linguistic Inquiry and Word Count ? a computerized word counting tool ? counts words in psychologically meaningful categories
  • 13. Outline Introduction Countering VLOs Data Experiments Conclusion LIWC - 12 - Psychologist User
  • 14. Outline Introduction Countering VLOs Data Experiments Conclusion LIWC - 13 -
  • 15. Outline Introduction Countering VLOs Data Experiments Conclusion LIWC - 14 -
  • 16. Outline Introduction Countering VLOs Data Experiments Conclusion LIWC - 15 -
  • 17. Outline Introduction Countering VLOs Data Experiments Conclusion LIWC LIWC Categories - 16 -
  • 18. Outline Introduction Countering VLOs Data Experiments Conclusion Data - 17 - Figure : Jose Reyes¡¯s Letters
  • 19. Outline Introduction Countering VLOs Data Experiments Conclusion Data ? VLOs ? manifesto, personal letter, suicide letter written by school shooters, mass murderers and lone o?enders ? 32 violent lone o?enders : 46 documents ? Non-VLOs ? 54 blogs written about personal interests, news, fashion and photography ? 108 stormfront users and their posts ? 108 boards.ie users and their posts - 18 -
  • 20. Outline Introduction Countering VLOs Data Experiments Conclusion Experiment Setup ? Feature selection : Mahalanobis relevance estimate ? Synthetic Minority Over-sampling Technique (SMOTE) ? Leave-One-Out Cross-Validation (LOOCV) ? Adaboost ? Java and R - 19 -
  • 21. Outline Introduction Countering VLOs Data Experiments Conclusion Experiment 1: Weak signals of warning behavior ? if it is possible to separate texts written by VLO ? combined lone o?enders into one set ? combined blogs, Stormfront and Boards.ie data into one set ? 11 important features used ? results : ? Accuracy : 0.8766 ? Blogs + Forums : 254 out of 270 are correctly classi?ed ? VLO : 33 out of 46 are correctly classi?ed - 20 -
  • 22. Outline Introduction Countering VLOs Data Experiments Conclusion Experiment 2: Bloggers ? possibility to identify lone o?enders from bloggers ? 12 important features used ? results : blog vs VLO ? Accuracy : 0.89 ? Blogs : 50 out of 54 are correctly classi?ed ? VLO : 39 out of 46 are correctly classi?ed - 21 -
  • 23. Outline Introduction Countering VLOs Data Experiments Conclusion Experiment 3: Stormfront users ? identify lone o?enders from Stormfront users ? 10 important features used ? results : Stormfront vs VLO ? Accuracy : 0.9026 ? Forum : 100 out of 108 are correctly classi?ed ? LO : 33 out of 35 are correctly classi?ed - 22 -
  • 24. Outline Introduction Countering VLOs Data Experiments Conclusion Experiment 4: Boards.ie users ? identify lone o?enders from boards.ie users ? 10 important features used ? results : boards.ie vs VLO ? Accuracy : 0.9221 ? Forum : 100 out of 108 are correctly classi?ed ? LO : 42 out of 46 are correctly classi?ed - 23 -
  • 25. Outline Introduction Countering VLOs Data Experiments Conclusion Conclusion ? machine learning can be use to identify texts written by violent lone o?enders ? consider ethical issues ? aid for human analyst - 24 -
  • 26. Outline Introduction Countering VLOs Data Experiments Conclusion - 25 - Thank You