際際滷

際際滷Share a Scribd company logo
GESIS - Leibniz Institute for the Social Sciences
HypTrails: A Bayesian Approach for Comparing
Hypotheses about Human Trails on the Web
Philipp Singer, Denis Helic, Andreas Hotho
and Markus Strohmaier
www.philippsinger.info/hyptrails
Vannevar Bush
227.05.2015 HypTrails - Philipp Singer
image courtesy of brucesterling on Flickr
Bush, V. (1945). As we may think. The Atlantic
Monthly, 176(1):101 108. Bush, V. (1945).
As we may think. The Atlantic Monthly,
176(1):101 108.
[The human brain] operates by association.
With one item in its grasp, it snaps instantly to the
next that is suggested by the association of thoughts.
Human trails on the Web
27.05.2015 HypTrails - Philipp Singer 3
image courtesy of user Mmxx on Wikipedia
Human trails on the Web
27.05.2015 HypTrails - Philipp Singer 4
image courtesy of user Mmxx on Wikipedia
?
?
?
?
?
What are the mechanisms
producing human trails on
the Web?
Example: Human navigational trails
 Humans prefer to navigate 
 H1: over semantically similar websites
 H2: via self-loops (e.g., refreshing)
 H3: by using the structural link network
 H4: by preferring similar categories
 H5: by utilizing structural properties
 H6: by information scent
[West et al. IJCAI 2009], [Singer et al. IJSWIS 2013], [West & Leskovec WWW 2012], [Chi et al. CHI 2001]
27.05.2015 HypTrails - Philipp Singer 5
Example: Human navigational trails
 Humans prefer to navigate 
 H1: over semantically similar websites
 H2: via self-loops (e.g., refreshing)
 H3: by using the structural link network
 H4: by preferring similar categories
 H5: by utilizing structural properties
 H6: by information scent
[West et al. IJCAI 2009], [Singer et al. IJSWIS 2013], [West & Leskovec WWW 2012], [Chi et al. CHI 2001]
27.05.2015 HypTrails - Philipp Singer 6
What is the relative
plausibility of these
hypotheses given data?
HypTrails in a nutshell
 Goal: Express and compare hypotheses about human trails
in a coherent research approach
 Method:
 First-order Markov chain model
 Bayesian inference
 Idea:
 Incorporate hypotheses as priors
 Utilize sensitivity of marginal likelihood on the prior
 Outcome: Partial ordering of hypotheses
27.05.2015 HypTrails - Philipp Singer 7
Markov chain model
 Stochastic model
 Transition probabilities between states
27.05.2015 HypTrails - Philipp Singer 8
S1
S2 S3
1/2 1/2
1/3
2/3
1
Structure of HypTrails
27.05.2015 HypTrails - Philipp Singer 9
MC Model
How to express hypotheses?
27.05.2015 HypTrails - Philipp Singer 10
Structural hypothesis
27.05.2015 HypTrails - Philipp Singer 11
1/3
1
1/3
1
1/3
Uniform hypothesis
27.05.2015 HypTrails - Philipp Singer 12
1/3
Empirical observations
27.05.2015 HypTrails - Philipp Singer 13
1.0
2/3
1/3
1
Structure of HypTrails
27.05.2015 HypTrails - Philipp Singer 14
MC Model
Hypothesis
(H1)
Belief in parameters
Which hypothesis is
the most plausible one?
27.05.2015 HypTrails - Philipp Singer 15
Bayesian model comparison:
Marginal likelihood
27.05.2015 HypTrails - Philipp Singer 16
Probability of data given hypothesis
= Model evidence
Bayesian model comparison:
Marginal likelihood
27.05.2015 HypTrails - Philipp Singer 17
Probability of data given hypothesis
Model evidence
Parameters are marginalized out
Probability of observing data
given parameters and hypothesis
Bayesian model comparison:
Marginal likelihood
27.05.2015 HypTrails - Philipp Singer 18
Probability of data given hypothesis
Model evidence
Parameters are marginalized out
Probability of observing data
given parameters and hypothesis Probability of parameters
before observing data
Bayesian model comparison:
Marginal likelihood
27.05.2015 HypTrails - Philipp Singer 19
Probability of data given hypothesis
Model evidence
Parameters are marginalized out
Probability of observing data
given parameters and hypothesis Probability of parameters
before observing data
Hypothesis
Structure of HypTrails
27.05.2015 HypTrails - Philipp Singer 20
MC Model
Hypothesis
(H1)
Belief in parameters
Prior (H1)
Elicitation
Data (Trails)
Marginal
likelihood (H1)
Influence
Influence
How to elicit priors from hypotheses?
27.05.2015 HypTrails - Philipp Singer 21
Eliciting priors
 (Trial) roulette method
27.05.2015 HypTrails - Philipp Singer 22
 (Trial) roulette method
Eliciting priors
27.05.2015 HypTrails - Philipp Singer 23
 (Trial) roulette method
Prior distribution
Eliciting priors
27.05.2015 HypTrails - Philipp Singer 24
Conjugate Dirichlet prior
 Hyperparameters  pseudo counts
27.05.2015 HypTrails - Philipp Singer 25
MC parameters Dirichlet hyperparameters
Eliciting priors from hypotheses
about human trails
 Adaption of (trial) roulette method
27.05.2015 HypTrails - Philipp Singer 26
#Chips = 硫
Strength of hypothesis
硫 = 18
Eliciting priors from hypotheses
about human trails
 Adaption of (trial) roulette method
27.05.2015 HypTrails - Philipp Singer 27
#Chips = 硫
Strength of hypothesis
硫 = 18
 Dirichlet hyperparameters
Example: Structural hypothesis
27.05.2015 HypTrails - Philipp Singer 28
1/3
1
1/3
1
1/3
Example: Structural hypothesis
27.05.2015 HypTrails - Philipp Singer 29
速i
1
2
3 速j
1
2
3
nr.ofchips
1
2
3
0.00 0.33 0.00 h3
1.00 0.33 1.00 h2
0.00 0.33 0.00 h1
h3 h2 h1
速i
1
2
3 速j
1
2
3
nr.ofchips
1
2
3
0.00 0.99 0.00 h3
3.01 0.99 3.01 h2
0.00 0.99 0.00 h1
h3 h2 h1
速i
1
2
3 速j
1
2
3
nr.ofchips
1
2
3
0.00 0.99 0.00 h3
0.01 0.99 0.01 h2
0.00 0.99 0.00 h1
h3 h2 h1
Input
Hypothesis
Output
Dirichlet prior
Example: Structural hypothesis
27.05.2015 HypTrails - Philipp Singer 30
速i
1
2
3 速j
1
2
3
nr.ofchips
1
2
3
0.00 0.33 0.00 h3
1.00 0.33 1.00 h2
0.00 0.33 0.00 h1
h3 h2 h1
速i
1
2
3 速j
1
2
3
nr.ofchips
1
2
3
0.00 0.99 0.00 h3
3.01 0.99 3.01 h2
0.00 0.99 0.00 h1
h3 h2 h1
速i
1
2
3 速j
1
2
3
nr.ofchips
1
2
3
0.00 0.99 0.00 h3
0.01 0.99 0.01 h2
0.00 0.99 0.00 h1
h3 h2 h1
Example: Structural hypothesis
27.05.2015 HypTrails - Philipp Singer 31
速i
1
2
3 速j
1
2
3
nr.ofchips
1
2
3
0.00 0.33 0.00 h3
1.00 0.33 1.00 h2
0.00 0.33 0.00 h1
h3 h2 h1
速i
1
2
3 速j
1
2
3
nr.ofchips
1
2
3
0.00 0.99 0.00 h3
3.01 0.99 3.01 h2
0.00 0.99 0.00 h1
h3 h2 h1
速i
1
2
3 速j
1
2
3
nr.ofchips
1
2
3
0.00 0.99 0.00 h3
0.01 0.99 0.01 h2
0.00 0.99 0.00 h1
h3 h2 h1
Example: Structural hypothesis
27.05.2015 HypTrails - Philipp Singer 32
速i
1
2
3 速j
1
2
3
nr.ofchips
1
2
3
0.00 0.33 0.00 h3
1.00 0.33 1.00 h2
0.00 0.33 0.00 h1
h3 h2 h1
速i
1
2
3 速j
1
2
3
nr.ofchips
1
2
3
0.00 0.99 0.00 h3
3.01 0.99 3.01 h2
0.00 0.99 0.00 h1
h3 h2 h1
速i
1
2
3 速j
1
2
3
nr.ofchips
1
2
3
0.00 0.99 0.00 h3
0.01 0.99 0.01 h2
0.00 0.99 0.00 h1
h3 h2 h1
Structure of HypTrails
27.05.2015 HypTrails - Philipp Singer 33
MC Model
Hypothesis
(H1)
Prior (H1)
Data (Trails)
Marginal
likelihood (H1)
Hypothesis
(H2)
Prior (H2)
Marginal
likelihood (H2)
Compare
Demonstration of general applicability
 Synthetic data
 Human song trails (Last.fm)
 Human review trails (Yelp)
 Human navigation trails (Wikigame)
27.05.2015 HypTrails - Philipp Singer 34
Wikigame
27.05.2015 HypTrails - Philipp Singer 35
0 1 2 3 4
hypothesis weighting factor k
1.40
1.35
1.30
1.25
1.20
1.15
1.10
1.05
1.00
0.95
evidence
1e8
uniform
self-loop
structural
similarity
Higher
plausibility
Higher belief
(more chips)
Wikigame
27.05.2015 HypTrails - Philipp Singer 36
0 1 2 3 4
hypothesis weighting factor k
1.40
1.35
1.30
1.25
1.20
1.15
1.10
1.05
1.00
0.95
evidence
1e8
uniform
self-loop
structural
similarity
Summary
 Studying mechanisms producing human trails
 HypTrails: A coherent approach for expressing and
comparing hypotheses about human trails
 Can be applied to all kinds of human trails
 Implementations: www.philippsinger.info/hyptrails
27.05.2015 HypTrails - Philipp Singer 37
GESIS - Leibniz Institute for the Social Sciences
for your attention!
@ph_singer
www.philippsinger.info
T
H
A
N
K
S
www.philippsinger.info/hyptrails
References 1/2
 [West et al. WWW 2015]
 Robert West, Ashwin Paranjape, and Jure Leskovec: Mining Missing Hyperlinks from Human
Navigation Traces: A Case Study of Wikipedia. 24th International World Wide Web Conference
(WWW'15), Florence, Italy, 2015.
 [De Choudhury et al. HT 2010]
 De Choudhury, Munmun and Feldman, Moran and Amer-Yahia, Sihem and Golbandi, Nadav and
Lempel, Ronny and Yu, Cong: Automatic construction of travel itineraries using social breadcrumbs.
21st ACM conference on Hypertext and hypermedia, 2010.
 [Bestavros CIKM 1995]
 Bestavros, Azer: Using speculation to reduce server load and service time on the WWW. 4th International conference
on Information and knowledge management. 1995.
 [Perkowitz IJCAI 1997]
 Perkowitz, Mike, and Oren Etzioni: Adaptive web sites: an AI challenge. 15th international joint
conference on Artifical intelligence. 1997.
 [West et al. IJCAI 2009]
 West, Robert, Joelle Pineau, and Doina Precup. "Wikispeedia: An Online Game for Inferring Semantic
Distances between Concepts." IJCAI. 2009.
27.05.2015 HypTrails - Philipp Singer 39
References 2/2
 [Singer et al. IJSWIS 2013]
 Philipp Singer, Thomas Niebler, Markus Strohmaier and Andreas Hotho, Computing Semantic
Relatedness from Human Navigational Paths: A Case Study on Wikipedia, International Journal on
Semantic Web and Information Systems (IJSWIS), vol 9(4), 41-70, 2013
 [West & Leskovec WWW 2012]
 Robert West and Jure Leskovec: Human Wayfinding in Information Networks 21st International
World Wide Web Conference (WWW'12), pp. 619628, Lyon, France, 2012.
 [Chi et al. CHI 2001]
 Chi, Ed H., et al. "Using information scent to model user information needs and actions and the
Web." Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 2001.
27.05.2015 HypTrails - Philipp Singer 40

More Related Content

Similar to HypTrails: A Bayesian Approach for Comparing Hypotheses about Human Trails on the Web (20)

Artificial Intelligence for the Film Industry
Artificial Intelligence for the Film IndustryArtificial Intelligence for the Film Industry
Artificial Intelligence for the Film Industry
Georg Rehm
Machine Learning with and for Semantic Web Knowledge Graphs
Machine Learning with and for Semantic Web Knowledge GraphsMachine Learning with and for Semantic Web Knowledge Graphs
Machine Learning with and for Semantic Web Knowledge Graphs
Heiko Paulheim
Stable_Diffusion_Diagrams_Version_2.pptx
Stable_Diffusion_Diagrams_Version_2.pptxStable_Diffusion_Diagrams_Version_2.pptx
Stable_Diffusion_Diagrams_Version_2.pptx
Dr. Yasir Butt
Stable_Diffusion_Codding_Diagrams_V2.pdf
Stable_Diffusion_Codding_Diagrams_V2.pdfStable_Diffusion_Codding_Diagrams_V2.pdf
Stable_Diffusion_Codding_Diagrams_V2.pdf
Dr. Yasir Butt
Showcasing research data tools
Showcasing research data toolsShowcasing research data tools
Showcasing research data tools
Jisc RDM
Research as Hypermedia Narrative
Research as Hypermedia NarrativeResearch as Hypermedia Narrative
Research as Hypermedia Narrative
Simon Buckingham Shum
Mining the Social Web - Lecture 1 - T61.6020 lecture-01-slides
Mining the Social Web - Lecture 1 - T61.6020 lecture-01-slidesMining the Social Web - Lecture 1 - T61.6020 lecture-01-slides
Mining the Social Web - Lecture 1 - T61.6020 lecture-01-slides
Michael Mathioudakis
Eduworks kick-off presentation: USAL
Eduworks kick-off presentation: USALEduworks kick-off presentation: USAL
Eduworks kick-off presentation: USAL
Eduworks Network
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
recsysfr
The Relevance of Algorithms
The Relevance of AlgorithmsThe Relevance of Algorithms
The Relevance of Algorithms
Julian Ausserhofer
Ethics in Technology
Ethics in TechnologyEthics in Technology
Ethics in Technology
RIPE NCC
Collective Intelligence Meets the Political Agenda
Collective Intelligence Meets the Political AgendaCollective Intelligence Meets the Political Agenda
Collective Intelligence Meets the Political Agenda
EDV Project
A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...
A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...
A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...
Lauri Eloranta
Thesis Presentation 12/08/2014
Thesis Presentation 12/08/2014Thesis Presentation 12/08/2014
Thesis Presentation 12/08/2014
thomasdemoor
Clipper British Library London slides
Clipper British Library London slidesClipper British Library London slides
Clipper British Library London slides
John Casey
191008 kafka meetup_liebig
191008 kafka meetup_liebig191008 kafka meetup_liebig
191008 kafka meetup_liebig
Thomas Liebig
Big data analytics and building intelligent applications
Big data analytics and building intelligent applicationsBig data analytics and building intelligent applications
Big data analytics and building intelligent applications
Flytxt
Distributed and heterogeneous data analysis for smart urban planning
Distributed and heterogeneous data analysis for smart urban planningDistributed and heterogeneous data analysis for smart urban planning
Distributed and heterogeneous data analysis for smart urban planning
Eduardo Oliveira
Using social media to promote your research
Using social media to promote your research Using social media to promote your research
Using social media to promote your research
Private
InfoVis1415: slides sessie 1, 10 Feb 2015
InfoVis1415: slides sessie 1, 10 Feb 2015InfoVis1415: slides sessie 1, 10 Feb 2015
InfoVis1415: slides sessie 1, 10 Feb 2015
Erik Duval
Artificial Intelligence for the Film Industry
Artificial Intelligence for the Film IndustryArtificial Intelligence for the Film Industry
Artificial Intelligence for the Film Industry
Georg Rehm
Machine Learning with and for Semantic Web Knowledge Graphs
Machine Learning with and for Semantic Web Knowledge GraphsMachine Learning with and for Semantic Web Knowledge Graphs
Machine Learning with and for Semantic Web Knowledge Graphs
Heiko Paulheim
Stable_Diffusion_Diagrams_Version_2.pptx
Stable_Diffusion_Diagrams_Version_2.pptxStable_Diffusion_Diagrams_Version_2.pptx
Stable_Diffusion_Diagrams_Version_2.pptx
Dr. Yasir Butt
Stable_Diffusion_Codding_Diagrams_V2.pdf
Stable_Diffusion_Codding_Diagrams_V2.pdfStable_Diffusion_Codding_Diagrams_V2.pdf
Stable_Diffusion_Codding_Diagrams_V2.pdf
Dr. Yasir Butt
Showcasing research data tools
Showcasing research data toolsShowcasing research data tools
Showcasing research data tools
Jisc RDM
Mining the Social Web - Lecture 1 - T61.6020 lecture-01-slides
Mining the Social Web - Lecture 1 - T61.6020 lecture-01-slidesMining the Social Web - Lecture 1 - T61.6020 lecture-01-slides
Mining the Social Web - Lecture 1 - T61.6020 lecture-01-slides
Michael Mathioudakis
Eduworks kick-off presentation: USAL
Eduworks kick-off presentation: USALEduworks kick-off presentation: USAL
Eduworks kick-off presentation: USAL
Eduworks Network
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
recsysfr
The Relevance of Algorithms
The Relevance of AlgorithmsThe Relevance of Algorithms
The Relevance of Algorithms
Julian Ausserhofer
Ethics in Technology
Ethics in TechnologyEthics in Technology
Ethics in Technology
RIPE NCC
Collective Intelligence Meets the Political Agenda
Collective Intelligence Meets the Political AgendaCollective Intelligence Meets the Political Agenda
Collective Intelligence Meets the Political Agenda
EDV Project
A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...
A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...
A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...
Lauri Eloranta
Thesis Presentation 12/08/2014
Thesis Presentation 12/08/2014Thesis Presentation 12/08/2014
Thesis Presentation 12/08/2014
thomasdemoor
Clipper British Library London slides
Clipper British Library London slidesClipper British Library London slides
Clipper British Library London slides
John Casey
191008 kafka meetup_liebig
191008 kafka meetup_liebig191008 kafka meetup_liebig
191008 kafka meetup_liebig
Thomas Liebig
Big data analytics and building intelligent applications
Big data analytics and building intelligent applicationsBig data analytics and building intelligent applications
Big data analytics and building intelligent applications
Flytxt
Distributed and heterogeneous data analysis for smart urban planning
Distributed and heterogeneous data analysis for smart urban planningDistributed and heterogeneous data analysis for smart urban planning
Distributed and heterogeneous data analysis for smart urban planning
Eduardo Oliveira
Using social media to promote your research
Using social media to promote your research Using social media to promote your research
Using social media to promote your research
Private
InfoVis1415: slides sessie 1, 10 Feb 2015
InfoVis1415: slides sessie 1, 10 Feb 2015InfoVis1415: slides sessie 1, 10 Feb 2015
InfoVis1415: slides sessie 1, 10 Feb 2015
Erik Duval

Recently uploaded (20)

Direct Gene Transfer Techniques for Developing Transgenic Plants
Direct Gene Transfer Techniques for Developing Transgenic PlantsDirect Gene Transfer Techniques for Developing Transgenic Plants
Direct Gene Transfer Techniques for Developing Transgenic Plants
Kuldeep Gauliya
ARepeatingFastRadioBurstSourceinaLow-luminosityDwarfGalaxy
ARepeatingFastRadioBurstSourceinaLow-luminosityDwarfGalaxyARepeatingFastRadioBurstSourceinaLow-luminosityDwarfGalaxy
ARepeatingFastRadioBurstSourceinaLow-luminosityDwarfGalaxy
S辿rgio Sacani
(Journal Club) - Sci-fate Characterizes the Dynamics of Gene Expression in Si...
(Journal Club) - Sci-fate Characterizes the Dynamics of Gene Expression in Si...(Journal Club) - Sci-fate Characterizes the Dynamics of Gene Expression in Si...
(Journal Club) - Sci-fate Characterizes the Dynamics of Gene Expression in Si...
David Podorefsky, PhD
The Solar Systems passage through the Radcliffe wave during the middle Miocene
The Solar Systems passage through the Radcliffe wave during the middle MioceneThe Solar Systems passage through the Radcliffe wave during the middle Miocene
The Solar Systems passage through the Radcliffe wave during the middle Miocene
S辿rgio Sacani
The Arctic through the lens of data visualization
The Arctic through the lens of data visualizationThe Arctic through the lens of data visualization
The Arctic through the lens of data visualization
Zachary Labe
(Journal Club) - Transgenic mice for in vivo epigenome editing with CRISPR-ba...
(Journal Club) - Transgenic mice for in vivo epigenome editing with CRISPR-ba...(Journal Club) - Transgenic mice for in vivo epigenome editing with CRISPR-ba...
(Journal Club) - Transgenic mice for in vivo epigenome editing with CRISPR-ba...
David Podorefsky, PhD
(Journal Club) - AmpliconReconstructor integrates NGS and optical mapping to ...
(Journal Club) - AmpliconReconstructor integrates NGS and optical mapping to ...(Journal Club) - AmpliconReconstructor integrates NGS and optical mapping to ...
(Journal Club) - AmpliconReconstructor integrates NGS and optical mapping to ...
David Podorefsky, PhD
Variation and Natural Selection | IGCSE Biology
Variation and Natural Selection | IGCSE BiologyVariation and Natural Selection | IGCSE Biology
Variation and Natural Selection | IGCSE Biology
Blessing Ndazie
(February 25th, 2025) Real-Time Insights into Cardiothoracic Research with In...
(February 25th, 2025) Real-Time Insights into Cardiothoracic Research with In...(February 25th, 2025) Real-Time Insights into Cardiothoracic Research with In...
(February 25th, 2025) Real-Time Insights into Cardiothoracic Research with In...
Scintica Instrumentation
Energ and Energy Forms, Work, and Power | IGCSE Physics
Energ and Energy Forms, Work, and Power | IGCSE PhysicsEnerg and Energy Forms, Work, and Power | IGCSE Physics
Energ and Energy Forms, Work, and Power | IGCSE Physics
Blessing Ndazie
The Sense Organs: Structure and Function of the Eye and Skin | IGCSE Biology
The Sense Organs: Structure and Function of the Eye and Skin | IGCSE BiologyThe Sense Organs: Structure and Function of the Eye and Skin | IGCSE Biology
The Sense Organs: Structure and Function of the Eye and Skin | IGCSE Biology
Blessing Ndazie
Cell Structure & Function | Cambridge IGCSE Biology
Cell Structure & Function | Cambridge IGCSE BiologyCell Structure & Function | Cambridge IGCSE Biology
Cell Structure & Function | Cambridge IGCSE Biology
Blessing Ndazie
(Journal Club) Folding DNA to create nanoscale shapes and patterns
(Journal Club) Folding DNA to create nanoscale shapes and patterns(Journal Club) Folding DNA to create nanoscale shapes and patterns
(Journal Club) Folding DNA to create nanoscale shapes and patterns
David Podorefsky, PhD
The Novel Drug Delivery System darade mam.pptx
The Novel Drug Delivery System darade mam.pptxThe Novel Drug Delivery System darade mam.pptx
The Novel Drug Delivery System darade mam.pptx
J.k college of Pharmacy, hingoli
Telescope equatorial mount polar alignment quick reference guide
Telescope equatorial mount polar alignment quick reference guideTelescope equatorial mount polar alignment quick reference guide
Telescope equatorial mount polar alignment quick reference guide
bartf25
Detection of ferrihydrite in Martian red dust records ancient cold and wet co...
Detection of ferrihydrite in Martian red dust records ancient cold and wet co...Detection of ferrihydrite in Martian red dust records ancient cold and wet co...
Detection of ferrihydrite in Martian red dust records ancient cold and wet co...
S辿rgio Sacani
Simple Phenomena of Magnetism | IGCSE Physics
Simple Phenomena of Magnetism | IGCSE PhysicsSimple Phenomena of Magnetism | IGCSE Physics
Simple Phenomena of Magnetism | IGCSE Physics
Blessing Ndazie
(Chapter Summary) Molecular Biology of the Cell, Chapter 18: Cell Death
(Chapter Summary) Molecular Biology of the Cell, Chapter 18: Cell Death(Chapter Summary) Molecular Biology of the Cell, Chapter 18: Cell Death
(Chapter Summary) Molecular Biology of the Cell, Chapter 18: Cell Death
David Podorefsky, PhD
Excretion in Humans | Cambridge IGCSE Biology
Excretion in Humans | Cambridge IGCSE BiologyExcretion in Humans | Cambridge IGCSE Biology
Excretion in Humans | Cambridge IGCSE Biology
Blessing Ndazie
Investigational New drug application process
Investigational New drug application processInvestigational New drug application process
Investigational New drug application process
onepalyer4
Direct Gene Transfer Techniques for Developing Transgenic Plants
Direct Gene Transfer Techniques for Developing Transgenic PlantsDirect Gene Transfer Techniques for Developing Transgenic Plants
Direct Gene Transfer Techniques for Developing Transgenic Plants
Kuldeep Gauliya
ARepeatingFastRadioBurstSourceinaLow-luminosityDwarfGalaxy
ARepeatingFastRadioBurstSourceinaLow-luminosityDwarfGalaxyARepeatingFastRadioBurstSourceinaLow-luminosityDwarfGalaxy
ARepeatingFastRadioBurstSourceinaLow-luminosityDwarfGalaxy
S辿rgio Sacani
(Journal Club) - Sci-fate Characterizes the Dynamics of Gene Expression in Si...
(Journal Club) - Sci-fate Characterizes the Dynamics of Gene Expression in Si...(Journal Club) - Sci-fate Characterizes the Dynamics of Gene Expression in Si...
(Journal Club) - Sci-fate Characterizes the Dynamics of Gene Expression in Si...
David Podorefsky, PhD
The Solar Systems passage through the Radcliffe wave during the middle Miocene
The Solar Systems passage through the Radcliffe wave during the middle MioceneThe Solar Systems passage through the Radcliffe wave during the middle Miocene
The Solar Systems passage through the Radcliffe wave during the middle Miocene
S辿rgio Sacani
The Arctic through the lens of data visualization
The Arctic through the lens of data visualizationThe Arctic through the lens of data visualization
The Arctic through the lens of data visualization
Zachary Labe
(Journal Club) - Transgenic mice for in vivo epigenome editing with CRISPR-ba...
(Journal Club) - Transgenic mice for in vivo epigenome editing with CRISPR-ba...(Journal Club) - Transgenic mice for in vivo epigenome editing with CRISPR-ba...
(Journal Club) - Transgenic mice for in vivo epigenome editing with CRISPR-ba...
David Podorefsky, PhD
(Journal Club) - AmpliconReconstructor integrates NGS and optical mapping to ...
(Journal Club) - AmpliconReconstructor integrates NGS and optical mapping to ...(Journal Club) - AmpliconReconstructor integrates NGS and optical mapping to ...
(Journal Club) - AmpliconReconstructor integrates NGS and optical mapping to ...
David Podorefsky, PhD
Variation and Natural Selection | IGCSE Biology
Variation and Natural Selection | IGCSE BiologyVariation and Natural Selection | IGCSE Biology
Variation and Natural Selection | IGCSE Biology
Blessing Ndazie
(February 25th, 2025) Real-Time Insights into Cardiothoracic Research with In...
(February 25th, 2025) Real-Time Insights into Cardiothoracic Research with In...(February 25th, 2025) Real-Time Insights into Cardiothoracic Research with In...
(February 25th, 2025) Real-Time Insights into Cardiothoracic Research with In...
Scintica Instrumentation
Energ and Energy Forms, Work, and Power | IGCSE Physics
Energ and Energy Forms, Work, and Power | IGCSE PhysicsEnerg and Energy Forms, Work, and Power | IGCSE Physics
Energ and Energy Forms, Work, and Power | IGCSE Physics
Blessing Ndazie
The Sense Organs: Structure and Function of the Eye and Skin | IGCSE Biology
The Sense Organs: Structure and Function of the Eye and Skin | IGCSE BiologyThe Sense Organs: Structure and Function of the Eye and Skin | IGCSE Biology
The Sense Organs: Structure and Function of the Eye and Skin | IGCSE Biology
Blessing Ndazie
Cell Structure & Function | Cambridge IGCSE Biology
Cell Structure & Function | Cambridge IGCSE BiologyCell Structure & Function | Cambridge IGCSE Biology
Cell Structure & Function | Cambridge IGCSE Biology
Blessing Ndazie
(Journal Club) Folding DNA to create nanoscale shapes and patterns
(Journal Club) Folding DNA to create nanoscale shapes and patterns(Journal Club) Folding DNA to create nanoscale shapes and patterns
(Journal Club) Folding DNA to create nanoscale shapes and patterns
David Podorefsky, PhD
Telescope equatorial mount polar alignment quick reference guide
Telescope equatorial mount polar alignment quick reference guideTelescope equatorial mount polar alignment quick reference guide
Telescope equatorial mount polar alignment quick reference guide
bartf25
Detection of ferrihydrite in Martian red dust records ancient cold and wet co...
Detection of ferrihydrite in Martian red dust records ancient cold and wet co...Detection of ferrihydrite in Martian red dust records ancient cold and wet co...
Detection of ferrihydrite in Martian red dust records ancient cold and wet co...
S辿rgio Sacani
Simple Phenomena of Magnetism | IGCSE Physics
Simple Phenomena of Magnetism | IGCSE PhysicsSimple Phenomena of Magnetism | IGCSE Physics
Simple Phenomena of Magnetism | IGCSE Physics
Blessing Ndazie
(Chapter Summary) Molecular Biology of the Cell, Chapter 18: Cell Death
(Chapter Summary) Molecular Biology of the Cell, Chapter 18: Cell Death(Chapter Summary) Molecular Biology of the Cell, Chapter 18: Cell Death
(Chapter Summary) Molecular Biology of the Cell, Chapter 18: Cell Death
David Podorefsky, PhD
Excretion in Humans | Cambridge IGCSE Biology
Excretion in Humans | Cambridge IGCSE BiologyExcretion in Humans | Cambridge IGCSE Biology
Excretion in Humans | Cambridge IGCSE Biology
Blessing Ndazie
Investigational New drug application process
Investigational New drug application processInvestigational New drug application process
Investigational New drug application process
onepalyer4

HypTrails: A Bayesian Approach for Comparing Hypotheses about Human Trails on the Web

  • 1. GESIS - Leibniz Institute for the Social Sciences HypTrails: A Bayesian Approach for Comparing Hypotheses about Human Trails on the Web Philipp Singer, Denis Helic, Andreas Hotho and Markus Strohmaier www.philippsinger.info/hyptrails
  • 2. Vannevar Bush 227.05.2015 HypTrails - Philipp Singer image courtesy of brucesterling on Flickr Bush, V. (1945). As we may think. The Atlantic Monthly, 176(1):101 108. Bush, V. (1945). As we may think. The Atlantic Monthly, 176(1):101 108. [The human brain] operates by association. With one item in its grasp, it snaps instantly to the next that is suggested by the association of thoughts.
  • 3. Human trails on the Web 27.05.2015 HypTrails - Philipp Singer 3 image courtesy of user Mmxx on Wikipedia
  • 4. Human trails on the Web 27.05.2015 HypTrails - Philipp Singer 4 image courtesy of user Mmxx on Wikipedia ? ? ? ? ? What are the mechanisms producing human trails on the Web?
  • 5. Example: Human navigational trails Humans prefer to navigate H1: over semantically similar websites H2: via self-loops (e.g., refreshing) H3: by using the structural link network H4: by preferring similar categories H5: by utilizing structural properties H6: by information scent [West et al. IJCAI 2009], [Singer et al. IJSWIS 2013], [West & Leskovec WWW 2012], [Chi et al. CHI 2001] 27.05.2015 HypTrails - Philipp Singer 5
  • 6. Example: Human navigational trails Humans prefer to navigate H1: over semantically similar websites H2: via self-loops (e.g., refreshing) H3: by using the structural link network H4: by preferring similar categories H5: by utilizing structural properties H6: by information scent [West et al. IJCAI 2009], [Singer et al. IJSWIS 2013], [West & Leskovec WWW 2012], [Chi et al. CHI 2001] 27.05.2015 HypTrails - Philipp Singer 6 What is the relative plausibility of these hypotheses given data?
  • 7. HypTrails in a nutshell Goal: Express and compare hypotheses about human trails in a coherent research approach Method: First-order Markov chain model Bayesian inference Idea: Incorporate hypotheses as priors Utilize sensitivity of marginal likelihood on the prior Outcome: Partial ordering of hypotheses 27.05.2015 HypTrails - Philipp Singer 7
  • 8. Markov chain model Stochastic model Transition probabilities between states 27.05.2015 HypTrails - Philipp Singer 8 S1 S2 S3 1/2 1/2 1/3 2/3 1
  • 9. Structure of HypTrails 27.05.2015 HypTrails - Philipp Singer 9 MC Model
  • 10. How to express hypotheses? 27.05.2015 HypTrails - Philipp Singer 10
  • 11. Structural hypothesis 27.05.2015 HypTrails - Philipp Singer 11 1/3 1 1/3 1 1/3
  • 12. Uniform hypothesis 27.05.2015 HypTrails - Philipp Singer 12 1/3
  • 13. Empirical observations 27.05.2015 HypTrails - Philipp Singer 13 1.0 2/3 1/3 1
  • 14. Structure of HypTrails 27.05.2015 HypTrails - Philipp Singer 14 MC Model Hypothesis (H1) Belief in parameters
  • 15. Which hypothesis is the most plausible one? 27.05.2015 HypTrails - Philipp Singer 15
  • 16. Bayesian model comparison: Marginal likelihood 27.05.2015 HypTrails - Philipp Singer 16 Probability of data given hypothesis = Model evidence
  • 17. Bayesian model comparison: Marginal likelihood 27.05.2015 HypTrails - Philipp Singer 17 Probability of data given hypothesis Model evidence Parameters are marginalized out Probability of observing data given parameters and hypothesis
  • 18. Bayesian model comparison: Marginal likelihood 27.05.2015 HypTrails - Philipp Singer 18 Probability of data given hypothesis Model evidence Parameters are marginalized out Probability of observing data given parameters and hypothesis Probability of parameters before observing data
  • 19. Bayesian model comparison: Marginal likelihood 27.05.2015 HypTrails - Philipp Singer 19 Probability of data given hypothesis Model evidence Parameters are marginalized out Probability of observing data given parameters and hypothesis Probability of parameters before observing data Hypothesis
  • 20. Structure of HypTrails 27.05.2015 HypTrails - Philipp Singer 20 MC Model Hypothesis (H1) Belief in parameters Prior (H1) Elicitation Data (Trails) Marginal likelihood (H1) Influence Influence
  • 21. How to elicit priors from hypotheses? 27.05.2015 HypTrails - Philipp Singer 21
  • 22. Eliciting priors (Trial) roulette method 27.05.2015 HypTrails - Philipp Singer 22
  • 23. (Trial) roulette method Eliciting priors 27.05.2015 HypTrails - Philipp Singer 23
  • 24. (Trial) roulette method Prior distribution Eliciting priors 27.05.2015 HypTrails - Philipp Singer 24
  • 25. Conjugate Dirichlet prior Hyperparameters pseudo counts 27.05.2015 HypTrails - Philipp Singer 25 MC parameters Dirichlet hyperparameters
  • 26. Eliciting priors from hypotheses about human trails Adaption of (trial) roulette method 27.05.2015 HypTrails - Philipp Singer 26 #Chips = 硫 Strength of hypothesis 硫 = 18
  • 27. Eliciting priors from hypotheses about human trails Adaption of (trial) roulette method 27.05.2015 HypTrails - Philipp Singer 27 #Chips = 硫 Strength of hypothesis 硫 = 18 Dirichlet hyperparameters
  • 28. Example: Structural hypothesis 27.05.2015 HypTrails - Philipp Singer 28 1/3 1 1/3 1 1/3
  • 29. Example: Structural hypothesis 27.05.2015 HypTrails - Philipp Singer 29 速i 1 2 3 速j 1 2 3 nr.ofchips 1 2 3 0.00 0.33 0.00 h3 1.00 0.33 1.00 h2 0.00 0.33 0.00 h1 h3 h2 h1 速i 1 2 3 速j 1 2 3 nr.ofchips 1 2 3 0.00 0.99 0.00 h3 3.01 0.99 3.01 h2 0.00 0.99 0.00 h1 h3 h2 h1 速i 1 2 3 速j 1 2 3 nr.ofchips 1 2 3 0.00 0.99 0.00 h3 0.01 0.99 0.01 h2 0.00 0.99 0.00 h1 h3 h2 h1 Input Hypothesis Output Dirichlet prior
  • 30. Example: Structural hypothesis 27.05.2015 HypTrails - Philipp Singer 30 速i 1 2 3 速j 1 2 3 nr.ofchips 1 2 3 0.00 0.33 0.00 h3 1.00 0.33 1.00 h2 0.00 0.33 0.00 h1 h3 h2 h1 速i 1 2 3 速j 1 2 3 nr.ofchips 1 2 3 0.00 0.99 0.00 h3 3.01 0.99 3.01 h2 0.00 0.99 0.00 h1 h3 h2 h1 速i 1 2 3 速j 1 2 3 nr.ofchips 1 2 3 0.00 0.99 0.00 h3 0.01 0.99 0.01 h2 0.00 0.99 0.00 h1 h3 h2 h1
  • 31. Example: Structural hypothesis 27.05.2015 HypTrails - Philipp Singer 31 速i 1 2 3 速j 1 2 3 nr.ofchips 1 2 3 0.00 0.33 0.00 h3 1.00 0.33 1.00 h2 0.00 0.33 0.00 h1 h3 h2 h1 速i 1 2 3 速j 1 2 3 nr.ofchips 1 2 3 0.00 0.99 0.00 h3 3.01 0.99 3.01 h2 0.00 0.99 0.00 h1 h3 h2 h1 速i 1 2 3 速j 1 2 3 nr.ofchips 1 2 3 0.00 0.99 0.00 h3 0.01 0.99 0.01 h2 0.00 0.99 0.00 h1 h3 h2 h1
  • 32. Example: Structural hypothesis 27.05.2015 HypTrails - Philipp Singer 32 速i 1 2 3 速j 1 2 3 nr.ofchips 1 2 3 0.00 0.33 0.00 h3 1.00 0.33 1.00 h2 0.00 0.33 0.00 h1 h3 h2 h1 速i 1 2 3 速j 1 2 3 nr.ofchips 1 2 3 0.00 0.99 0.00 h3 3.01 0.99 3.01 h2 0.00 0.99 0.00 h1 h3 h2 h1 速i 1 2 3 速j 1 2 3 nr.ofchips 1 2 3 0.00 0.99 0.00 h3 0.01 0.99 0.01 h2 0.00 0.99 0.00 h1 h3 h2 h1
  • 33. Structure of HypTrails 27.05.2015 HypTrails - Philipp Singer 33 MC Model Hypothesis (H1) Prior (H1) Data (Trails) Marginal likelihood (H1) Hypothesis (H2) Prior (H2) Marginal likelihood (H2) Compare
  • 34. Demonstration of general applicability Synthetic data Human song trails (Last.fm) Human review trails (Yelp) Human navigation trails (Wikigame) 27.05.2015 HypTrails - Philipp Singer 34
  • 35. Wikigame 27.05.2015 HypTrails - Philipp Singer 35 0 1 2 3 4 hypothesis weighting factor k 1.40 1.35 1.30 1.25 1.20 1.15 1.10 1.05 1.00 0.95 evidence 1e8 uniform self-loop structural similarity Higher plausibility Higher belief (more chips)
  • 36. Wikigame 27.05.2015 HypTrails - Philipp Singer 36 0 1 2 3 4 hypothesis weighting factor k 1.40 1.35 1.30 1.25 1.20 1.15 1.10 1.05 1.00 0.95 evidence 1e8 uniform self-loop structural similarity
  • 37. Summary Studying mechanisms producing human trails HypTrails: A coherent approach for expressing and comparing hypotheses about human trails Can be applied to all kinds of human trails Implementations: www.philippsinger.info/hyptrails 27.05.2015 HypTrails - Philipp Singer 37
  • 38. GESIS - Leibniz Institute for the Social Sciences for your attention! @ph_singer www.philippsinger.info T H A N K S www.philippsinger.info/hyptrails
  • 39. References 1/2 [West et al. WWW 2015] Robert West, Ashwin Paranjape, and Jure Leskovec: Mining Missing Hyperlinks from Human Navigation Traces: A Case Study of Wikipedia. 24th International World Wide Web Conference (WWW'15), Florence, Italy, 2015. [De Choudhury et al. HT 2010] De Choudhury, Munmun and Feldman, Moran and Amer-Yahia, Sihem and Golbandi, Nadav and Lempel, Ronny and Yu, Cong: Automatic construction of travel itineraries using social breadcrumbs. 21st ACM conference on Hypertext and hypermedia, 2010. [Bestavros CIKM 1995] Bestavros, Azer: Using speculation to reduce server load and service time on the WWW. 4th International conference on Information and knowledge management. 1995. [Perkowitz IJCAI 1997] Perkowitz, Mike, and Oren Etzioni: Adaptive web sites: an AI challenge. 15th international joint conference on Artifical intelligence. 1997. [West et al. IJCAI 2009] West, Robert, Joelle Pineau, and Doina Precup. "Wikispeedia: An Online Game for Inferring Semantic Distances between Concepts." IJCAI. 2009. 27.05.2015 HypTrails - Philipp Singer 39
  • 40. References 2/2 [Singer et al. IJSWIS 2013] Philipp Singer, Thomas Niebler, Markus Strohmaier and Andreas Hotho, Computing Semantic Relatedness from Human Navigational Paths: A Case Study on Wikipedia, International Journal on Semantic Web and Information Systems (IJSWIS), vol 9(4), 41-70, 2013 [West & Leskovec WWW 2012] Robert West and Jure Leskovec: Human Wayfinding in Information Networks 21st International World Wide Web Conference (WWW'12), pp. 619628, Lyon, France, 2012. [Chi et al. CHI 2001] Chi, Ed H., et al. "Using information scent to model user information needs and actions and the Web." Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 2001. 27.05.2015 HypTrails - Philipp Singer 40