ºÝºÝߣ

ºÝºÝߣShare a Scribd company logo

The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director, eBay

?
?
E
exponential-inc

Developers are leading the charge to turn consumer behavior into profitable solutions. By accessing and analyzing the explosion of data from consumer activities, any developer can create the personalized, relevant products and services that customers demand and merchants urgently need. Brian will discuss how to acquire, store, and mine information, and how to design analytics-focused software and build data-driven software engines.

1 of 24
Download to read offline
! ! ! CloudCon, Tuesday, October 2nd, 11am
Every Second ¨C in over thousands of Categories
www.wallpapertimes.com $¡¯s per year in incremental revenue Value > Cost
Big
Detail
structured incremental storage processing change Volume Variety Velocity DATA semi-structured un-structured
Data Warehouse + Behavioral Data Warehouse Semi-Structured SQL++ Structured SQL Low End Enterprise-class System Contextual-Complex Analytics Deep, Seasonal, Consumable Data Sets Production Data Warehousing Large Concurrent User-base Enterprise-class System Unstructured Java/C++/Pig/Hive Structure the Unstructured Detect Patterns Commodity Hardware System 8+PB 60+PB 40+PB Hadoop Analyze & Report Discover & Explore
! ? Data Growing Faster
The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director, eBay
10 questions later structure later (<$0.04/GB, <$80/2TB) single HDFS instances >50PB Value > Cost Data
Designing for the Unknown >85% of analytical workload is NEW & Unknown The metrics you know are cheap The metrics you don¡¯t know are expensive ¨C but high in potential ROI Exploration & Testing are core pillars of an analytics-driven organization
?? Impact
The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director, eBay
!"#$ %$& '()*+,"-+ .-)/01$2& 3-#$ 4! 5"*2"$, 5"*2& 4! 6*77"$, 6*77& 4! 82*+6$22"$, 82*+6$22& 4! 9-77"+7 9-7 4! :",;"+7/,#"8<$2 :",;/,#"8<$2, 4% )*+$=, )*+$=="+7 4% )2-#$8#"-+ )2-#$8#$2 4% ="+"+7 ="+$5 4% *+">*#"-+ *+">*#$5 4% #218<, #218<"+7 4% $57"+7 $57$, 4% +$#, +$##"+7
!"#$ %$& '()*+,"-+ .-)/01$2& 3-#$ 4! 5"*2"$, 5"*2& 6*7)"2$/5"*2"$, 4! 8*99"$, 8*99& )*#*9-+"*/8*99"$, 9--5/:-2/)*#*9-+"*/8*99&;/+-#/9--5/*<-+$ 4! =2*+8$22"$, =2*+8$22& #>$/=2*+8$22"$, 4! ?-99"+9 ?-9 ?-99"+9/,#2-<<$2 4! :",>"+9/,#"=@$2 :",>/,#"=@$2, :",>"+9/,#"=@$2 ,)-2#,/6,A/@"5,/2--7, 4% )*+$<, )*+$<<"+9 :$+=$/)*+$<, 4% )2-#$=#"-+ )2-#$=#$2 7=*:$$/#-#*</)2-#$=#"-+/BCDB ,=2$$+/)2-#$=#$2/",/#-)/4!/E1$2& 4% <"+"+9 <"+$5 )"+@/<"+"+9/=>*+9"+9/8*9 4% *+"7*#"-+ *+"7*#$5 *+"7*#"-+/=$< 4% #21=@, #21=@"+9 =-29"/#21=@, 4% $59"+9 $59$, 9*25$+/$59"+9 4% +$#, +$##"+9 )12,$/+$#,
The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director, eBay
The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director, eBay
www.wallpapertimes.com $¡¯s per year in incremental revenue Value > Cost
The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director, eBay
The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director, eBay
Toys and Hobbies ATC > Artist trading card in ART ATC > Automatic Tool Change in Business and Industrial
German Compound Words ?? German compound words can be arbitrarily created and extremely long Adidastrainingsanzug (Adidas track suit) Rindfleischetikettierungs¨¹berwachungsaufgaben¨¹bertragungsgesetz (beef labeling regulation & delegation of supervision law) ?? Syntactically, words can be combined and split in many ways. ?? Some words shouldn¡¯t be de-compounded. beiden (both) ¨C bei(at) den(the) ?? Too many candidates for Granitpflastersteine (granite paving stones) Granit(granite) pflastersteine(cobblestones) Granit(granite) pflaster(paving/band-aid) steine(stones) ?? Binding characters Hochzeitsschuhe (grammatically correct, 593 hits on ebay.de) Hochzeitschuhe (129 hits on ebay.de).
Synonyms ?derived ?from ?top ?queries ?in ?item ?query ?clusters ? texas ?instruments ?ba ?ii ?plus ? / ?ba ?ii ?plus ? brighton ?handbag ? brighton ?purse ? lenovo ?x200 ? thinkpad ?x200 ? king ?bedspread ? king ?coverlet ? rockabilly ?dress ? swing ?dress ? 1963 ?ford ?falcon ? 63 ?falcon ? jessica ?simpson ?hair ?extensions ? jessica ?simpson ?hairdo ? ? Abbrevia7ons/acronym ?derived ?from ?query ?transi7ons ? stanford ?ky ? stanford ?kentucky ? dc ?sub ? dc ?subwoofer ? snowboard ?helmet ?l ? snowboard ?helmet ?large ? motorcycle ?cam ? motorcycle ?camera ? diamond ?amp ? diamond ?ampli?er ?
The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director, eBay

More Related Content

The New Alchemy: Turning Data into Gold By Brian Johnson Engineering Director, eBay

  • 2. Every Second ¨C in over thousands of Categories
  • 3. www.wallpapertimes.com $¡¯s per year in incremental revenue Value > Cost
  • 4. Big
  • 7. Data Warehouse + Behavioral Data Warehouse Semi-Structured SQL++ Structured SQL Low End Enterprise-class System Contextual-Complex Analytics Deep, Seasonal, Consumable Data Sets Production Data Warehousing Large Concurrent User-base Enterprise-class System Unstructured Java/C++/Pig/Hive Structure the Unstructured Detect Patterns Commodity Hardware System 8+PB 60+PB 40+PB Hadoop Analyze & Report Discover & Explore
  • 8. ! ? Data Growing Faster
  • 10. 10 questions later structure later (<$0.04/GB, <$80/2TB) single HDFS instances >50PB Value > Cost Data
  • 11. Designing for the Unknown >85% of analytical workload is NEW & Unknown The metrics you know are cheap The metrics you don¡¯t know are expensive ¨C but high in potential ROI Exploration & Testing are core pillars of an analytics-driven organization
  • 14. !"#$ %$& '()*+,"-+ .-)/01$2& 3-#$ 4! 5"*2"$, 5"*2& 4! 6*77"$, 6*77& 4! 82*+6$22"$, 82*+6$22& 4! 9-77"+7 9-7 4! :",;"+7/,#"8<$2 :",;/,#"8<$2, 4% )*+$=, )*+$=="+7 4% )2-#$8#"-+ )2-#$8#$2 4% ="+"+7 ="+$5 4% *+">*#"-+ *+">*#$5 4% #218<, #218<"+7 4% $57"+7 $57$, 4% +$#, +$##"+7
  • 15. !"#$ %$& '()*+,"-+ .-)/01$2& 3-#$ 4! 5"*2"$, 5"*2& 6*7)"2$/5"*2"$, 4! 8*99"$, 8*99& )*#*9-+"*/8*99"$, 9--5/:-2/)*#*9-+"*/8*99&;/+-#/9--5/*<-+$ 4! =2*+8$22"$, =2*+8$22& #>$/=2*+8$22"$, 4! ?-99"+9 ?-9 ?-99"+9/,#2-<<$2 4! :",>"+9/,#"=@$2 :",>/,#"=@$2, :",>"+9/,#"=@$2 ,)-2#,/6,A/@"5,/2--7, 4% )*+$<, )*+$<<"+9 :$+=$/)*+$<, 4% )2-#$=#"-+ )2-#$=#$2 7=*:$$/#-#*</)2-#$=#"-+/BCDB ,=2$$+/)2-#$=#$2/",/#-)/4!/E1$2& 4% <"+"+9 <"+$5 )"+@/<"+"+9/=>*+9"+9/8*9 4% *+"7*#"-+ *+"7*#$5 *+"7*#"-+/=$< 4% #21=@, #21=@"+9 =-29"/#21=@, 4% $59"+9 $59$, 9*25$+/$59"+9 4% +$#, +$##"+9 )12,$/+$#,
  • 18. www.wallpapertimes.com $¡¯s per year in incremental revenue Value > Cost
  • 21. Toys and Hobbies ATC > Artist trading card in ART ATC > Automatic Tool Change in Business and Industrial
  • 22. German Compound Words ?? German compound words can be arbitrarily created and extremely long Adidastrainingsanzug (Adidas track suit) Rindfleischetikettierungs¨¹berwachungsaufgaben¨¹bertragungsgesetz (beef labeling regulation & delegation of supervision law) ?? Syntactically, words can be combined and split in many ways. ?? Some words shouldn¡¯t be de-compounded. beiden (both) ¨C bei(at) den(the) ?? Too many candidates for Granitpflastersteine (granite paving stones) Granit(granite) pflastersteine(cobblestones) Granit(granite) pflaster(paving/band-aid) steine(stones) ?? Binding characters Hochzeitsschuhe (grammatically correct, 593 hits on ebay.de) Hochzeitschuhe (129 hits on ebay.de).
  • 23. Synonyms ?derived ?from ?top ?queries ?in ?item ?query ?clusters ? texas ?instruments ?ba ?ii ?plus ? / ?ba ?ii ?plus ? brighton ?handbag ? brighton ?purse ? lenovo ?x200 ? thinkpad ?x200 ? king ?bedspread ? king ?coverlet ? rockabilly ?dress ? swing ?dress ? 1963 ?ford ?falcon ? 63 ?falcon ? jessica ?simpson ?hair ?extensions ? jessica ?simpson ?hairdo ? ? Abbrevia7ons/acronym ?derived ?from ?query ?transi7ons ? stanford ?ky ? stanford ?kentucky ? dc ?sub ? dc ?subwoofer ? snowboard ?helmet ?l ? snowboard ?helmet ?large ? motorcycle ?cam ? motorcycle ?camera ? diamond ?amp ? diamond ?ampli?er ?