CloudCon Data Mining Presentation
0 likes568 views
The document provides an agenda for a CloudCon conference taking place on Tuesday, October 2nd at 11am. It discusses how every second generates thousands of categories of data with increasing value compared to cost. It notes that most of the analytical workload will be new and unknown, so exploration and testing are important. It also discusses structured, semi-structured, and unstructured data and different approaches for analyzing each type including SQL, SQL++, Java/C++/Pig/Hive, and Hadoop. Storage and data growth are increasing faster than companies can structure the data.
CloudCon Data Mining Presentation
- 1. ! ! ! CloudCon, Tuesday, October 2nd, 11am
- 2. Every Second in over thousands of Categories
- 3. Value > Cost $s per year in incremental revenue www.wallpapertimes.com
- 4. Big
- 5. Detail
- 6. incremental storage Volume DATA structured Variety Velocity processing semi-structured change un-structured
- 7. Analyze & Report Discover & Explore Structured Semi-Structured Unstructured SQL SQL++ Java/C++/Pig/Hive Production Data Warehousing Contextual-Complex Analytics Structure the Unstructured Large Concurrent User-base Deep, Seasonal, Consumable Data Sets Detect Patterns Data Warehouse Data Warehouse + Hadoop Behavioral Enterprise-class System Low End Enterprise-class System Commodity Hardware System 8+PB 60+PB 40+PB
- 8. ! Data Growing Faster
- 10. Data questions later structure later (<$0.04/GB, <$80/2TB) single HDFS instances >50PB Value > Cost 10
- 11. Designing for the Unknown >85% of analytical workload is NEW & Unknown The metrics you know are cheap The metrics you dont know are expensive but high in potential ROI Exploration & Testing are core pillars of an analytics-driven organization
- 12. ≒仰 Impact
- 14. !"#$ %$& '()*+,"-+ .-)/01$2& 3-#$ 4! 5"*2"$, 5"*2& 4! 6*77"$, 6*77& 4! 82*+6$22"$, 82*+6$22& 4! 9-77"+7 9-7 4! :",;"+7/,#"8<$2 :",;/,#"8<$2, 4% )*+$=, )*+$=="+7 4% )2-#$8#"-+ )2-#$8#$2 4% ="+"+7 ="+$5 4% *+">*#"-+ *+">*#$5 4% #218<, #218<"+7 4% $57"+7 $57$, 4% +$#, +$##"+7
- 15. !"#$ %$& '()*+,"-+ .-)/01$2& 3-#$ 4! 5"*2"$, 5"*2& 6*7)"2$/5"*2"$, 4! 8*99"$, 8*99& )*#*9-+"*/8*99"$, 9--5/:-2/)*#*9-+"*/8*99&;/+-#/9--5/*<-+$ 4! =2*+8$22"$, =2*+8$22& #>$/=2*+8$22"$, 4! ?-99"+9 ?-9 ?-99"+9/,#2-<<$2 4! :",>"+9/,#"=@$2 :",>/,#"=@$2, :",>"+9/,#"=@$2 ,)-2#,/6,A/@"5,/2--7, 4% )*+$<, )*+$<<"+9 :$+=$/)*+$<, 4% )2-#$=#"-+ )2-#$=#$2 7=*:$$/#-#*</)2-#$=#"-+/BCDB ,=2$$+/)2-#$=#$2/",/#-)/4!/E1$2& 4% <"+"+9 <"+$5 )"+@/<"+"+9/=>*+9"+9/8*9 4% *+"7*#"-+ *+"7*#$5 *+"7*#"-+/=$< 4% #21=@, #21=@"+9 =-29"/#21=@, 4% $59"+9 $59$, 9*25$+/$59"+9 4% +$#, +$##"+9 )12,$/+$#,
- 18. Value > Cost $s per year in incremental revenue www.wallpapertimes.com
- 21. Toys and Hobbies ATC > Artist trading card in ART ATC > Automatic Tool Change in Business and Industrial
- 22. German Compound Words ≒仰 German compound words can be arbitrarily created and extremely long Adidastrainingsanzug (Adidas track suit) Rindfleischetikettierungs端berwachungsaufgaben端bertragungsgesetz (beef labeling regulation & delegation of supervision law) ≒仰 Syntactically, words can be combined and split in many ways. ≒仰 Some words shouldnt be de-compounded. beiden (both) bei(at) den(the) ≒仰 Too many candidates for Granitpflastersteine (granite paving stones) Granit(granite) pflastersteine(cobblestones) Granit(granite) pflaster(paving/band-aid) steine(stones) ≒仰 Binding characters Hochzeitsschuhe (grammatically correct, 593 hits on ebay.de) Hochzeitschuhe (129 hits on ebay.de).
- 23. Synonyms derived from top queries in item query clusters texas instruments ba ii plus / ba ii plus brighton handbag brighton purse lenovo x200 thinkpad x200 king bedspread king coverlet rockabilly dress swing dress 1963 ford falcon 63 falcon jessica simpson hair extensions jessica simpson hairdo Abbrevia7ons/acronym derived from query transi7ons stanford ky stanford kentucky dc sub dc subwoofer snowboard helmet l snowboard helmet large motorcycle cam motorcycle camera diamond amp diamond ampli鍖er