際際滷shows by User: elyisu / http://www.slideshare.net/images/logo.gif 際際滷shows by User: elyisu / Sat, 25 May 2013 15:39:52 GMT 際際滷Share feed for 際際滷shows by User: elyisu MongoDB and Web Scraping with the Gyes platform. MongoDB Atlanta 2013 /slideshow/mongo-db-and-web-scraping-with-the-gyes-platform-atlanta-21910315/21910315 mongodbandwebscrapingwiththegyesplatform-atlanta-130525153952-phpapp02
Gyes is an aggregation platform for the Web. Gyes allows you to develop, schedule and troubleshoot data extraction programs (crawlers) that translate html content into structured data you can use later on. In selecting the data model for the platform, several challenges arose due to the lack of structure of the scraped data, and the need to provide meaningful and efficient access to it. MongoDB was our third rewrite of the Gyes back-end, and by far has exceeded expectations. In this talk, I would like to discuss some of the challenges we faced, and how MongoDB addressed them. Details about implementation challenges are also shared.]]>
Gyes is an aggregation platform for the Web. Gyes allows you to develop, schedule and troubleshoot data extraction programs (crawlers) that translate html content into structured data you can use later on. In selecting the data model for the platform, several challenges arose due to the lack of structure of the scraped data, and the need to provide meaningful and efficient access to it. MongoDB was our third rewrite of the Gyes back-end, and by far has exceeded expectations. In this talk, I would like to discuss some of the challenges we faced, and how MongoDB addressed them. Details about implementation challenges are also shared.]]> Sat, 25 May 2013 15:39:52 GMT /slideshow/mongo-db-and-web-scraping-with-the-gyes-platform-atlanta-21910315/21910315 elyisu@slideshare.net(elyisu) MongoDB and Web Scraping with the Gyes platform. MongoDB Atlanta 2013 elyisu Gyes is an aggregation platform for the Web. Gyes allows you to develop, schedule and troubleshoot data extraction programs (crawlers) that translate html content into structured data you can use later on. In selecting the data model for the platform, several challenges arose due to the lack of structure of the scraped data, and the need to provide meaningful and efficient access to it. MongoDB was our third rewrite of the Gyes back-end, and by far has exceeded expectations. In this talk, I would like to discuss some of the challenges we faced, and how MongoDB addressed them. Details about implementation challenges are also shared. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/mongodbandwebscrapingwiththegyesplatform-atlanta-130525153952-phpapp02-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> Gyes is an aggregation platform for the Web. Gyes allows you to develop, schedule and troubleshoot data extraction programs (crawlers) that translate html content into structured data you can use later on. In selecting the data model for the platform, several challenges arose due to the lack of structure of the scraped data, and the need to provide meaningful and efficient access to it. MongoDB was our third rewrite of the Gyes back-end, and by far has exceeded expectations. In this talk, I would like to discuss some of the challenges we faced, and how MongoDB addressed them. Details about implementation challenges are also shared.
MongoDB and Web Scraping with the Gyes platform. MongoDB Atlanta 2013 from Jesus Diaz
]]> 1477 2 https://cdn.slidesharecdn.com/ss_thumbnails/mongodbandwebscrapingwiththegyesplatform-atlanta-130525153952-phpapp02-thumbnail.jpg?width=120&height=120&fit=bounds presentation White http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 https://cdn.slidesharecdn.com/profile-photo-elyisu-48x48.jpg?cb=1517244251 Computer professional with strong background in mathematics and algorithms. Specialties: Web and Windows Development, Multi-tier Enterprise Application Architecture Design and Implementation. Web Mining. System Integration. Web scrapping and computer software algorithms. http://www.infinithread.com