Importing and synchronizing content using Feeds
14 likes9,450 views
This document discusses how to use the Feeds module in Drupal to import and synchronize content from various sources. Feeds allows importing content like nodes, users, taxonomy from RSS, CSV, XML and JSON feeds. It provides fetchers to access remote sources, parsers to interpret different formats, and processors to save content as Drupal entities. Examples demonstrated include importing Flickr photos and keeping RSS feeds in sync. The document also covers using Feeds with Commerce products, tampering to modify field values, and enabling real-time updates via PubSubHubbub.
Importing and synchronizing content using Feeds
- 1. 7 drupal Importing and syncing content using Feeds Peter Vanhee 2nd October 2011 - DrupalCamp Spain
- 2. Who am I? Consumer and contributor to Drupal for over 5 years Co-founder Youth Agora @youthagora and Nuvole @nuvoleweb Web consultant in Barcelona @pvhee
- 5. Content is aggregated and synchronized using Feeds
- 6. Use Cases Build Activity streams using feeds from Twitter, Facebook, ... Batch import sets of users from 鍖le Import Commerce Products ...
- 8. Feeds is... Import / aggregate framework Create and update drupal entities out of the box: nodes, users, taxonomy Real-time feeds support
- 9. Related Migrate Aggregator Table Wizard User import Node import
- 10. Feeds as the standard for piping content
- 11. Feeds usage drupal 6 drupal 7 statistics from drupal.org Statistics from drupal.org
- 13. Fetcher Http File upload A complete list is at http://drupal.org/node/856644
- 14. Parser CSV, RSS1, RSS2, Atom OPML, Sitemap XML XPath for XML/HTML JSONPath for JSON YouTube, Flickr, 際際滷share iCal A complete list is at http://drupal.org/node/856644
- 15. Processor Node User Taxonomy Commerce Products A complete list is at http://drupal.org/node/856644
- 16. 2011.drupalcamp.es my drupal site Example #1 Import and sync RSS Feeds
- 17. Feeds importers are con鍖gurations of Fetcher Parser Processor
- 21. create nodes of type Feed item
- 22. 鍖elds in RSS 鍖elds in Feed item
- 24. /import
- 26. We can do this with Drupal Core Aggregator too!
- 27. Lets try spawning Feed A User 1 Feed B Feed A User Feed B Feed C Feed C 1 User 2 Feed X Aggregator (core) Feeds
- 28. Spawning
- 29. Add Feed = Add Node
- 30. Example #2 Import images
- 31. A node of type Story will hold a Flickr image
- 32. the Flickr XML feed { http://www.鍖ickr.com/services/feeds/geo?format=rss_200&tags=drupalcamp
- 33. Parse XML with XPath expressions //item title link description geo:lat geo:long media:thumbnail/@url
- 34. Fetcher http Parser XPath Parser Map targets from XPath Processor Node processor
- 35. select XPath XML parser
- 36. source is XPath Result 鍖elds in Story
- 39. Importing
- 41. We have problems ! Tags are not imported correctly
- 42. Feeds Tamper http://drupal.org/project/feeds_tamper
- 43. Enter Tampering Input Field Output Field explode drupal feeds sevilla drupal feeds sevilla html_encode Me</a>posted a <a href=.>Me</a> photo:</p> posted a photo
- 46. Add your own tamper plugins snippet from html_entity_decode.inc
- 47. After importing... tags are now correctly split
- 48. Importing Big Stuff Feeds has Batch support Feeds can run on cron jobs in the background
- 49. Field support Text Email File Multimedia Image Address Link Geo鍖eld Taxonomy Tip: check Feeds issue Password queues for patches Date Integer
- 50. Feeds as a Framework Supports import/sync of Commerce Products (via Commerce Feeds) Straightforward to add custom fetchers, patchers and processors using Feed hooks (check feeds.api.php)
- 51. Finally... when not to use Feeds Content does not need to be stored by Drupal Complex content migration tasks
- 52. Now... Real-Time? Are we there yet? Are we there yet? Are we there yet? Publisher Subscriber Yes. Here you are. Are we there yet? 際際滷 taken from @alexb presentation on Feeds
- 53. Enter PubSubHubBub Publisher Hub Subscriber What does this solve? 1. Noti鍖cations to Subscribers managed by Hub 2. Send only what is changed and when it gets changed
- 54. Euhm.. so what does Feeds do exactly? Feeds makes Drupal a PSHB Subscriber Update feeds in real-time from PSHB Hubs e.g. Blogger, Wordpress, Superfeedr, ...
- 55. Thanks! Peter Vanhee @pvhee
- 56. Questions? Peter Vanhee @pvhee