際際滷

際際滷Share a Scribd company logo
Feeding Drupal
   * Now in Real Time
Overview

   What is Feeds module all about?

   How does Feeds module work?

   DEMO: Importing Flickr photos

   Real-time feeds with PubSubHubbub

   Very Exciting Demonstration with Gowalla!
What is Feeds Module?

   Import and aggregation framework

   Creates nodes, users, taxonomy, 鍖at data...

   From RSS / Atom / SOAP / CSV / ...

   Mapping of input to Drupal elements

   Its easily extensible and supports
    PubSubHubbub as a subscriber
But, what about...

 Periodic       One-o鍖
 Imports        Imports


Aggregator      Migrate
 Feed API     Node Import
              User Import
How does it work?


Fetcher    Parser   Processor
How does Feeds work?


Fetcher   Parser   Processor


HTTP       RSS       NODE
HTTPS     ATOM        USER
 FILE     FLICKR   TAXONOMY
  ...        ...       ...
How does it work?
          Feeds Importer
 {
Fetcher


HTTP
HTTPS
 FILE
  ...
              Parser


              RSS
             ATOM
             FLICKR
                ...
                           Processor


                             NODE
                              USER
                           TAXONOMY
                               ...
Lets import some stu鍖
          Feeds Importer
 {
Fetcher


HTTP
HTTPS
 FILE
  ...
              Parser


              RSS
             ATOM
             FLICKR
                ...
                           Processor


                             NODE
                              USER
                           TAXONOMY
                               ...
DEMO

   Importing photos from Flickr into Drupal
    nodes

   Using location data from GeoRSS feed to
    display them on a Google map

   Import set to run on cron every 30 mins.
Whats wrong with that?
                     Are we there yet?
                     Are we there yet?


  Publisher                              Subscriber



Yes! Here you are.


                     Are we there yet?
Solution?



Publisher               Subscriber
Problem
                      Subscriber

                      Subscriber

                      Subscriber

Publisher             Subscriber

                      Subscriber

                      Subscriber

                      Subscriber
Enter PubSubHubbub

      A publish / subscribe protocol

      Turns Atom and RSS feeds into real-time
       streams



Publisher                Hub              Subscriber
What does it look like?
Step 1 of 2: Subscribe

               I want to subscribe to
               feed X, send updates
                       to me.


Publisher    Hub                 Subscriber


                   Are you for real?
Step 2 of 2: Publish
                       Hey subscribers,
                     heres new content for
I have new content           feed X
     for feed X
                                              Subscriber

                                              Subscriber
Publisher             Hub
                                              Subscriber

                                              Subscriber
Lets import some more
         stu鍖...

   Now in real-time with PuSH

   Check into Gowalla from mobile phone

   See location update on Google map in
    Drupal
What just happened?




Publisher    Hub      Subscriber
Step 1 of 2: Subscribe
      When we created the Gowalla Feed node,
       we asked the hub to send us updates.


                         I want to subscribe to
                          Johns Gowalla Feed



                      Super
Publisher
Gowalla                                    Drupal Site
                      Feedr
Step 2 of 2: Publish

                   No polling

                   No cron runs

                   Real-time update



               Super
Publisher
Gowalla                            Drupal Site
               Feedr
Feeding Drupal in Real-Time
Any Questions?
References

Feeds Module - http://drupal.org/project/feeds

Flickr Parser - http://drupal.org/project/feeds_鍖ickr

Pubsubhubbub spec - http://pubsubhubbub.googlecode.com/svn/trunk/pubsubhubbub-
core-0.3.html

Superfeedr - http://superfeedr.com/

Federated Social Web Google Group - http://groups.google.com/group/federated-social-
web
Credits


   PubSubHubbub diagrams inspired by Alex
    Barths presentation at Drupalcon CPH.

   Walled social network image - David
    Simonds (The Economist)

More Related Content

Feeding Drupal in Real-Time

  • 1. Feeding Drupal * Now in Real Time
  • 2. Overview What is Feeds module all about? How does Feeds module work? DEMO: Importing Flickr photos Real-time feeds with PubSubHubbub Very Exciting Demonstration with Gowalla!
  • 3. What is Feeds Module? Import and aggregation framework Creates nodes, users, taxonomy, 鍖at data... From RSS / Atom / SOAP / CSV / ... Mapping of input to Drupal elements Its easily extensible and supports PubSubHubbub as a subscriber
  • 4. But, what about... Periodic One-o鍖 Imports Imports Aggregator Migrate Feed API Node Import User Import
  • 5. How does it work? Fetcher Parser Processor
  • 6. How does Feeds work? Fetcher Parser Processor HTTP RSS NODE HTTPS ATOM USER FILE FLICKR TAXONOMY ... ... ...
  • 7. How does it work? Feeds Importer { Fetcher HTTP HTTPS FILE ... Parser RSS ATOM FLICKR ... Processor NODE USER TAXONOMY ...
  • 8. Lets import some stu鍖 Feeds Importer { Fetcher HTTP HTTPS FILE ... Parser RSS ATOM FLICKR ... Processor NODE USER TAXONOMY ...
  • 9. DEMO Importing photos from Flickr into Drupal nodes Using location data from GeoRSS feed to display them on a Google map Import set to run on cron every 30 mins.
  • 10. Whats wrong with that? Are we there yet? Are we there yet? Publisher Subscriber Yes! Here you are. Are we there yet?
  • 11. Solution? Publisher Subscriber
  • 12. Problem Subscriber Subscriber Subscriber Publisher Subscriber Subscriber Subscriber Subscriber
  • 13. Enter PubSubHubbub A publish / subscribe protocol Turns Atom and RSS feeds into real-time streams Publisher Hub Subscriber
  • 14. What does it look like?
  • 15. Step 1 of 2: Subscribe I want to subscribe to feed X, send updates to me. Publisher Hub Subscriber Are you for real?
  • 16. Step 2 of 2: Publish Hey subscribers, heres new content for I have new content feed X for feed X Subscriber Subscriber Publisher Hub Subscriber Subscriber
  • 17. Lets import some more stu鍖... Now in real-time with PuSH Check into Gowalla from mobile phone See location update on Google map in Drupal
  • 19. Step 1 of 2: Subscribe When we created the Gowalla Feed node, we asked the hub to send us updates. I want to subscribe to Johns Gowalla Feed Super Publisher Gowalla Drupal Site Feedr
  • 20. Step 2 of 2: Publish No polling No cron runs Real-time update Super Publisher Gowalla Drupal Site Feedr
  • 23. References Feeds Module - http://drupal.org/project/feeds Flickr Parser - http://drupal.org/project/feeds_鍖ickr Pubsubhubbub spec - http://pubsubhubbub.googlecode.com/svn/trunk/pubsubhubbub- core-0.3.html Superfeedr - http://superfeedr.com/ Federated Social Web Google Group - http://groups.google.com/group/federated-social- web
  • 24. Credits PubSubHubbub diagrams inspired by Alex Barths presentation at Drupalcon CPH. Walled social network image - David Simonds (The Economist)