Skip to content


An introduction to Yahoo Pipes

Yahoo describes Pipes as “an interactive data aggregator and manipulator that lets you mashup your favorite online data sources”. Alright, but what does that mean to the rest of us? Yahoo Pipes uses an easy-to-understand visual editor that allows you to (among other things) take multiple RSS feeds, combine and filter them, and then output all of that information to one RSS feed.

This tutorial will take you through the steps to filter the content of one RSS feed (Techmeme) so that content you may have already read isn’t included in your Techmeme feed.

  1. To create a pipe you’ll a need a Yahoo account, so if you don’t have one, you might as well sign up now. Once you’ve signed in, visit http://pipes.yahoo.com. The default/blank Pipes layout will be presented.
  2. yahoo pipes
    click to enlarge

  3. Get started by dragging Fetch Feed from the Sources list into the main module area. Enter the full URL to the RSS feed you want to customize. For this tutorial I’m using the Techmeme RSS feed, which is http://www.techmeme.com/index.xml
  4. yahoo pipes
    click to enlarge

  5. To confirm the feed was loaded correctly, drag a line from the small circle at the bottom of the Fetch Feed module to the Pipe Output module. Then, drag the Debugger window into focus and click the Refresh link if nothing shows up right away. The Debugger window should fill with a list of the articles in the feed you added.
  6. yahoo pipes
    click to enlarge

  7. Now we’ll filter out articles from the feed that we don’t want to include. From the Operations menu, drag the Filter module into the main workspace.
  8. yahoo pipes
    click to enlarge

  9. Now link the Fetch Feed module to the Filter module (you can leave the Pipe Output module unconnected for now).
  10. yahoo pipes
    click to enlarge

  11. In the Filter module, make sure that Block and Any are both selected. In the Rules area, select item.description. The item.description option is ‘created’ because Yahoo Pipes recognizes the “description” part of the Techmeme feed (see the bottom part of the screenshot below).

    For this feed, I’m going to block out certain URL’s from the Techmeme feed, because I already subscribe to those sites RSS feeds, and I don’t want to waste time scrolling through the Techmeme feed on things that I’ve already ready. So the first URL I entered was http://gigaom.com. That will block out any Techmeme articles that originate from GigaOM.com.

  12. yahoo pipes
    click to enlarge

  13. Click the + (plus) Rules button to create another rule, and repeat the steps above. Enter in the URLs to sites that you already read, and therefore don’t need to read again when they’re published in Techmeme. When you’re done, ‘drag’ the pipe from the Filter module to the Pipe Output module. Refresh the Debugger area and any articles that originate from a site that you’ve just added to your filter will be removed.
  14. yahoo pipes

  15. If you’d like, you can also add a Sort module (from the Operations menu) into the mix. That way you can sort the feed articles by the date published etc. Make sure the final pipe goes from Fetch Feed to Filter to Sort and finally to Pipe Output. When you’re done, click the Save button in the upper-right part of Yahoo Pipes.
  16. yahoo pipes
    click to enlarge

  17. Give your custom feed a name and click Save.
  18. yahoo pipes

  19. To preview your “new” feed, click Run Pipe from the top (center) of Yahoo Pipes. Your feed will be previewed in a new browser window/tab.
  20. yahoo pipes
    click to enlarge

  21. If you’re happy with the results, close the preview window/tab and click the Publish button (next to Save). Enter a description and some tags, then click Publish.
  22. yahoo pipes

  23. To subscribe to your feed, go back to the Preview page and use the handy Subscribe drop down menu. You can save your feed directly to a number of the popular online feed readers, or just use the Get as RSS item to display your RSS feed URL.
  24. yahoo pipes

  25. For Firefox users, the feed will be displayed in your browser. You can copy and paste the URL into any RSS reader you choose.
  26. yahoo pipes
    click to enlarge

  27. You can find more Yahoo Pipes resources/tutorials here (and feel free/encouraged to add more to that list).

Posted in Other.

Get Simple Help tutorials just like this one in your email inbox every day - for free! Just enter your email address below:

 

You can always opt out of this email subscription at any time.

52 Responses

Stay in touch with the conversation, subscribe to the RSS feed for comments on this post.

  1. TV Online says

    Excellent tutorial, it was a little daunting to use at first. It makes a lot more sense now, can use it to merge feeds together rather then subscribing to each one separately.

  2. Ed says

    Great article, i will defenitly try this out.

  3. Richard says

    Heh, the amusing thing is FIVE MINUTES AGO I put “check out pipes” on my todo list, have a look at their site and then see your post! Will give it a good read :)

  4. Ed says

    Thanks for the tutorial.

  5. Ben says

    Excellent article!

    http://www.yahoopipes.co.uk

  6. Vijay Teach Me says

    Hi,
    I had tried yahoo pipes earlier but with not great resultys your article provides a very step by step approach.

    Will give pipes a try again.

    Vijay

  7. midget__plumber says

    Nice tutorial! Tip: Feedity’s RSS generator can be used for those data sources which don’t provide a syndication format like RSS to act as a Pipe’s input. There’s a video tutorial at http://jfiles2.googlepages.com/pipesFeedity.html … Feedity is an RSS generator for web pages without a web syndication format.

  8. Inte Angett says

    This tutorial shows off the Regex Module in Yahoo Pipes: http://theytookmystapler.blogspot.com/2007/09/yahoo-pipes-case-study-of-using-regex.html

  9. johnny says

    Thanks for the great article. I will try this for sure.

  10. jimmy says

    Thanks for the great tutorial.. I was having a ton of problems.

  11. Jones says

    Thanks for the great article. I will try this for sure.

  12. Busby says

    Will give pipes a try again, after read this tutorial I wan try it again. Because, I had tried yahoo pipes earlier but with not great results.

  13. Marius says

    Curios that i navigate all day long and i never knew about yahoo pipes.First time i hear about it;i will give it a try anyway and this tutorial will make it easier for sure.Thanks.

  14. Web Design Melbourne says

    thanks for the info on yahoo pipes and very well explained.

    greetings from Graphic Design Melbourne

  15. MaleOK says

    I’m trying to import multiple feeds into my Facebook Notes. However Facebook only supports 1 external feed.

    I have merged all my feeds into one via Yahoo! Pipes but Facebook doesn’t seem to work with it.

    Is there another way?

  16. Male says

    The pipes program is great for rss feeds too. Im playing a bit on how to configure the best feeds.

  17. AC says

    Great tutorial, i will defenitly try this out!

  18. slendertone review says

    Great post, thanks for sharing! Very useful…

  19. Cerita Dewasa says

    Thanks for information, this is very useful…

  20. Auction site says

    Good help for those who are novice in this. I really like the article and all the points that you have provided here!

  21. Mike says

    Awesome article, thanks for the share!

  22. Carl says

    Really like this yahoo pipes application

Continuing the Discussion

  1. University Update - Yahoo - An introduction to Yahoo Pipes linked to this post on July 16, 2007

    [...] YouTube Link to Article yahoo An introduction to Yahoo Pipes » Posted at Simplehelp – Common questions, simple answers on Monday, July 16, 2007 Yahoo describes Pipes as “an interactive data aggregator and manipulator that lets you mashup your favorite online data sources”. Alright, but what does that mean to the rest of us? Yahoo Pipes uses an easy-to-understand visual … t included in your Techmeme feed. To create a pipe you’ll a need a Yahoo account, so if you don’ View Entire Article » [...]

  2. University Update - Firefox - An introduction to Yahoo Pipes linked to this post on July 16, 2007

    [...] YouTube Link to Article firefox An introduction to Yahoo Pipes » Posted at Simplehelp – Common questions, simple answers on Monday, July 16, 2007 Yahoo describes Pipes as “an interactive data aggregator and manipulator that lets you mashup your favorite online data sources”. Alright, but what does that mean to the rest of us? Yahoo Pipes uses an easy-to-understand visual editor that allows you to (among other things) View Entire Article » [...]

  3. Micahville » Blog Archive » Using Yahoo Pipes for 69 Tech Blogs Mashup linked to this post on July 17, 2007

    [...] Currently, I am working on that, however if any of you are interested in how it is done, I have provided the link here. [...]

  4. Syaf The Geek » Blog Archive » An introduction to Yahoo Pipes linked to this post on July 17, 2007

    [...] Yahoo describes Pipes as “an interactive data aggregator and manipulator that lets you mashup your favorite online data sources”. But what does that mean to the rest of us? This tutorial will take you through the steps to filter the content of one RSS feed (Techmeme) so that content you may have already read isn’t included in your Techmeme feed.read more | digg story Sphere: Related Content [...]

  5. SeoGenetic Blogs » An introduction to Yahoo Pipes linked to this post on July 17, 2007

    [...] read more | digg story [...]

  6. I Write Things » Blog Archive » Discovering Yahoo Pipes linked to this post on July 17, 2007

    [...] I was talking with some friends and figured I would check out the digg RSS feed for any new stories that may catch my interest. I saw a submission on Yahoo’s new application, Pipes from SimpleHelp, “An introduction to Yahoo Pipes”. At first it didn’t sound very interesting since I stopped using Yahoo four years ago. Then curiosity bit me in the butt and I checked it out. Pretty cool little web application that allows you to create a custom RSS feed from pretty much anything. [...]

  7. Links fundet på internettet den 2007-07-18 | Webmercial.dk linked to this post on July 18, 2007

    [...] An introduction to Yahoo Pipes – Simplehelp Sådan lærer du at aggregere (tags: tutorial rss) [...]

  8. What I’m doing » Great intro to Yahoo Pipes linked to this post on July 18, 2007

    [...] SimpleHelp has a great introduction to Yahoo Pipes. Yahoo describes Pipes as “an interactive data aggregator and manipulator that lets you mashup your favorite online data sources”. Alright, but what does that mean to the rest of us? Yahoo Pipes uses an easy-to-understand visual editor that allows you to (among other things) take multiple RSS feeds, combine and filter them, and then output all of that information to one RSS feed. [...]

  9. links for 2007-07-18 « HAPHT linked to this post on July 18, 2007

    [...] An introduction to Yahoo Pipes – Simplehelp (tags: pipes tutorial) Posted by hapht Filed in [...]

  10. Noticias y artículos interesantes del 2007-07-18 | hombrelobo, una mente dispersa linked to this post on July 18, 2007

    [...] 11 – An introduction to Yahoo Pipes – Simplehelp [...]

  11. BarelyBlogging » Blog Archive » links for 2007-07-19 linked to this post on July 18, 2007

    [...] An introduction to Yahoo Pipes – Simplehelp (tags: yahoo pipes rss syndication) [...]

  12. rich video and other delicious waves « edParadigm [index] linked to this post on July 18, 2007

    [...] An introduction to Yahoo Pipes [...]

  13. Vu du Web - Jérôme Bourreau Guggenheim linked to this post on July 18, 2007

    [...] Yahoo Pipes – Simplehelp – Découverte de l’aggregateur de flux RSS de Yahoo [...]

  14. » Blog Archive » links for 2007-07-19 linked to this post on July 18, 2007

    [...] An introduction to Yahoo Pipes – Simplehelp Yahoo describes Pipes as “an interactive data aggregator and manipulator that lets you mashup your favorite online data sources”. Alright, but what does that mean to the rest of us? (tags: rss tools mashup) [...]

  15. Jeremy Hermanns dot org » An introduction to Yahoo Pipes linked to this post on July 18, 2007

    [...] read more | digg story [...]

  16. 新闻简评:二季度:Intel赚13亿 AMD亏6亿 [7/19] - 花儿开了 linked to this post on July 18, 2007

    [...] An introduction to Yahoo Pipes – Simplehelp Yahoo Pipes 的教程,很不错 TAGs: yahoo pipes tutorial toblog [...]

  17. links for 2007-07-19 | SoulSoup: e-learning blog, elearning blog, knowledge management, e-learning strategy, learning experience design, usability linked to this post on July 18, 2007

    [...] An introduction to Yahoo Pipes – Simplehelp Yahoo describes Pipes as “an interactive data aggregator and manipulator that lets you mashup your favorite online data sources”. Alright, but what does that mean to the rest of us? (tags: rss tools mashup) [...]

  18. .:: ju ::. » links for 2007-07-19 linked to this post on July 19, 2007

    [...] An introduction to Yahoo Pipes – Simplehelp (tags: yahoo) [...]

  19. rascunho » Blog Archive » links for 2007-07-19 linked to this post on July 19, 2007

    [...] An introduction to Yahoo Pipes – Simplehelp (tags: http://www.simplehelp.net 2007 Yahoo_Pipes webservices mashup generator) [...]

  20. links for 2007-07-19 « toonz linked to this post on July 19, 2007

    [...] An introduction to Yahoo Pipes – Simplehelp (tags: yahoo pipes tutorial rss) [...]

  21. Best of Feeds - 41 links - blogging, humor, geek, lifehacks, facebook « Internet Duct Tape linked to this post on July 21, 2007

    [...] [RSS] An introduction to Yahoo Pipes (simplehelp.net, 341 saves, 31 inbound links, 522 diggs) [...]

  22. tech.twomadgeeks.com » Blog Archive » An introduction to Yahoo Pipes linked to this post on July 21, 2007

    [...] Link: Simplehelp [...]

  23. Pan Admun Republic of Western Blog linked to this post on August 7, 2007

    Mashup with Yahoo Pipes

    Saw this introduction on Yahoo Pipes and decided to try it out.

    A mashup is created from a GUI that one can drag and drop components to construct the logic (aka programming…).

    A user…

  24. Double Bang, Triple Pew (SFW, I Swear!) « citizen geek linked to this post on August 8, 2007

    [...] Introduction to Yahoo Pipes. [...]

  25. nerdybird.org » digg newly popular 1-30days linked to this post on August 9, 2007

    [...] (at least once) How To Easily Handle the Digg Effect With Your Blog Please Crash my HTTP server. An introduction to Yahoo Pipes Linux: Using ionice to make disk IO more responsive when multitasking Back up like an expert with [...]

  26. An introduction to Yahoo Pipes « Programming News linked to this post on October 15, 2007

    [...] read more | digg story [...]

  27. Search Engine Marketing » Blog Archive » Yahoo! Search Blog: Yahoo! Pipes out Questions from Answers (News feed) linked to this post on October 30, 2007

    [...] An introduction to Yahoo Pipes – SimplehelpYahoo describes Pipes as an interactive data aggregator and manipulator that lets you mashup your favorite online data sources . Alright, but what does that mean to the rest of us? [...]

  28. My Hobby is Programming » An introduction to Yahoo Pipes linked to this post on November 20, 2007

    [...] read more | digg story [...]

  29. Making a specialized RSS feed for all your social media coverage / True North Media House – Social Reporting from Vancouver 2010 linked to this post on January 25, 2010

    [...] SimpleHelp.net: An introduction to Yahoo Pipes [...]



Some HTML is OK

or, reply to this post via trackback.