Yahoo describes Pipes as “an interactive data aggregator and manipulator that lets you mashup your favorite online data sources”. Alright, but what does that mean to the rest of us? Yahoo Pipes uses an easy-to-understand visual editor that allows you to (among other things) take multiple RSS feeds, combine and filter them, and then output all of that information to one RSS feed.
This tutorial will take you through the steps to filter the content of one RSS feed (Techmeme) so that content you may have already read isn’t included in your Techmeme feed.
- To create a pipe you’ll a need a Yahoo account, so if you don’t have one, you might as well sign up now. Once you’ve signed in, visit http://pipes.yahoo.com. The default/blank Pipes layout will be presented.
- Get started by dragging Fetch Feed from the Sources list into the main module area. Enter the full URL to the RSS feed you want to customize. For this tutorial I’m using the Techmeme RSS feed, which is http://www.techmeme.com/index.xml
- To confirm the feed was loaded correctly, drag a line from the small circle at the bottom of the Fetch Feed module to the Pipe Output module. Then, drag the Debugger window into focus and click the Refresh link if nothing shows up right away. The Debugger window should fill with a list of the articles in the feed you added.
- Now we’ll filter out articles from the feed that we don’t want to include. From the Operations menu, drag the Filter module into the main workspace.
- Now link the Fetch Feed module to the Filter module (you can leave the Pipe Output module unconnected for now).
- In the Filter module, make sure that Block and Any are both selected. In the Rules area, select item.description. The item.description option is ‘created’ because Yahoo Pipes recognizes the “description” part of the Techmeme feed (see the bottom part of the screenshot below).
For this feed, I’m going to block out certain URL’s from the Techmeme feed, because I already subscribe to those sites RSS feeds, and I don’t want to waste time scrolling through the Techmeme feed on things that I’ve already ready. So the first URL I entered was http://gigaom.com. That will block out any Techmeme articles that originate from GigaOM.com.
- Click the + (plus) Rules button to create another rule, and repeat the steps above. Enter in the URLs to sites that you already read, and therefore don’t need to read again when they’re published in Techmeme. When you’re done, ‘drag’ the pipe from the Filter module to the Pipe Output module. Refresh the Debugger area and any articles that originate from a site that you’ve just added to your filter will be removed.
- If you’d like, you can also add a Sort module (from the Operations menu) into the mix. That way you can sort the feed articles by the date published etc. Make sure the final pipe goes from Fetch Feed to Filter to Sort and finally to Pipe Output. When you’re done, click the Save button in the upper-right part of Yahoo Pipes.
- Give your custom feed a name and click Save.
- To preview your “new” feed, click Run Pipe from the top (center) of Yahoo Pipes. Your feed will be previewed in a new browser window/tab.
- If you’re happy with the results, close the preview window/tab and click the Publish button (next to Save). Enter a description and some tags, then click Publish.
- To subscribe to your feed, go back to the Preview page and use the handy Subscribe drop down menu. You can save your feed directly to a number of the popular online feed readers, or just use the Get as RSS item to display your RSS feed URL.
- For Firefox users, the feed will be displayed in your browser. You can copy and paste the URL into any RSS reader you choose.
- You can find more Yahoo Pipes resources/tutorials here (and feel free/encouraged to add more to that list).
Excellent tutorial, it was a little daunting to use at first. It makes a lot more sense now, can use it to merge feeds together rather then subscribing to each one separately.
Great article, i will defenitly try this out.
Heh, the amusing thing is FIVE MINUTES AGO I put “check out pipes” on my todo list, have a look at their site and then see your post! Will give it a good read
Thanks for the tutorial.
Excellent article!
http://www.yahoopipes.co.uk
Hi,
I had tried yahoo pipes earlier but with not great resultys your article provides a very step by step approach.
Will give pipes a try again.
Vijay
Nice tutorial! Tip: Feedity’s RSS generator can be used for those data sources which don’t provide a syndication format like RSS to act as a Pipe’s input. There’s a video tutorial at http://jfiles2.googlepages.com/pipesFeedity.html … Feedity is an RSS generator for web pages without a web syndication format.
This tutorial shows off the Regex Module in Yahoo Pipes: http://theytookmystapler.blogspot.com/2007/09/yahoo-pipes-case-study-of-using-regex.html
Thanks for the great article. I will try this for sure.
Thanks for the great tutorial.. I was having a ton of problems.
Thanks for the great article. I will try this for sure.
Will give pipes a try again, after read this tutorial I wan try it again. Because, I had tried yahoo pipes earlier but with not great results.
Curios that i navigate all day long and i never knew about yahoo pipes.First time i hear about it;i will give it a try anyway and this tutorial will make it easier for sure.Thanks.
thanks for the info on yahoo pipes and very well explained.
greetings from Graphic Design Melbourne
I’m trying to import multiple feeds into my Facebook Notes. However Facebook only supports 1 external feed.
I have merged all my feeds into one via Yahoo! Pipes but Facebook doesn’t seem to work with it.
Is there another way?
The pipes program is great for rss feeds too. Im playing a bit on how to configure the best feeds.
Great tutorial, i will defenitly try this out!
Great post, thanks for sharing! Very useful…
Thanks for information, this is very useful…
Good help for those who are novice in this. I really like the article and all the points that you have provided here!
Awesome article, thanks for the share!
Really like this yahoo pipes application