I’m Smokin’ Pipes
• ∞
- aggregate 35 English language feeds
- aggregate a few Russian feeds AND translate them into English
- create a super-feed out of the union of the English and (previously) Russian feeds
- filter out all the feed items that don’t match my ‘wanted’ keywords (having to do with UFO sightings, the paranormal, etc)
- filter out all the feed items that DO match my ‘unwanted’ keywords (such as ‘illegal alien’, and ‘hoax’)
- sort the feed items by publication date descending
- remove duplicates based on the item’s link URL
- extract keywords from each item’s description, and append them to each item as an extra “keywords” attribute
- extract location information from each item’s content (mentions of cities, etc), translate it into latitudes & longitudes, and append them to each item as an extra “location” attribute
- publish it as a native-PHP array, for easy consumption by file_get_contents($url)
- Note: My pipe is automatically also available as RSS, JSON, & KML
I’m not even kidding. One Hour. It’s insane. There’s one little bug in it somewhere, having to do with ATOM feeds not having an item.description, but it still works. In fact, you can see it working here: - as an RSS feed - as JSON - as native PHP - as KML - embedded in Yahoo’s interface. Click the [LIST] tab.
Let me know what you think in the comments on this blog post!