Home > SOA Tips > XML Developer > Beating the RSS crunch with aggregation/bloglines
SOA Tips:
EMAIL THIS
 TIPS & NEWSLETTERS TOPICS 

XML DEVELOPER

Beating the RSS crunch with aggregation/bloglines


Ed Tittel
10.20.2004
Rating: --- (out of 5)


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   


Those not intimately familiar with RSS, and the congestion problems caused by newsreaders that too-frequently poll for RSS feeds, might not have noticed the announcement on September 28, 2004, that Bloglines had created a set of APIs that developers could use to access their aggregated blog database. Not coincidentally, Bloglines announced the same day that blog- and newsreading software vendors FeedDemon, NetNewsWire and Blogbot have decided to use the Bloglines APIs in their popular desktop applications.

Understanding why this means something, and in fact what it means, requires some quick background. If you stop to think that many RSS readers poll ALL the Web sites from which their users have signed up for feeds, and that some do so by default as often as every 5 minutes, it's not hard to understand how a server with a popular collection of blogs could become overwhelmed with update requests both quickly and easily. In fact, some recent news reports (for example, the eWeek story from 9/20/2004 "RSS Comes with Bandwidth Price Tag") have stressed that smaller sites can get overwhelmed, and even the largest sites heavily taxed, by keeping up with RSS update polls. A current nerd joke in circulation even makes the point that a successful RSS site is indistinguishable from a distributed denial of service attack (because a whole bunch of clients around the Internet make heavy and simultaneous requests for service)!

What Bloglines does for RSS feeds is very much like what Google and Yahoo do for popular Web pages and information: they compile this content into their databases, so that accesses to frequently requested pages are satisfied from a local cache, instead of requiring the original server to handle yet another update or access request. If a user or a mirror site draws its RSS feeds from Bloglines instead of the original site, Bloglines can update its material quite frequently for a much lower bandwidth cost than if all sites and users who turn to Bloglines turned directly to those sites instead. Thus, blog aggregation databases hold an important key to keeping update RSS traffic manageable.

Furthermore, by publishing a freely available set of Web services APIs, Bloglines permits developers to create code that reads RSS and Atom (a related type of blog feed format, also based on XML) feeds straight from the Bloglines databases. A quick review of the Bloglines API documentation shows that this stuff is both simple and straightforward. In fact, there are only three small APIs in total:

  • Notifier API: used to gather a count of unread items in a Bloglines account (uses a single update function)
  • Sync API: used to access subscription lists and/or unread items (uses two functions: listsubs to retrieve subscription data on a per-account basis and getitems to retrieve blog entries on a per-subscription basis)
  • Blogroll API: used to incorporate subscription lists into other sites or applications. (Provides a mechanism to create lists of links to other blogs, using a single chunk of pre-defined HTML markup that loads a script from the Bloglines server.)

This is pretty simple stuff, and makes it easy for Web developers and site managers to add pretty spiffy blog support to their offerings. And it comes with one more additional and possibly substantial advantage: those who've messed with RSS (and to some extent, Atom) know that such feeds come in a variety of formats, each with its own little eccentricities and minor format and access variations. By grabbing feeds from Bloglines, you're guaranteed that all incoming feeds use the same, well-documented format and you can therefore promise to your users anything that Bloglines can deliver--and believe me, that's a lot!


Ed Tittel is a full-time writer and trainer whose interests include XML and development topics, along with IT Certification and information security topics. E-mail Ed at etittel@techtarget.com with comments, questions, or suggested topics or tools for review.


Rate this Tip
To rate tips, you must be a member of SearchSOA.com.
Register now to start rating these tips. Log in if you are already a member.




Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   



RELATED CONTENT
XML and XML schema
What's the future of XML?
SOA pattern of the week (#7): policy centralization
Try XML-based Extensible Business Reporting Language (XBRL) for accounting reports
What's new at the W3C
Ganymede: Modeling tools target SOA, UML
Data services mashups emerge for SOA
Making sense of data services mashups
XML turns 10
SOA helps save 100-year-old business
Oracle maps heterogeneous data services strategy for SOA

XML
National Weather Service policy supports XML
XML and democracy at work: The Election Markup Language (EML)
For interesting interface access, check out Xamlon
Royalty-free, revolutionary UBL
Altova strikes again with MapForce 2005
Voice, speech, SIP, and XML: ECMA-269
Microsoft Baseline Security Analyzer and XML
An open source, native XML database: dbXML 2.0
Second-generation XML security preview: SAML
XHTML IS a workable markup language, darn it!

SOA implementations
SOA implementation evolves from open source to Oracle SOA suite
U.S. Coast Guard adopts SOA and ESB to better track ships at sea
SOA Implementation: Should top down meet bottom up?
ESB watered down by EAI, but distinction remains
On the road to SOA – Part 1, Boubez on early insights
On the road to SOA – Part 2, Governance is fundamental
Sparx releases new SoaML profile for Enterprise Architect 7.5
SOA implementation: It's the increments, stupid
Bury SOA inside a larger architectural vision
Enterprise Architecture in the Agile age - Part 1, Styles of EA
SOA implementations Research

RELATED GLOSSARY TERMS
Terms from Whatis.com − the technology online dictionary
class diagram  (SearchSOA.com)
Fast Infoset (FI)  (SearchSOA.com)
GeoRSS  (SearchSOA.com)
Keyhole Markup Language  (SearchSOA.com)
RELAX NG  (SearchSOA.com)
state diagram  (SearchSOA.com)
Universal Business Language  (SearchSOA.com)
Vector Markup Language  (SearchSOA.com)
XML infoset  (SearchSOA.com)
XML pipeline  (SearchSOA.com)

RELATED RESOURCES
2020software.com, trial software downloads for accounting software, ERP software, CRM software and business software systems
Search Bitpipe.com for the latest white papers and business webcasts
Whatis.com, the online computer dictionary

DISCLAIMER: Our Tips Exchange is a forum for you to share technical advice and expertise with your peers and to learn from other enterprise IT professionals. TechTarget provides the infrastructure to facilitate this sharing of information. However, we cannot guarantee the accuracy or validity of the material submitted. You agree that your use of the Ask The Expert services and your reliance on any questions, answers, information or other materials received through this Web site is at your own risk.



SOA Trends and Strategy - SOA Education, SOA Development, SOA Implementations
About Us  |  Contact Us  |  For Advertisers  |  For Business Partners  |  Site Index  |  RSS
SEARCH 
TechTarget provides technology professionals with the information they need to perform their jobs - from developing strategy, to making cost-effective purchase decisions and managing their organizations' technology projects - with its network of technology-specific websites, events and online magazines.

TechTarget Corporate Web Site  |  Media Kits  |  Site Map




All Rights Reserved, Copyright 2001 - 2009, TechTarget | Read our Privacy Policy
  TechTarget - The IT Media ROI Experts