World Library  
Flag as Inappropriate
Email this Article


Article Id: WHEBN0014848473
Reproduction Date:

Title: WebFetch  
Author: World Heritage Encyclopedia
Language: English
Subject: Atom (standard), NewsML, NewsML 1, WinnowTag, Outline of Perl
Collection: Atom (Standard), News Aggregators, Perl Modules, Unix Internet Software, Web Software
Publisher: World Heritage Encyclopedia


WebFetch is a set of Perl 5 modules written by Ian Kluft from 1998 through 2009 that provides a framework for retrieving information feeds from the Web, or posting a feed on a web site. It is intended to be run on a Unix or Linux server automatically, such as from cron. The current version 0.13 was released September 20, 2009. It is Open Source software, licensed under the GNU General Public License.[1]

WebFetch can collect various types of inputs via plugin modules and send or store them to various outputs also via plugin modules. Inputs include RSS, Atom, local news feed files, and perl data structures. Outputs include perl data structures, the Template Toolkit and pages in TWiki systems.[1]

Before there were RSS and Atom aggregation, WebFetch started with modules to retrieve news in ad hoc feed formats of various web sites, including Slashdot.[2]

WebFetch is available from the Comprehensive Perl Archive Network.[1] The following Perl modules are included with it.

  • WebFetch::Input::Atom - Atom feed reader
  • WebFetch::Input::PerlStruct - Perl structure input
  • WebFetch::Input::RSS - RSS feed reader
  • WebFetch::Input::SiteNews - local "site news" file reader
  • WebFetch::Output::Dump - perl structure dump output
  • WebFetch::Output::TT - Template Toolkit output
  • WebFetch::Output::TWiki - TWiki page output

The following Perl modules were based on ad hoc news formats from before RSS, and in some cases web scraping. They used to be provided with WebFetch in the past, but were deprecated and removed.[3]

  • WebFetch::CNETnews
  • WebFetch::CNNsearch
  • WebFetch::COLA
  • WebFetch::DebianNews
  • WebFetch::Freshmeat
  • WebFetch::LinuxDevNet
  • WebFetch::LinuxTelephony
  • WebFetch::LinuxToday
  • WebFetch::ListSubs
  • WebFetch::Slashdot
  • WebFetch::32BitsOnline
  • WebFetch::YahooBiz


  1. ^ a b c "WebFetch 0.13".  
  2. ^ "About SLASH: The Slashdot Code". Retrieved 2009-09-29. 
  3. ^ "The WebFetch Project". Retrieved 2009-09-30. 

External links

  • WebFetch Project Site
  • WebFetch Add-On for TWiki
This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.

Copyright © World Library Foundation. All rights reserved. eBooks from Project Gutenberg are sponsored by the World Library Foundation,
a 501c(4) Member's Support Non-Profit Organization, and is NOT affiliated with any governmental agency or department.