The great strength of the internet is also its weakness: There is So! Much! Information! out there--so much, in fact, that it can become hard to access. And not everyone who publishes the same kind of ...

Journalists who have ignored repeated calls to learn how to code are in luck. ScraperWiki, a platform for extracting and analyzing data from the web, has launched a new set of tools for journalists ...

Scraping is an important tool for data journalists. Sometimes you are lucky, and can download your data or copy-paste them from a website. Bad luck; then the data journalist has to look for heavy ...

There’s gold in them thar’ Webs! Yes indeed, out there amongst the LOL Cats and dancing babies are thousands of Web sites with useful data just waiting to be exploited; but how to actually get it?

Looking over the scope of the Knight News Challenge, from its beginning to the winners announced this year, it’s clear data is king. From this year’s data-mining projects alone — whether inside the ...

A scraper is a program written to take content off of a webpage or other data source and turn it into some kind of usable format, usually an RSS feed or by entering it directly into a database.

This article was migrated from an old version of our website in 2025. As a result, it might have some low-quality images or non-functioning links - if there's any issues you'd like to see fixed, get ...

Software development company ScraperWiki has been handed a £175,000 grant to develop its offering which allows journalists and users to ‘scrape’ sites for public data. The grant from the Knight ...

This article was migrated from an old version of our website in 2025. As a result, it might have some low-quality images or non-functioning links - if there's any issues you'd like to see fixed, get ...