Get data from massive web crawling system
December 13th, 2005Amazon owns Alexa, and today Alexa is announcing a web service that allows developers to make special requests for content during Alexa's web crawls. The Wall Street Journal article gives the example of asking the crawler to help you identify new music files or images that have recently been posted to the web.
I'm interested in using the Alexa service to identify and track the number of links coming in to sites I am promoting (or competing with). The service is free for 10,000 requests a month and then there is a charge of $0.15 for each additional 1,000 requests, according to Paidcontent.org.
Last month I met the evangelist from Amazon's six other web services at a BYU event, including the amazing Mechanical Turk.
It's becoming more difficult to keep track of all the web services and APIs coming out from the major internet companies.
Who knows the best blog or web site that tracks all of these?
Posted in: Search Engine News
December 13th, 2005 at 17:15 PM
Here's a wiki page that tries to do that: http://wsfinder.jot.com/WikiHome
I bookmarked it some time ago, and it looks like it has increased in both volume of material and pagerank since the last time I gave it a visit. I hope that's what you were looking for.
December 13th, 2005 at 18:15 PM
Programmable Web has a long list of API's: http://www.programmableweb.com/apis
December 13th, 2005 at 19:00 PM
www.wsfinder.com has a great Wiki of 100+ public APIs. They also have a blog at http://wsfinder.typepad.com/.
December 15th, 2005 at 15:45 PM
http://mashable.com/
A great blog that tracks mashups and related topics.
December 15th, 2005 at 18:20 PM
[...] Other Thoughts If Everyone Had A Foundry - Seth Godin Get data from massive web crawling system - Paul Allen Alexa Allows Personal Search Development Alexa’s Crawler is Yours - Marc Eisenstadt Alexa’s search platform - Rajesh Jain [...]
December 28th, 2005 at 20:41 PM
Alexa Web Search Platform - It’s a Problem
There’s just one problem with the new Alexa Web Search Platform, which was recently introduced. Just one. Alexa charges money for it. It’s cheap. $1. In fact, that’s really cheap. The only reason it could be a problem is because of a...
Post new comment