OT: Web automation tools

[William James McEachran]

On Tue, Oct 17, 2006 at 05:28:31PM -0400, Walter Vaughan wrote:
[snip]
> 
> I dunno, if you have to create a "bot" to get the info you need it seems 
> like
> you are treading close to violating some TOS either today or in the future.

Nope, not a problem. 

> The whole premise of SOA architectures is that it's supposed to fire 
> properly
> crafted XML in reponse to a properly crafted request.

Not the architecture involved here.

> The world is not a better place building a really gee-wiz cool screen 
> scraper.

Not screen scrapping ... navigating to a "Click here to download your file"
button. I know, it's convaluted.  I used to get these files via 1200 bps 
modem and a script.  I thought I could script this too, with cURL, but I
can't use cURL because of java applets in the page.
-- 
Bill McEachran