writing a crawler (need to handle the authentication)

Greetings,

I'm pretty new to the subject and would appreciate if you could give me some pointers as to what technology to research and or a place with examples.

I'm trying to manage the authentication that the browser does seamlessly through cookies...

So far my code can go and load pages and parse them but whenever there is a password required it just can't do anything(I get the please login page instead of the actual data)... now I have the password and can see the cookies in the browser cache but how can I use this in my JAVA application?

Thanks very much.

David

[611 byte] By [David_Aa] at [2007-10-2 20:09:35]