URL connection -- browser headers

Thread view:

Manivannan Palanichamy - 10 Aug 2007 17:27 GMT

Hi
I am writing a java url connection code to read a web page. The
intelligent web server denies the request (returns 500 error). Yes, I
know the reason -- the web server identifies my java client as a robot/
spam program. Is there any way to pass the browser headers like ,
Accept-Language: en ?
I know I can pass these using java socket, but is there anyway to
put these values in properties for URL connection?

--
Manivannan.Palanichamy (@) Oracle.com
http://mani.gw.googlepages.com/index.html

Reply to this Message

Andrew Thompson - 11 Aug 2007 01:07 GMT

...

>I am writing a java url connection code to read a web page.

URL?

>...The
>intelligent web server denies the request (returns 500 error). Yes, I
>know the reason -- the web server identifies my java client as a robot/
>spam program. Is there any way to pass the browser headers like ,
>Accept-Language: en ?

Sure, but why not ..
a) convince the site administrators to allow connections
from UA's that identify themselves as Java, or..
b) respect their wishes *not* to connect?

Signature

Andrew Thompson
http://www.athompson.info/andrew/

Reply to this Message

Arne Vajhøj - 11 Aug 2007 03:10 GMT

> I am writing a java url connection code to read a web page. The
> intelligent web server denies the request (returns 500 error). Yes, I
[quoted text clipped - 3 lines]
> I know I can pass these using java socket, but is there anyway to
> put these values in properties for URL connection?

URL url = new URL("http://www.foobar.com/");
HttpURLConnection con = (HttpURLConnection)url.openConnection();
con.setRequestProperty("User-Agent", "Mozilla/4.0 (compatible; MSIE
5.01; Windows NT 5.0)");

(this is emulating Windows 2000 and IE 5.0 - you may want something
more recent)

Arne

Reply to this Message

Manivannan Palanichamy - 11 Aug 2007 11:45 GMT

On Aug 11, 7:10 am, Arne Vajh?j <a...@vajhoej.dk> wrote:

> > I am writing a java url connection code to read a web page. The
> > intelligent web server denies the request (returns 500 error). Yes, I
[quoted text clipped - 13 lines]
>
> Arne

Cool and quick idea. Haven't tried it. but, thanks in advance.

--
Manivannan.Palanichamy (@) Oracle.com
http://mani.gw.googlepages.com/index.html

Reply to this Message

URL connection -- browser headers

Free Magazines