Cookie setting and the URL Scraper Channel
I'm trying to get the following URL to appear in a URL Scraper channel:
http://ticker.nasdaq.com/tkr/Tickerframe.asp
Unfortunately, I get an empty channel, with just a header and no content. In the iwtURLScraper debug log, I get the following message:
ERROR: HTMLFetcher.run(): invalid cookie: Set-Cookie: TICKER=T%7E%7EC%7CP%7E%7EtickerNasdaq100%7CS%7ESUN%7E%7E%7CS%7EG%7E%7E%7CS%7ET% 7E%7E%7CS%7EA%7E%7E%7CS%7EAOL%7E%7E; expires=Thu, 13-Mar-2003 05:00:00 GMT; path=/
java.lang.StringIndexOutOfBoundsException: String index out of range: -1
at java.lang.Throwable.fillInStackTrace(Native Method)
at java.lang.Throwable.fillInStackTrace(Compiled Code)
at java.lang.Throwable.<init>(Compiled Code)
at java.lang.Exception.<init>(Compiled Code)
at java.lang.RuntimeException.<init>(Compiled Code)
at java.lang.IndexOutOfBoundsException.<init>(IndexOutOfBoundsException.java :44)
at java.lang.StringIndexOutOfBoundsException.<init>(StringIndexOutOfBoundsEx ception.java:57)
at java.lang.String.substring(Compiled Code)
at com.iplanet.portalserver.providers.urlscraper.HTMLFetcher.run(Compiled Code)
The "Set-Cookie: TICKER=T%7E%..." stuff is the same contents of a cookie that this webpage sets on your desktop if access this URL via a browser. I have read the documentation and adjusted the settings for the following parameters:
Forward Cookie URL List: added http://ticker.nasdaq.com
Non Portal Server Cookie Management: selected yes
I've also tried various other combinations of these and other gateway settings to no avail.
Any help greatly appreciated. It gets frustrating when the "easy" things get difficult...
Thanks!
Erez.
