URL Scraper Connections
Hello all.
It was brought to my attention that when logged into our company portal, a
new connection is opened to the web server for every channel that I have
created by URL scraper. Instead of opening 1 connection to the web server,
it creates many (21 for this particular portal).
The problem is that if 10 people are logging on at the same general time, we
now have 210 connections created to the server. What if I had 100 people log
in? You can see the problem. The system (and network hardware) would most
likely choke with this many connections being opened.
Has anyone ever run across this situation, and is there a solution?
Thanks,
Matt
[725 byte] By [
708770] at [2007-11-25 4:29:56]
Can you elaborate on this, when you refer to a web server are you referring to
the external webserver from where you are scraping content ?
how many channels do you have in total and where do you see the connections
being open ?
I know other sites using many channels with a bigger load and haven't seen this
problem anywhere ..
Karthik !
Matthew Shull wrote:
> Hello all.
>
> It was brought to my attention that when logged into our company portal, a
> new connection is opened to the web server for every channel that I have
> created by URL scraper. Instead of opening 1 connection to the web server,
> it creates many (21 for this particular portal).
>
> The problem is that if 10 people are logging on at the same general time, we
> now have 210 connections created to the server. What if I had 100 people log
> in? You can see the problem. The system (and network hardware) would most
> likely choke with this many connections being opened.
>
> Has anyone ever run across this situation, and is there a solution?
>
> Thanks,
> Matt
