02-08-2008 04:48 PM - edited 03-10-2019 03:59 AM
Running version 6.0(3)E1 S297. Is there a specific signature that will recognize web crawler/scraper traffic? If not one already defined what in particular would I need to create a customer signature.
02-12-2008 01:15 PM
what kindt of traffic is this ? some p2p application ?
02-12-2008 02:57 PM
it would be http or https type of traffic
02-12-2008 03:03 PM
02-12-2008 03:32 PM
thanks, good link. I know about the custom signature configuration and will advise client to provide information from their web logs to asssit in an attempt to create a custom signature. It does not appear there are any pre-configured sigs. for "web crawler type traffic". I looked at what is available in version 6.0(3)E1 S315.
02-14-2008 07:23 AM
I have heard of people embedding hidden URL's in their HTML and then firing when something requests the resource. You could also create something based on requests per second.
02-14-2008 02:06 PM
hmm, sounds good. Would creating a sig based upon # of requests per second be in the custom signature documentation?
Discover and save your favorite ideas. Come back to expert answers, step-by-step guides, recent topics, and more.
New here? Get started with these tips. How to use Community New member guide