02-08-2008 04:48 PM - edited 03-10-2019 03:59 AM
Running version 6.0(3)E1 S297. Is there a specific signature that will recognize web crawler/scraper traffic? If not one already defined what in particular would I need to create a customer signature.
02-12-2008 01:15 PM
what kindt of traffic is this ? some p2p application ?
02-12-2008 02:57 PM
it would be http or https type of traffic
02-12-2008 03:03 PM
02-12-2008 03:32 PM
thanks, good link. I know about the custom signature configuration and will advise client to provide information from their web logs to asssit in an attempt to create a custom signature. It does not appear there are any pre-configured sigs. for "web crawler type traffic". I looked at what is available in version 6.0(3)E1 S315.
02-14-2008 07:23 AM
I have heard of people embedding hidden URL's in their HTML and then firing when something requests the resource. You could also create something based on requests per second.
02-14-2008 02:06 PM
hmm, sounds good. Would creating a sig based upon # of requests per second be in the custom signature documentation?
Find answers to your questions by entering keywords or phrases in the Search bar above. New here? Use these resources to familiarize yourself with the community: