Block many page requests

Peter Bille Larsen

Posted on 13/10/2011 10:05:40

Hi DW's

We have a client which has the problem, that the competitors trawls the webpage for info about prices, pictures and text information.
In that way the competitors can make a robot, and then match the daily prices in a very competitive market.

I was thinking about using IP filters, and then take some info about the pageviews from Analytics, but would there be a way to make a filter, which block several hundred pageviews within an hour?

Thanks
//Peter

Replies

David Matheson

Posted on 13/10/2011 10:47:20

My two pennies worth!

Be devious and don't exclude the competitors IP - they will notice and change it. Instead, based on IP filtration provide them with slightly higher prices for (most popular) products. Do this on some days and not others to further confuse them, and either they might not notice or they will start to doubt their own data mining techniques.

Not knowing the scope/size of the site I will leave you to figure out whether this is possible :-)

Peter Bille Larsen

Posted on 13/10/2011 11:33:02

Hi David,

That could be an option. :-) But I was looking for a way to block many request within a short interval.

I just looked into another client, and they have the "same" problem. A robot which makes 300 orders of 300 different products in 2 minutes.

could the filter be done in the system or should it be done on the server?

David Matheson

Posted on 13/10/2011 11:48:03

Hi Peter,
If the robot is actually making orders, then I would be asking my lawyers to look at this - cease and desist - as I believe one could argue that they are potentially stopping real customers making orders, providing your customer with extra work etc etc. Seem to remember a case where CimberAir employees booked kr 1 tickets in false names on Air Norwegian flights to the same destination (Billund). Once that hit the press, the practice stopped.

Peter Bille Larsen

Posted on 14/10/2011 13:06:51

hi David

The robot is not completing the order, I guess it could be a search engine robot.

But I was looking for the techinical approach. :-)

How could a lot of page request be tracked and filtered? Should it be done on the server? or in the administration?

Kevin Steffer

Posted on 03/11/2011 16:30:44

Hi Peter,

I was just wondering if the bot is EniroRedback?

Peter Bille Larsen

Posted on 03/11/2011 21:15:47

Hi Kevin

No when I trace the IP the trace says that the server is in Holland.
Half of the shops transactions in DIBS are reported as "suspicion of fraud", so I guess they are trying to hack the shop.
They have made just over 300 orders in 40 minutes one each 5-10 sec.

I have no idea wtf it is..

You must be logged in to post in the forum

Developer forum

Block many page requests

Replies