Nginx-ru mailing list archive (nginx-ru@sysoev.ru)
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Забанить поисковики
- To: nginx-ru@xxxxxxxxx
- Subject: Re: Забанить поисковики
- From: "Alexey Kovyrin" <alexey@xxxxxxxxxxx>
- Date: Mon, 7 Jan 2008 21:51:22 -0500
- Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; bh=F8X83CIt6btWEC5WIvPh4cKvWUFWpxoeWJfWEDMUDlk=; b=K8va/X9X63USo/r5GKHmsgbCreWmd8GJiWujuoy81p+zRzpiUciJVCJw9FHmRsi0sZ5pP3OzZi+XBElEvOfg1PrOTOah5i//5rm9OfawqDcWFVnt3/WHUcl7bdZmkCPm5txVHzRFMO2nmvKpd72WW9+5Vn+OwQN+WSe5hUyN09c=
- Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=MSaLG1uI5XEO/tkvdi0nXxRWZj5IRU4L+lONFM05v2ryIFRFNg8tGC6xVbklU1m3BczDBc3UVbC+ER5qgvtFBZL5pg5FpPWnoYxYbIm+bPJtoXG7yaTzITLcx+3TLqI40cLYwNZoERNquvzRePcj1d88VUz3gzvm5ud77vNQog0=
- In-reply-to: <4782BF5B.3070907@xxxxxxxxxx>
- References: <4782BF5B.3070907@xxxxxxxxxx>
У нас вот такое вот используется:
@@invalid_ua = [
/google/i,
/yahoo/i,
/slurp/i,
/msn.*bot/i,
/bot/i,
/detectURL/i,
/AcadiaUniversityWebCensusClient/i,
/Accoona/i,
/Apexoo/i,
/appie/i,
/crawler/i,
/spider/i,
/Bigsearch/i,
/Blaiz\-Bee/i,
/BlogBridge/i,
/Bloglines/i,
/Drupal/i,
/Teoma/i,
/inktomi/i,
/Infoseek/i,
/Scooter/i,
/Lycos/i,
/alexa/i,
/findlinks/i,
/Alltheweb/i,
/Exalead/i,
/Xenu/i,
/curl/i,
/wget/i
]
Еще есть список ипов поисковых ботов.
On Jan 7, 2008 7:10 PM, Nick S. Knutov <mail@xxxxxxxxxx> wrote:
>
> Хочу полностью избавить несколько server {} от поисковиков. У
> кого-нибудь есть готовые строчки с регекспами? Поделитесь пожалуйста,
> буду очень признателен.
--
Alexey Kovyrin
http://kovyrin.info/
|
