mod_rewrite - Suay.Site

How to prevent search engines from indexing only the main page of the site

Posted by Alex On September 1, 2022

To prevent search engines from indexing only the main page, while allowing indexing of all other pages, you can use several approaches, depending on the characteristics of a particular site. 1. Using the robots.txt file If the main page has its own address (usually it is index.php, index.html, index.htm, main.html and so on), and while trying to open a link...

How to block access to my site from a specific bux site or any other site with negative traffic

Posted by Alex On August 21, 2021

There are situations when negative traffic comes from certain sites, for example, from bux sites or simply from sites that you don't like. In some cases, such traffic can be dealt with, but not always. Quite often, there are tasks like “go to a search engine, enter such and such a query, go to such and such a site” in...

How to protect my website from bots

Posted by Alex On August 19, 2021

In the article “How to block by Referer, User Agent, URL, query string, IP and their combinations in mod_rewrite” I showed how to block requests to a site that match several parameters at once – on the one hand, it is effective against bots, on the other – practically eliminates false positives, that is, when a regular user who is...

How to block by Referer, User Agent, URL, query string, IP and their combinations in mod_rewrite

Posted by Alex On May 28, 2021

As part of the fight against the influx of bots to the site (see the screenshot above), I had to refresh my knowledge of mod_rewrite. Below are examples of mod_rewrite rules that allow you to perform certain actions (such as blocking) for users who meet a large number of criteria at once – see the most recent example to see...