Re: Correctly dealing with bots and scrapers.

[Andrew Latham via NANOG <nanog () lists nanog org>]

Constantine

Good call there, I need to investigate the 404 responses to see if
there are any improvements to be made.

On Wed, Jul 16, 2025 at 11:22 PM Constantine A. Murenin
<mureninc () gmail com> wrote:
> On Wed, 16 Jul 2025 at 14:33, Andrew Latham via NANOG
> <nanog () lists nanog org> wrote:
> > related topic. Security Scans. Any requests for wordpress could be an
> > easy way to flag and block with fail2ban when wordpress is not in use.
>
> For WordPress and PHP, I think it's simply easier to catch the
> scenarios with a nginx config, and cheaply return errors from the
> front end webserver, without wasting any of the real backend
> resources.
>
> C.



-- 
- Andrew "lathama" Latham -
_______________________________________________
NANOG mailing list 
https://lists.nanog.org/archives/list/nanog () lists nanog org/message/MQLMECD52VCK5DLPFTGZ2YQDNMPOHWZQ/