nanog mailing list archives
Re: Captchas on Cloudflare-Proxied Sites
From: William Kern via NANOG <nanog () lists nanog org>
Date: Wed, 2 Jul 2025 12:37:47 -0700
On 7/1/25 8:22 PM, Constantine A. Murenin via NANOG wrote:
But the bots are not a problem if you're doing proper caching and throttling.
Not all site traffic is cacheable or can be farmed out to a CDN. Dynamic (especially per-session) requests (think ecommerce) can't be cached.Putting an item into the shopping cart is typically one of the more resource driven events.
We have seen bots that will select the buy button and put items into the cart, possibly to see
any discounts given. You end up with hundreds of active 'junk' cart sessions on a small site
that was not designed for that much traffic.Forcing the bot (or a legit customer) to create yet another login to create a cart can help
but that generates push back from the store owner. The owners don't want that until
the payment details phase or they want purchasers to be able to do a guest checkout.
They will point that on amazon.com you don't have to login to put an item in the cart.
Rate limiting is not effective when they come from different ip ranges. The old days of using
a Class C (/24) as a rate limit key are no longer effective. The bots come from all over the providers space
(often Azure) but can be from any of the larger providers and often from different regions.
if you throttle EVERYONE then legit customers can get locked out with 429 or even 503s
And has been pointed out. Relying on the browser string is no longer effective. They use
common strings and change them dynamically. Sincerely, William Kern PixelGate Networks. _______________________________________________NANOG mailing list https://lists.nanog.org/archives/list/nanog () lists nanog org/message/3GYV3XRRRHNGRPCOXLYZR4SGYNNHKRWY/
Current thread:
- Re: Captchas on Cloudflare-Proxied Sites, (continued)
- Re: Captchas on Cloudflare-Proxied Sites Constantine A. Murenin via NANOG (Jul 01)
- Re: Captchas on Cloudflare-Proxied Sites Josh Reynolds via NANOG (Jul 01)
- Re: Captchas on Cloudflare-Proxied Sites Constantine A. Murenin via NANOG (Jul 01)
- Re: Captchas on Cloudflare-Proxied Sites Josh Reynolds via NANOG (Jul 01)
- Re: Captchas on Cloudflare-Proxied Sites niels=nanog--- via NANOG (Jul 02)
- Re: Captchas on Cloudflare-Proxied Sites Rich Kulawiec via NANOG (Jul 02)
- Re: Captchas on Cloudflare-Proxied Sites Constantine A. Murenin via NANOG (Jul 02)
- Re: Captchas on Cloudflare-Proxied Sites nanog--- via NANOG (Jul 06)
- Re: Captchas on Cloudflare-Proxied Sites niels=nanog--- via NANOG (Jul 07)
- Re: Captchas on Cloudflare-Proxied Sites nanog--- via NANOG (Jul 09)
- Re: Captchas on Cloudflare-Proxied Sites Constantine A. Murenin via NANOG (Jul 01)
- Re: Captchas on Cloudflare-Proxied Sites William Kern via NANOG (Jul 02)
- Re: Captchas on Cloudflare-Proxied Sites Constantine A. Murenin via NANOG (Jul 02)
- Re: Captchas on Cloudflare-Proxied Sites niels=nanog--- via NANOG (Jul 03)
- Re: Captchas on Cloudflare-Proxied Sites Constantine A. Murenin via NANOG (Jul 03)
- Re: Captchas on Cloudflare-Proxied Sites Rich Kulawiec via NANOG (Jul 06)
- Re: Captchas on Cloudflare-Proxied Sites William Herrin via NANOG (Jul 06)
- Re: Captchas on Cloudflare-Proxied Sites Dan Lowe via NANOG (Jul 07)
- Re: Captchas on Cloudflare-Proxied Sites Brandon Martin via NANOG (Jul 07)
- Re: Captchas on Cloudflare-Proxied Sites Dan Lowe via NANOG (Jul 07)
- Re: Cats vs Mice [CAPTCHAs on Cloudflare-proxied sites] nanog--- via NANOG (Jul 09)
- Re: Cats vs Mice [CAPTCHAs on Cloudflare-proxied sites] niels=nanog--- via NANOG (Jul 09)
