When Your RSS Reader Gets Cloudflare-Banned: Diagnosing and Hardening a Feed Pipeline Against Bot Detection
The failure looked like nothing. No HTTP 500, no timeout exception, no DNS resolution error — just empty content coming back from a feed that had been working fine. Julia Evans’ blog had been a reliable source in LUMIS’s feed pipeline, and then one day it wasn’t, and the logs gave me almost nothing to work with. That’s the thing about Cloudflare blocking your bot: it doesn’t always slam a door in your face. Sometimes it just stops letting anything through and waits to see if you notice. ...