Really interesting idea. I like the idea of blocking these crawlers, but I’d imagine blocking all Amazon-owned ip addresses would be damaging for federated apps, like Nextcloud and Mastodon. It would mean anyone who hosts one of these apps on Amazon servers won’t be able to interact with servers running this proposed app, right?
Also, here’s a related post: Prevent LLM scrapers/trawlers? - #12 by okam_rzr