Public
- Public
- Network
- Groups
- Popular
- People

Conversation

Notices

nixCraft 🐧 (nixcraft@mastodon.social)'s status on Sunday, 28-Apr-2024 00:57:42 JST nixCraft 🐧

Bad and freeloader behaviour
AnthropicAI. https://www.reddit.com/r/linux/comments/1ceco4f/claude_ai_name_and_shame/
In conversation about 7 months ago from mastodon.social permalink
Attachments
1. From the r/linux by user named MintAlone Title: Claude AI - name and shame I'm a mint user, regular contributor to the LM forum. Our forum went down today. Message from one of the mods when it was restored: Claude AI is a new AI chatbot by the company Anthropic. They're scraping websites to train their chatbot for free. They're doing it in a way that causes so much extra load on websites, it's effectively a DDos attack. Sometime yesterday their "ClaudeBot" started scraping the forums and this caused very poor performance of the forums for several hours and ultimately led to an outage. ClaudeBot is now blocked at the firewall and forums performance should be back to normal. Went looking for Anthropic, found no way of contacting them to complain (you end up going in circles). So posted here, not that I expect it will make any difference to their behaviour. Update: To put it into perspective: over the same time period ClaudeBot caused 20 times as much traffic as the 2nd worst bot and 40 times as much as the 3rd worst bot. The traffic from all other bots combined was a blip in comparison. We've blocked several other bots in the past for doing the same as ClaudeBot but as you can see most bots aren't an issue.
  https://files.mastodon.social/media_attachments/files/112/343/998/751/025/229/original/fd775e423b15d563.png
2. Untitled attachment
- nixCraft 🐧 (nixcraft@mastodon.social)'s status on Sunday, 28-Apr-2024 01:59:45 JST nixCraft 🐧
  in reply to
  - Christian Quest 🌍
  - OpenStreetMap 🇫🇷
  @cquest @osm_fr any idea how to black list them? robots.txt? CIDR block?
  
  In conversation about 7 months ago permalink
- Christian Quest 🌍 (cquest@amicale.net)'s status on Sunday, 28-Apr-2024 01:59:47 JST Christian Quest 🌍
  in reply to
  - OpenStreetMap 🇫🇷
  @nixCraft got the same on @osm_fr discourse forum.
  They are now blacklisted, with others.
  
  In conversation about 7 months ago permalink
- Fubaroque (fubaroque@mastodon.social)'s status on Sunday, 28-Apr-2024 02:21:13 JST Fubaroque
  in reply to
  
  @nixCraft Interesting. I just decided that enough was enough and am now redirecting (301) ClaudeBot to large files filled with random bytes elsewhere om the web. 🤣
  Didn’t know it was scraping for AI. But I’m sure the “info” the get out of that will be useful to them. 🤭
  
  In conversation about 7 months ago permalink
- DamonHD (damonhd@mastodon.social)'s status on Sunday, 28-Apr-2024 04:29:00 JST DamonHD
  in reply to
  
  @nixCraft had to mail the press@ address to stop them re-checking every few seconds if I'd changed my mind about blocking them for effectively DoSing my site. Tech bros in a hurry...
  
  In conversation about 7 months ago permalink
- YurkshireLad (yurkshirelad@mastodon.social)'s status on Sunday, 28-Apr-2024 06:35:16 JST YurkshireLad
  in reply to
  
  @nixCraft it’s a shame you can’t return a random block of text instead of the page content.
  
  In conversation about 7 months ago permalink
- Michael Boelen (mboelen@mastodon.social)'s status on Sunday, 28-Apr-2024 08:15:51 JST Michael Boelen
  in reply to
  - Keith Hoodlet :verified: :donor:
  @nixCraft
  Yes, saw them as well on my end. Tried contacting them and not much of a response yet. We should feed them digital rubbish, so their products will output 🤡💩
  @securingdev
  
  In conversation about 7 months ago permalink

Public

Conversation

Notices

Feeds