Reddit blocked all search engines including bing, DDG, and others, but because of the deal with Google, it is still making money and is the top destination for many Google searches. Here is robots.txt. They are blocking it because AI bots are scrapping and profiting from user-generated content. If you do this you will be dropped from Google immediately but now they have a deal with Google
Conversation
Notices
-
nixCraft 🐧 (nixcraft@mastodon.social)'s status on Friday, 26-Jul-2024 19:56:06 JST nixCraft 🐧 -
nixCraft 🐧 (nixcraft@mastodon.social)'s status on Friday, 26-Jul-2024 20:04:39 JST nixCraft 🐧 @gideonstar yes. I guess bing will ignore it if they want 😂
-
Stefan Ritter :verified: (gideonstar@mastodon.gideonstar.de)'s status on Friday, 26-Jul-2024 20:04:40 JST Stefan Ritter :verified: @nixCraft To be precise, a robots.txt does not block anything, it is only a guideline.
-
nixCraft 🐧 (nixcraft@mastodon.social)'s status on Friday, 26-Jul-2024 20:12:32 JST nixCraft 🐧 @piepants haha 🤣
-
Andrew Cook :hokkaido: (piepants@famichiki.jp)'s status on Friday, 26-Jul-2024 20:12:33 JST Andrew Cook :hokkaido: @nixCraft "Reddit believes in an open internet, but only when it benefits us financially."
Fixed that for them.
-
Kaito (kaito02@mastodon.social)'s status on Friday, 26-Jul-2024 20:55:18 JST Kaito @nixCraft "Reddit believes in an open internet" 🤮🤮🤮
-
Preston Is Not My Real Name (prestontumber@mastodon.social)'s status on Friday, 26-Jul-2024 22:16:08 JST Preston Is Not My Real Name @nixCraft man, we really, really need to replace Reddit. Especially in the age where search engines are useless for finding reliable stuff.
-
Parke (parke@mastodon.social)'s status on Saturday, 27-Jul-2024 08:24:13 JST Parke @nixCraft damn, fuck reddit.
-
Will (willa763@mastodon.social)'s status on Sunday, 28-Jul-2024 07:38:02 JST Will @nixCraft This is why Alphabet needs to be busted into a million pieces, alongside every big tech company in this country. It’s also why I long since left Reddit. Sad. I remember Reddit when it was a worthy service.
-
SeerIntelligence (seerintelligence@mastodon.social)'s status on Tuesday, 30-Jul-2024 06:04:31 JST SeerIntelligence @nixCraft Aaron swartz would like to have a word with them.
-