０７６萌ＳＮＳ
  • Login

  • Public

    • Public
    • Network
    • Groups
    • Popular
    • People

Add OpenAI, Google, and Common Crawl to your robots.txt to block generative AI from stealing content and profiting from it. Sample robots.txt

Download link

https://files.mastodon.social/media_attachments/files/111/150/376/103/641/549/original/ddfa3856f9b4263d.png

Notices where this attachment appears

  1. nixCraft 🐧 (nixcraft@mastodon.social)'s status on Saturday, 30-Sep-2023 05:44:51 JST nixCraft 🐧 nixCraft 🐧

    Add OpenAI, Google, and Common Crawl to your robots.txt to block generative AI from stealing content and profiting from it. See https://www.cyberciti.biz/web-developer/block-openai-bard-bing-ai-crawler-bots-using-robots-txt-file/ for more info and firewall to block those and other AI bots too.

    In conversation about a year ago from mastodon.social permalink
  • Help
  • About
  • FAQ
  • TOS
  • Privacy
  • Source
  • Version
  • Contact

０７６萌ＳＮＳ is a social network, courtesy of ０７６. It runs on GNU social, version 2.0.2-beta0, available under the GNU Affero General Public License.

Creative Commons Attribution 3.0 All ０７６萌ＳＮＳ content and data are available under the Creative Commons Attribution 3.0 license.