@f4grx that is true. They do have applebot, which seems to follow robots.txt, unlike scams like OpenAI and Perplexity, who ignores robots.txt completely despite getting caught redhanded multiple times https://www.heise.de/en/news/Crawler-without-limits-Perplexity-ignores-robots-txt-9770682.html