Conversation

Notices

1. nixCraft 🐧 (nixcraft@mastodon.social)'s status on Tuesday, 05-Mar-2024 18:03:26 JST nixCraft 🐧

   I'm getting an HTTP/429 error when trying to access the Wayback Machine (Internet Archive) over a VPN. For context, it's worth noting that the Wayback Machine has a history of not respecting the robots.txt standard, which can lead to a higher server load. But, now, they are blocking VPN and data center ranges. Lmao. Oh, this is such irony.

   • nixCraft 🐧 (nixcraft@mastodon.social)'s status on Tuesday, 05-Mar-2024 18:05:05 JST nixCraft 🐧

     in reply to

     Regardless of an organization's mission, it's essential that they adhere to the robots.txt standard. This standard exists to manage web traffic and prevent servers from being overloaded. All entities, non-profit or otherwise, should respect this protocol for the health of the wider internet ecosystem.

   • nixCraft 🐧 (nixcraft@mastodon.social)'s status on Tuesday, 05-Mar-2024 18:11:52 JST nixCraft 🐧

     in reply to

     • Martin A. Brooks :verified:

     @mart_brooks Sir, I only send one request. Just typed the URL. I'm not sending 100 requests per second. They are hiding blocking under HTTP/429 and pretending that I'm overloading their shity service. Also, I will give my hard-earned money to those who follow the robots.txt standard. I don't give shit about their mission. Follow the standard.

   • Martin A. Brooks :verified: (mart_brooks@mastod.no)'s status on Tuesday, 05-Mar-2024 18:11:53 JST Martin A. Brooks :verified:

     in reply to

     @nixCraft That's not blocking, it's throttling. I look forward to seeing your campaign to fund their improved CDN presence.

   • nixCraft 🐧 (nixcraft@mastodon.social)'s status on Tuesday, 05-Mar-2024 18:14:37 JST nixCraft 🐧

     in reply to

     I blocked them a long time ago while I was browsing my blog. For two reasons:
     a) They do not follow robots.txt
     b) When I die, I want my blog to die with me. That is my wish. I do not want some shity non-profit or for-profit to keep showing my words when I'm gone. That is why it is essential to follow robots.txt

     And yes, I'm in a bad mood today. So fuck off, IA and your shity org.

   • popey (popey@mastodon.social)'s status on Tuesday, 05-Mar-2024 18:17:09 JST popey

     in reply to

     @nixCraft That's a very, very weird stance. But your blog, your policy, I guess.

   • The Planet Repairman (theplanetrepairman@mastodon.social)'s status on Tuesday, 05-Mar-2024 18:22:57 JST The Planet Repairman

     in reply to

     @nixCraft

     You better not die. All my l337 skills I copied from your blog.

   • Gregory Vanderlaan (gregvan@mastodon.social)'s status on Tuesday, 05-Mar-2024 18:33:24 JST Gregory Vanderlaan

     in reply to

     @nixCraft I'm grateful that internet archive stores my words and pictures... Thanks... When I Die I want my words to live forever...

   • Gregory Vanderlaan (gregvan@mastodon.social)'s status on Tuesday, 05-Mar-2024 18:45:20 JST Gregory Vanderlaan

     in reply to

     @nixCraft a friend's website VANISHED because he failed to pay his bill...so I found all the Content on the Wayback Machine and Copied and Pasted it onto Google's BLOGGER... Where there is no bill to pay... https://gvan42.blogspot.com/2018/08/the-headwaters-forest-coloring-book.html