You were offered guest_accounts to handle the scraping internally by Zedeus, what you’re doing is a dick move scraping public instances for the data. Furthermore you apparently prevent access to people from poa.st but feel its ok to scrape their Nitter instance for data.
This used to be a thing back in the day, also doctors used to do home visits back up to the 50s-70s and carried basic drugs on them as well. One of the old timers in my town used to be a doctor that did home visits in Philly during this time frame and stopped doing it because he got beaten badly and robbed by a bunch of black people in who wanted his basic drugs. The same was true for what you’re talking about with locally stored drugs at the doctors office. They kept dealing with break-ins so it shifted to a “secure” location such as the pharmacies we have today.
In the most recent wave of looting here in Philly last month the first thing they went for was the pharmacies so they could sell the Percocets, Promethazine and other crap on the corners. The system you want only works in a high-trust society, everything in America has to be asshole-proofed now and its really irritating for honest people.
In my case they're not scraping a single account, they're scraping half of twitter via my instance, such simple regex options have never worked for me. One of the approaches brought up was to ban anything that wasn't containing a referrer from the site.
Welp, after autobanning anything that connected to the site for 8 hours the botnet is only increasing in speed. The access log moves so fast I cannot even begin to read it any longer.
I think its rather annoying that these cars don't exist any longer, these 500 dollar shitboxes were perfect for teenagers and early 20 somethings to buy and do their stupid shit with. "Oh you reversed into a power pole? Who cares the car isn't worth shit" Barely any zoomers have a car license and check craigslist and other sites like autotrader I can see why they don't bother, even 15 year old shitboxes with the hood smashed in costs 10-15k for some stupid reason.
@RustyCrab That requires skill and pragmatic thinking, its far easier for pajeet to slam together 90 different frameworks rather than be deliberate in his choices.
Oh I should also point out that these AI business are basically impossible to monetize properly, the current Silicon Valley approach is to give free access to the world and then data mine the content created for marketing purposes. Each additional user adds more costs to the business, just like the streaming companies such as Netflix. More hardware, more bandwidth, more staff to maintain them. I don't expect the current AI craze to last very long under current economic conditions, this stuff is going to get paywalled and likely just become niche products like Github's coding AI or that audio AI company that was making voices a while back. These companies will probably get industry contracts that carry them, but general purpose chat kinds like the one that popped up for Google and Bing searchs will fade off as its just a waste of money.
Having a local setup will benefit in the long run since models can be shared and software is portable.
It has a docker image and its just a matter of setting up nginx to host it. Nitter is very lightweight. I don't use the docker image because I wanted a few features that are just idling in the pull request queue.
You should never be using a public Nitter instance for RSS feeds, let alone the flagship Nitter instance, its bad form. Nitter takes all of 20mb of ram to run so if you wanted RSS feeds beyond one or two you really should run one yourself.