Looking at most recent logs, there are still some scrapers that fall through the cracks, and reach my backend. They use residential IPs, and user agents I can't filter. Luckily, they don't put much pressure on my infra, but... I don't like them there.
The vast majority of them are interested in my forge, so I'm thinking about deploying #Anubis there, on some URLs that humans don't usually visit.
I don't like proof-of-work things, because they penalize the legit visitor too. But there's a point where the passive defenses do not scale anymore. I can still limit the damage, though. But I've got to do some serious log digging to figure out the patterns I can shove behind Anubis.
I will also have to figure out how often the same IP address is used. As in... can I set things up in a way that if the Anubis check fails, I temporarily route that IP into a maze?
Tired of this. Don't tell me to turn off privacy extensions. I just won't visit your site.
As my initial use case for #swad was to stop #AI #bots clogging my DSL upstream, and the #FreeBSD / #poudriere build logs they were downloading in gigabytes aren't secret at all (to the contrary, it can sometimes be helpful to share them when hunting down build issues in the community) I wonder whether I should add a module somewhat similar to #anubis[1] for "guest logins"? Might be a lot of work though...
Esta mañana al comentar los problemas de Wikimedia con el scrapping, un amigo programador me han hablado del proyecto Anubis https://github.com/TecharoHQ/anubis/
"Es bastante sencillo y fácil de implementar en cualquier web medio seria, te cargas automáticamente cualquier scrapper (sea de IA sea de lo que sea). Además, no pueden inventar nada que haga que sea rentable el scrapping con eso puesto." #aiscraping #aiscrapers #wikimedia #anubis #iahastaenlaputasopa
New advanced #FIN7's #Anubis #backdoor allows to gain full system control on #Windows
https://securityaffairs.com/176134/malware/new-advanced-fin7s-anubis-backdoor-allows-to-gain-full-system-control-on-windows.html
#securityaffairs #hacking #malware
Anubis: self hostable scraper defense software
Weigh the soul of incoming HTTP requests using proof-of-work to stop AI crawlers
@cadey My thoughts on #Anubis after encountering it multiple times as a user:
* mascot is nice, creative and intuitive to understand
* as a user of tor it works! cloudflare and others reject me as a bot, but anubis left me through, thank you
* onion services do not require anubis protection, though, right? Since they have their own proof of work system integrated by default …
https://blog.torproject.org/introducing-proof-of-work-defense-for-onion-services/
… equi-x function based on what Tor uses?
https://pony.social/@cadey/114236263848292147
Web scrapers run by LLM companies have become so aggressive that some website operators feel a need to use Anubis, a proof-of-work barrier using script in the browser. I'm told it's less bad than blocking entire countries or making your readers find all the traffic lights.
https://anubis.techaro.lol/
@fijxu Thank you so much for using a proof-of-work #captcha https://nadeko.net/announcements/invidious-and-the-bot-problem/ instead of centralised proprietary mass #surveillance aka Google/CloudFlare!
You're a hero.
Anubis: Proof-of-work proxy to prevent AI crawlers
The Tomb Of Eternal Dread
An Egyptian pharaoh and Anubis in an ancient tomb, illuminated by torches, creating a mystical and ancient atmosphere with blue and brown tones.
Tonight's #Gemini #FirstQuarter moon is the lunar phase we call the #Jackal Moon in #Antinous #MoonMagic which enhances your ability to sniff out danger, hear the faintest plea for help and lead others out of darkness like #Anubis: https://antinousstars.blogspot.com/2025/03/the-antinous-jackal-moon-gemini-first.html
Pink #Agate enhances cunning/acumen for tonight's #Gemini #FirstQuarter moon, which we call the #Antinous #Jackal Moon of #Anubis-like guidance through darkness to light, says #Antinous priest and registered crystals advisor #MartinCampbell: https://antinousstars.blogspot.com/2025/03/pink-agate-for-jackal-moon-by-our.html
@GeopJr I though it's a shitpost, but no: Gnome's GitLab is protected by an anime girl!