minus-squarepurrtastic@lemmy.nztoTechnology@lemmy.world•TikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIlinkfedilinkEnglisharrow-up45·2 days agoIt’s not fine. They are not archiving the internet. I had to ban their user agent after very aggressive scraping that would have taken down our servers. Fuck this shitty behaviour. linkfedilink
purrtastic@lemmy.nz to Technology@lemmy.worldEnglish · 7 months agoUsers ditch Glassdoor, stunned by site adding real names without consentplus-squarearstechnica.comexternal-linkmessage-square2fedilinkarrow-up12arrow-down10
arrow-up12arrow-down1external-linkUsers ditch Glassdoor, stunned by site adding real names without consentplus-squarearstechnica.compurrtastic@lemmy.nz to Technology@lemmy.worldEnglish · 7 months agomessage-square2fedilink
It’s not fine. They are not archiving the internet.
I had to ban their user agent after very aggressive scraping that would have taken down our servers. Fuck this shitty behaviour.