Working on some graphs after spending a lot of time poring over logs yesterday.
Падабаецца 0
Рэпосты 0
@monsieuricon I don't understand why there's so much scraping traffic. I assume it's AI bots which are mostly revisiting pages which have already been scraped, but why?
Падабаецца 0
Рэпосты 0
@jgrg there's no good answer for that. It's stupid. If these AI training bots were actually smart, they would just clone the underlying git repos and walk all commits. But we're not dealing with "smart" here -- we're dealing with companies throwing money and resources into the "win the AI race at all costs" hole, even if it creates a scorched earth environment in the end (both literally and figuratively).
Падабаецца 0
Рэпосты 🔁