2026-07-30 08:54 UTC
@soatok@furry.engineer whatever happened to good, old, human-driven scraping :/
Replies (2)
-
@jablkoziemne@101010.pl 2026-07-30 09:52
@cancername@mas.to @soatok@furry.engineer when I do scrape, I usually put 1-60 seconds sleep to not overwhelm the server, while running curl output directly to grep, and then to file, as thats enough for my recent needs.
-
@TheMNWolf@furry.engineer 2026-07-30 08:59
@cancername@mas.to @soatok@furry.engineer I remember the good old days when it was just web crawlers looking to add search results to a database.