Ask HN: What scraping libraries are being used by the big AI players? 3 points by Gooblebrai 4 hours ago
I imagine almost everything is being done using Puppeteer.