This post makes no effort to break apart the large DevOps undertakings of large-scale scraping instead, we'll cover how to delay that large undertaking by using the cheap consumer VPN Nord as an automated proxy rotation service. The energizing greenfield work and short MVP times are fun - until suddenly the architecture needs to scale. Small scale scraping is the bread and butter of growth-minded engineers. You could use the OpenVPN/Tunnelblick parts of this with other VPN providers, but the code and setup will not transfer 1:1. This post and my work are not sponsored by Nord. Tl dr: how to use a cheap personal VPN for scraping ( code here)Ĭost: $0 (+ NordVPN free trial or subscription of your choosing)
Tagged software, how-to, scraping, python, internal tools
0 kommentar(er)
