Crawling Your Way through the Web, One Hiss at A Time.
If you’re building a bot or trying to collect data from a website, web scraping is the way to go. Web scraping pulls text from website and lets you format and save the data in an easy format like json.
The easiest way to make your own web scraper is with python and the library scrapy. Scrapy has a great starter tutorial you can follow HERE to get started.