Machine Learning- Level 1 Module 2 - Chris Tom

Technical Area:

  • I understand the ideas behind web scraping versus web crawling/spiders and am able to look at code and understand the ideas behind them.

Tools:

  • Scrapy
  • VS Code

Achievements:

  • Got Workspace up and running
  • Installed Scrapy elements + Folder

Tasks:

  • Chose a discoursehub forum (Amazon sellers)
  • Created a python program to scrape data using scrapy into a csv + json file
  • Currently am working on debugging- files are created but I think there is an issue with me getting the correct path or elements, leading to an empty file.