Technical Area:
- I understand the ideas behind web scraping versus web crawling/spiders and am able to look at code and understand the ideas behind them.
Tools:
- Scrapy
- VS Code
Achievements:
- Got Workspace up and running
- Installed Scrapy elements + Folder
Tasks:
- Chose a discoursehub forum (Amazon sellers)
- Created a python program to scrape data using scrapy into a csv + json file
- Currently am working on debugging- files are created but I think there is an issue with me getting the correct path or elements, leading to an empty file.