Technical Areas:
- Learned about EDA and how to perform it with the scraped data
- Learned and practiced scraping with Beautiful Soup and Selenium
Tools:
- Selenium
- BeautifulSoup
- Visual Studio Code
- Jupyter Notebook
Soft Skills:
- Understood the code examples from the webinars and resource pdfs on the module by going line by line
Highlights:
- Successfully scraped data from a Discourse community into a csv file with the help of scraper code examples from Sara
- Was able to analyze the csv file using Pandas
- I’m getting the hang of HTML formatting and some Python commands
Tasks:
- Scraped data from the forum and stored it all in a csv file, did some cleaning to remove HTML tags, and performed EDA
Problems faced:
- Spent a lot of time doing outside research on basic Python code since I haven’t worked with the language before