# Xiaofang - Machine Learning (Level 1) Pathway **URL:** \ **Category:** Machine Learning Pipeline (NLP) (CE) 2021\ **Created:** [June 30, 2021, 6:53pm UTC](https://stemaway.com/t/xiaofang-machine-learning-level-1-pathway/8602 "2021-06-30T18:53:00Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![xiaofang](https://d2nat51eddc6b4.cloudfront.net/letter_avatar_proxy/v4/letter/x/8a9e4e/32.png) [@xiaofang](https://stemaway.com/u/xiaofang)\ **Post date:** [June 30, 2021, 6:53pm UTC](https://stemaway.com/t/xiaofang-machine-learning-level-1-pathway/8602/1 "2021-06-30T18:53:00Z")
Technical Areas: - Familiarized myself with fundamentals of EDA - Learned how to navigate HTML and extract certain components of the website - Got more practice with scraping - extract text and dates - Basic Clean the Data and Analyze the data Tools: - Jupyter Notebook - BeautifulSoup, Spacy, Pandas, NumPy, CSV, Requests - Git / GitHub Soft Skills: - Navigating forums like stack overflow to find solutions to some errors - Demonstrating Code with team members Tasks Completed: - Scraped the messages from one of the boards into a CSV and removed the HTML tags - Basic data analysis - compared the relative lengths of the comments and graphed them (frequency of long/medium/short messages) - Basic data visualization ---
**Author:** ![xiaofang](https://d2nat51eddc6b4.cloudfront.net/letter_avatar_proxy/v4/letter/x/8a9e4e/32.png) [@xiaofang](https://stemaway.com/u/xiaofang)\ **Post date:** [July 30, 2021, 5:36pm UTC](https://stemaway.com/t/xiaofang-machine-learning-level-1-pathway/8602/2 "2021-07-30T17:36:38Z")
Module 1 **Concise overview of things learned:** **Technical area:** • Set up the Google Colab Environment • Set up the New local test Environment • Learned Basics of Machine learning • Learned Definition of Classification • Learned the basic of Logistic regression model • Learned Basics of NLP(by reading PDF) • Learned Web Scrapping(Selenium, Chrome driver, and beautiful soup) • **Tools:** Beautiful Soap, Selenium, Chrome driver, Github, Jupyter Notebook, Python • **Softskills:** Learned about Project Management **Achievement highlights:** Successfully set up a new test environment for the project Successfully use the tools selenium and Beautiful Soup to get data from the website.[https://www.discoursehub.com/](https://www.discoursehub.com/) **Detailed Statement of Tasks Completed:** 1 Use selenium and chrome driver to auto click the website 2 Locate to the section of the e-commerce 3 Use beautiful soup to collect data from the page. The data are the topic of the latest review of the e-commerce section. ---
**Author:** ![xiaofang](https://d2nat51eddc6b4.cloudfront.net/letter_avatar_proxy/v4/letter/x/8a9e4e/32.png) [@xiaofang](https://stemaway.com/u/xiaofang)\ **Post date:** [August 6, 2021, 11:57pm UTC](https://stemaway.com/t/xiaofang-machine-learning-level-1-pathway/8602/3 "2021-08-06T23:57:00Z")
Module 3 **Technical** - World Cloud - Logistic regression model - Random Forest Model - Xgboost Model - Recommender **Tools** jupyter notebook ,word2Vec **Achievement** understanding the new python package word2vec Successfully build three models ![word](https://d1xykt6w2ydx2s.cloudfront.net/original/2X/9/938ce28d5c1e33dfa26af5300fb40d079fe064d4.jpeg) **Challenge** The Accuracy of three models are not so good ---
**Author:** ![xiaofang](https://d2nat51eddc6b4.cloudfront.net/letter_avatar_proxy/v4/letter/x/8a9e4e/32.png) [@xiaofang](https://stemaway.com/u/xiaofang)\ **Post date:** [August 7, 2021, 1:05am UTC](https://stemaway.com/t/xiaofang-machine-learning-level-1-pathway/8602/4 "2021-08-07T01:05:53Z")
Module 4 **Technical** - Bert classification Model - Simple Transformers Library - Compare the various model results such as Bert and Random Forest **Tools** - Simple Transformer - Torch - Sklearn - Tokenizers **Achievement** Successful built Bert Classification Model ![bert](https://d1xykt6w2ydx2s.cloudfront.net/original/2X/c/caf5fdfabe88d7228066978de32e372381faf882.jpeg) **Challenge** Did not build a ML app ---
**Author:** ![xiaofang](https://d2nat51eddc6b4.cloudfront.net/letter_avatar_proxy/v4/letter/x/8a9e4e/32.png) [@xiaofang](https://stemaway.com/u/xiaofang)\ **Post date:** [August 20, 2021, 12:12am UTC](https://stemaway.com/t/xiaofang-machine-learning-level-1-pathway/8602/5 "2021-08-20T00:12:49Z")
**Module 1** **Concise overview of things learned:** **Technical area:** • Set up the Google Colab Environment • Set up the New local test Environment • Learned Basics of Machine learning • Learned Definition of Classification • Learned the basic of Logistic regression model • Learned Basics of NLP(by reading PDF) • Learned Web Scrapping(Selenium, Chrome driver, and beautiful soup) • **Tools:** Beautiful Soap, Selenium, Chrome driver, Github, Jupyter Notebook, Python • **Softskills:** Learned about Project Management **Achievement highlights:** Successfully set up a new test environment for the project Successfully use the tools selenium and Beautiful Soup to get data from the website.[https://www.discoursehub.com/](https://www.discoursehub.com/) **Detailed Statement of Tasks Completed:** 1 Use selenium and chrome driver to auto click the website 2 Locate to the section of the e-commerce 3 Use beautiful soup to collect data from the page. The data are the topic of the latest review of the e-commerce section.