# Jianglu0725 - Machine Learning (Level 1) Pathway **URL:** \ **Category:** Machine Learning Pipeline (NLP) (CE) 2021\ **Created:** [June 14, 2021, 11:30pm UTC](https://stemaway.com/t/jianglu0725-machine-learning-level-1-pathway/8181 "2021-06-14T23:30:20Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![jianglu0725](https://d2nat51eddc6b4.cloudfront.net/user_avatar/stemaway.com/jianglu0725/32/4358_2.png) [@jianglu0725](https://stemaway.com/u/jianglu0725)\ **Post date:** [June 14, 2021, 11:30pm UTC](https://stemaway.com/t/jianglu0725-machine-learning-level-1-pathway/8181/1 "2021-06-14T23:30:20Z")
### Things Learned 1. Technical Area 2. Tool 3. Soft Skills ### Three achievement highlights 1. Gathering all my team members 2. Successfully scraping data from Discourse Hub website 3. Have a hands on practice on NLP ### Tasks Completed Process 1. Gathering members 2. Scraping data from Discourse Hub ---
**Author:** ![jianglu0725](https://d2nat51eddc6b4.cloudfront.net/user_avatar/stemaway.com/jianglu0725/32/4358_2.png) [@jianglu0725](https://stemaway.com/u/jianglu0725)\ **Post date:** [June 23, 2021, 1:39am UTC](https://stemaway.com/t/jianglu0725-machine-learning-level-1-pathway/8181/2 "2021-06-23T01:39:58Z")
## Week 2 Self-assessments ### Things Learned 1. Technical Area 2. Tool 3. Soft Skills ### Three achievement highlights 1. Successfully scraped data from [https://community.cartalk.com](https://community.cartalk.com) 2. Helped members with their technical problems 3. members got more involved in the team and were more active in taking responsibilities. ### Tasks completed process 1. scraping data - I took a look at the sample code. - I tried to run the sample code and run each function to get a closer look at their functionalities. - I applied a similar method, scraping the website we choose. The website we choose contains a bunch of information that takes a long time for the code to run. I tried to optimize the code and test out different categories. _ **Result** _ - I successfully scraping the data from the website. 1. Team Management ---
**Author:** ![jianglu0725](https://d2nat51eddc6b4.cloudfront.net/user_avatar/stemaway.com/jianglu0725/32/4358_2.png) [@jianglu0725](https://stemaway.com/u/jianglu0725)\ **Post date:** [July 20, 2021, 2:02am UTC](https://stemaway.com/t/jianglu0725-machine-learning-level-1-pathway/8181/3 "2021-07-20T02:02:39Z")
## Week 3 Self-assessments ### Things Learned 1. Technical Area 2. Tool 3. Soft Skills ### Three achievement highlights 1. have some findings after analyzing data 2. Helped members with their technical problems 3. Learnt several methods for data analysis ### Tasks completed process 1. Data cleaning 2. Team Management ---
**Author:** ![jianglu0725](https://d2nat51eddc6b4.cloudfront.net/user_avatar/stemaway.com/jianglu0725/32/4358_2.png) [@jianglu0725](https://stemaway.com/u/jianglu0725)\ **Post date:** [July 20, 2021, 2:29am UTC](https://stemaway.com/t/jianglu0725-machine-learning-level-1-pathway/8181/4 "2021-07-20T02:29:24Z")
## Week 4 Self-assessments This week we did our project presentation and Colin and Sara gave us a lot of advice. The main task this week was to improve the previous work as the previous part was a bit lacking. ### Things Learned 1. Technical Area 2. Tool 3. Soft Skills ### Three achievement highlights 1. Successfully scraped data from [https://community.cartalk.com](https://community.cartalk.com). This time we got around 6000 2. Almost every member was involved 3. We basically completed part of the data analysis ### Tasks completed the process 1. scraping data - I divide the whole group into 4 groups, each group completes data scraping for 1-2 categories. I do a data crawl of the largest and smallest category by myself. - Each team was given 2-3 days to capture the data - I applied a similar method, scraping the website we choose. The website we choose contains a bunch of information that takes a long time for the code to run. I tried to optimize the code and test out different categories. - I opened a separate Trello week4 board to monitor the progress of each group - We crawled almost 6000 more data than before 1. Team Management ---
**Author:** ![jianglu0725](https://d2nat51eddc6b4.cloudfront.net/user_avatar/stemaway.com/jianglu0725/32/4358_2.png) [@jianglu0725](https://stemaway.com/u/jianglu0725)\ **Post date:** [July 20, 2021, 2:52am UTC](https://stemaway.com/t/jianglu0725-machine-learning-level-1-pathway/8181/5 "2021-07-20T02:52:44Z")
## Week 5 Self-assessments ### Things Learned 1. Basic Recommender & Simple Classifiers 2. Tool ### Three Achievement highlights 1. Further Data analysis has new findings 2. Experiment with different data cleaning methods to improve model accuracy 3. Find the most suitable model for this data among multiple models ### Tasks completed the process 1. Data Analysis - The word cloud shows the words that appear in each group, and then delete them to observe the accuracy - There are a lot of links to images in the data, and these can affect our system 1. Data cleaning - In addition to the basic data cleaning based on the above two findings test data processing 1. Data Modeling - Testing the accuracy of different models under different data cleaning scenarios - Found logistic regression is the best