Objective

To identify trends in participation and also scores in state-based datasets for SAT and ACT scores in years 2017-2019.

---

Datasets

• 2017 SAT Scores
• 2017 ACT Scores
• 2018 SAT Scores
• 2018 ACT Scores
• 2019 SAT Scores
• 2019 ACT Scores

These data give average SAT and ACT scores by state, as well as participation rates for the classes of 2017, 2018, and 2019.

Project structure

The import, data process, as well as modeling and visualizatons were all performed in python. The project directory is structured as follows:

project-global_warming_NLP
    
|__ a_data/
|__ b_codes/
|   |__ a_2017_data_cleanin.ipynb  
|   |__ a_2018_data_cleanin.ipynb 
|   |__ a_Merge_data.ipynb   
|   |__ b_EDA.ipynb
|   |__ c_VIZ.ipynb
|__ c_plots/
|__ Executive_slides_NLP_reddit.pdf
|__ README.md

The project was first run on a small dataset of only 50 imported posts, at the production stage, it was run on 20,000 posts.

---

Final cleaned DataFrame

The cleaned Dataframe has the following format:

• df_final is a pandas dataframe. Its entries are:

Feature	Type	Dataset	Description
state	object	sat_2017	The states where the sat exam was taken.
sat_2017_participation	float	sat_2017	The sat participation in units of percentage
sat_2017_read_write	integer	sat_2017	The sat grades for reading and writing
sat_2017_math	integer	sat_2017	The sat grades for math
sat_2017_total	integer	sat_2017	The total sat grades
act_2017_participation	float	act_2017	The act participation in units of percentage
act_2017_english	float	act_2017	The act grades for english
act_2017_math	float	act_2017	The act grades for math
act_2017_reading	float	act_2017	The act grades for reading
act_2017_science	float	act_2017	The act grades for science
act_2017_composite	float	act_2017	The act composite grades
sat_2018_participation	float	sat_2018	The sat participation in units of percentage
sat_2018_read_write	integer	sat_2018	The sat grades for reading and writing
sat_2018_math	integer	sat_2018	The sat grades for math
sat_2018_total	integer	sat_2018	The total sat grades
act_2018_participation	float	act_2018	The act participation in units of percentage
act_2018_composite	float	act_2018	The act composite grades
=======

EDA results

Recommendations

• It is crucial to focus on reading as much as on math skills.

• This importance is being shared between SAT and ACT outcomes.

• As participation is historic, if the board does not pay attention to low participations, history will repeat itself.