Challenge background
Last year of High school in Egypt educational (Thanaweya Amma) system is a detrimental for students aiming for the best of the best universities to attend. Since the score in this single year is the entry card to those universities.
The problem
There are plenty of questions about the results of last year of high school that tingles our brains as a data scientists like:
- What schools have highest average?
- What city most care about math?
- Search for outliers in the scores.
Goal of the project
Every year about 600,000 students go into their high school. The results of the exams are publicly available on multiple websites. Find ways to collect the data, then we can:
- Learn about data ethics
- Answer questions through visualization
- Help new students choose their high school
Project timeline
- 1
Week 1
work with API: Learn how to send multiple http requests With web scraping at that scale we need to figure how to send plenty of requests to the server without triggering DoS preventions systems
- 2
Week 2
Web scrape the results: Learn about web scraping libraries Web scraping is the process of using scripts to extract content and data from a website. We get to interact with libraries like beautifulsoup and selenium
- 3
Week 3
Visualize to answer our questions : Visualization is a powerful tool Using charts or graph to convey meaning is simple yet so informative and to deliver you insights correctly data scientists need to master Visualization techniques
- 4
Week 4
Deliver the insights and finalize our research: we can use something like a web app so can deliver insights easily, and help students who lives in different cities what are the best schools to attend in terms of school average
What you'll learn
Working with APIs, Web scraping, EDA, data visualization