Skip to content

Latest commit

 

History

History
146 lines (102 loc) · 7.77 KB

README.md

File metadata and controls

146 lines (102 loc) · 7.77 KB
Raw

Data Processing in Python (JEM207)

Link to the 1st seminar

The course site for the Data Processing in Python from IES. See information on SIS. The course is taught by Martin Hronec, Vítek Macháček and Jan Šíla.

Date Topic who Project HW
29/9 Intro, Jupyter, Git (+ GitHub) Martin
6/10 Strings, Floats, Lists, Dictionaries, Functions Jan HW 1
12/10 Seminar (Git) Martin HW 0
13/10 Numpy, Pandas, Matplotlib Jan HW 2
20/10 Object-Oriented Programming Jan HW 3
26/10 Seminar Jan
27/10 HTML, XML, JSON, requests, APIs, BeautifulSoup Vitek
3/11 IES Web Scraper Vitek HW 4
9/11 Seminar Vitek
10/11 Advanced Pandas Vitek HW 5
17/11 State Holiday --
23/11 Seminar - MIDTERM full house
24/11 Introduction to Databases Jan Project Topic Proposal HW 6
1/12 Efficient Computing Martin
7/12 Parallelization Martin
8/12 Seminar Martin Project Topic Approval
15/12 Guest Lecture + Python BEER TBD
21/12 Project Work 2 (Seminar) full house Work-in-progress
22/12 Project Work 2 full house Work-in-progress

Course requirements

The requirements for passing the course are DataCamp assignments (5pts), the midterm (25pts), work in-progress-presentation (10pts), and the final project - including the final delivery presentation (60pts). At least 50% from the DataCamp assignments and work-in-progress presentation is required for passing the course.

Final project (60%)

  • Students in teams by 2
  • The task is to download any data from API or directly from the web. These data should be processed and visualized in the Jupyter Notebook, with auxiliary scripts consisting of functions and classes definitions as .py files. The project should be submitted as a GitHub repository.
  • The selection of the data is up to the students. (Conditional on our approval.)
  • Git collaboration as a proof of collaboration of both students.
  • More details during the lecture.

See example project from the previous semesters here from last year.

Project work - presentation (10%)

  • Presentation of work-in-progress related to the final project.

Midterm exam (25%)

23/11. Live coding (80 minutes), "open browser", no collaboration between the students. More details during the lecture week before

DataCamp Assignments (5%)

3 assignments out of assignments 1-6 submitted on time is required.

Assignment 0 - Submission on 12/10 (Introduction to Git)

  • Compulsory. Git is hard and you will need it throughout the course.

Assignment 1 - Submission on 06/10 (Introduction to Python Course)

  1. Python Lists
  2. Python Basics
  3. Function and Packages

Assignment 2 - Submission on 13/10 (Manipulating DataFrames with pandas)

  1. Numpy
  2. Extracting and Transforming Data
  3. Advanced Indexing

Assignment 3 - Submission on 20/10 (Object-Oriented Programming in Python)

  1. Getting ready for object-oriented programming
  2. Deep dive into classes and objects
  3. Fancy classes, fancy objects

Assignment 4 - Submission on 3/11 (Web Scraping in Python Course)

  1. Introduction to HTML
  2. XPaths and Selectors
  3. CSS Locators, Chaining, and Responses

Assignment 5 - Submission on 10/11 (Merging DataFrames with pandas Course)

  1. Concatenating and merging data
  2. Rearranging and reshaping data
  3. Grouping data

Assignment 6 - Submission on 24/11 (Importing Data in Python (Part 2) Course)

  1. The Intro to SQL for Data Science (full course)

Recommended DataCamp Courses

Tools

Introduction to Git for Data Science

General Python

Introduction to Python

Intermediate Python for Data Science

pandas

pandas Foundations

Manipulating DataFrames with pandas

Merging DataFrames with pandas

Cleaning Data in Python

Web Data Formats

Importing Data in Python (Part 1)

Importing Data in Python (Part 2)

Web Scraping with Python

Data Visualizations

Introduction to Data Visualization

Interactive Data Visualization in Bokeh

SQL

Introduction to SQL for Data Science

Introduction to Databases in Python

Prerequisities

Econometrics II. (JEB110) is an explicit prerequisite for bachelor students.

The course is designed for students that have at least some basic coding experience. It does not need to be very advanced, but they should be aware of concepts such as for loop ,if and else,variable or function.

No knowledge of Python is required for entering the course.

Credits

Passing the course is rewarded with 5 ECTS credits.

A sneak peek

IES web parser.

Materials

Git

Pro Git book, Atlassian Git tutorials, Github resources for learning Git

Python

Resources from the official Python webpage

Documentations

Python, Pandas, Numpy, requests, BeautifulSoup and Matplotlib.