| Instructor Information | TA Information | TA Information | Course Information |
|---|---|---|---|
| Jon Clindaniel | Shiyang Lai | Allison Towey | Location: 1155 E. 60th Street, Rm. 295 |
| 1155 E. 60th Street, Rm. 215 | 1155 E. 60th Street, Rm. 222 | 1155 E. 60th Street, Rm. 222 | Monday/Wednesday |
| [email protected] | [email protected] | [email protected] | 3:00-4:20 PM (CT) |
| Office Hours: Schedule an Appointment Drop-In (No appointment needed): Friday 1:00-3:00pm |
Office Hours: Schedule an Appointment Appointment needed: Tuesday 9:20am-11:20am |
Office Hours: Schedule an Appointment Appointment needed: Wednesday 12:30pm-2:30pm |
Canvas Course Site |
Computational social scientists increasingly need to grapple with data that is too big and code that is too resource intensive to run on a local machine. Using Python, students in this course will learn how to effectively scale their computational methods beyond their local machines -- optimizing and parallelizing their code across clusters of CPUs and GPUs, both on-premises and in the cloud. The focus of the course will be on social scientific applications, such as: accelerating social simulations by several orders of magnitude, processing large amounts of social media data in real-time, and training machine learning models on economic datasets that are too large for an average laptop to handle.
Prerequisites: MACS 30111 and MACS 30112, or equivalent.
Each week in this course is focused on building a fundamental competency in scalable computing, with an emphasis on Computational Social Science research applications. All readings, assignments, and resources for each of the class sessions can be accessed on the Canvas course site. If you have any questions about the course content, you should post these questions in the Ed Discussion forum for the course, which can be accessed by clicking the "Ed Discussion" tab on the left side of the screen on the Canvas course site. For an overall schedule and syllabus for the course, as well as to access additional course-related files (which we will walk through in in-class activities), consult (and clone/fork) this GitHub Course Repository.
During regular class hours, we will meet for a mixture of lecture, group activities, and in-class coding exercises related to the topic for the day. Attendance and active participation in each of the class sessions is mandatory and is an important component of the final course grade. Students should prepare for each class by reading the assigned readings for the day ahead of class time. All readings are available online and are linked in the course schedule below (and in the corresponding weekly module on Canvas).
In order to practice scalable computing skills and complete the course assignments, we will provide free access to on-premise cluster computing resources, Amazon Web Services (AWS) cloud computing resources, and DataCamp. More information about accessing these resources will be provided to registered students in the first several weeks of the quarter.
Each week, we will release an assignment that is designed to give you a chance to further hone the skills you have learned in class. While there will be a total of 9 assignments, we will drop your lowest 2 assignment scores when calculating your final grade. Overall, these assigments are worth 70% of the overall grade. During our scheduled exam period in Finals Week, there will also be a cumulative final exam, which will count for 20% of the overall grade. Finally, attendance and participation will be worth 10% of the overall grade.
| Course Component | Grade Percentage |
|---|---|
| Assignments (Total: Best 7 of 9) | 70% |
| Final Exam | 20% |
| Attendance/Participation | 10% |
Grades are not curved in this class or, at least, not in the traditional sense. We use a standard set of grade boundaries:
- 95-100: A
- 90-95: A-
- 85-90: B+
- 80-85: B
- 75-80: B-
- 70-75: C+
- <70: Dealt on a case-by-case basis
We curve only to the extent we might lower the boundaries for one or more letter grades, depending on the distribution of the raw scores. We will not raise the boundaries in response to the distribution.
So, for example, if you have a total score of 82 in the course, you are guaranteed to get, at least, a B (but may potentially get a higher grade if the boundary for a B+ is lowered).
If you would like to be graded on a Pass/Fail (P/F) basis, send a private message to the course staff on the Ed Discussion forum before the Final Exam is administered. A total score of 75 and above in the class will qualify for a "P" in the class.
We expect all students to participate in each class session in person (having read all of the readings listed for the day ahead of class time). Your participation grade (10% of your overall grade in the class) will be based on your engagement and completion of in-class activities.
If, for whatever reason, you cannot attend a class session, send a private message to the course staff ahead of the class session on the class Ed Discussion forum. We will evaluate these requests on a case-by-case basis and assign an alternative assignment to make up participation credit for the day.
Unexcused Late Assignment Submissions will be penalized 10 percentage points for every hour they are late. For example, if an assignment is due on Wednesday at 11:59pm, the following percentage points will be deducted based on the time stamp of the last commit in your private GitHub assignment repository.
| Example last commit | Percentage points deducted |
|---|---|
| 12:00am to 12:59am | -10 percentage points |
| 1:00am to 1:59am | -20 percentage points |
| 2:00am to 2:59am | -30 percentage points |
| 3:00am to 3:59am | -40 percentage points |
| ... | ... |
| 9:00am and beyond | -100 percentage points (no credit) |
If, for whatever reason, you need an extension on an assignment deadline, send a private message to the course staff ahead of the assignment deadline on the class Ed Discussion forum and we will evaluate these requests on a case-by-case basis.
Academic honesty is an extremely important principle in academia and at the University of Chicago.
- Writing assignments must quote and cite any excerpts taken from another work.
- If the cited work is the particular paper referenced in the assignment, no works cited or references are necessary at the end of the composition.
- If the cited work is not the particular paper referenced in the assignment, you MUST include a works cited or references section at the end of the composition.
- Any copying of work other than your own will result in a zero grade and potential further academic discipline.
- If we discover that you have shared or posted questions/solutions from any class assignments or exams in a public, online space, this will also result in a zero grade and potential further academic discipline.
If you have any questions about citations, references, or what constitutes plagiarism, consult with your instructor.
The University of Chicago is committed to diversity and rigorous inquiry from multiple perspectives. The MAPSS, CIR, and Computation programs share this commitment and seek to foster productive learning environments based upon inclusion, open communication, and mutual respect for a diverse range of identities, experiences, and positions.
Any suggestions for how we might further such objectives both in and outside the classroom are appreciated and will be given serious consideration. Please share your suggestions or concerns with your instructor, your preceptor, or your program’s Diversity and Inclusion representatives: Darcy Heuring (MAPSS), Matthias Staisch (CIR), and Chad Cyrenne (Computation). You are also welcome and encouraged to contact the Faculty Director(s) of your program.
This course is open to all students who meet the academic requirements for participation. Any student who has a documented need for accommodation should contact Student Disability Services (773-702-6000 or [email protected]) and the instructor as soon as possible.
| Week | Day | Topic | Readings | Assignment |
|---|---|---|---|---|
| Week 1: Introduction to Code Optimization and Parallelism | 3/20/2023 | Introduction to the Course + Code Optimization with Numba | A ~5 minute guide to Numba | |
| 3/22/2023 | Parallel Computational Thinking | Robey and Zamora 2021 (Chapter 1, through section 1.2) | ||
| Week 2: Distributed CPU-computing | 3/27/2023 | An Introduction to CPU Hardware and types of CPU Parallelism | Robey and Zamora 2021 (Chapter 1, sections 1.3-1.5), Read the mpi4py "Introduction" section (and optionally skim the "Overview" and "Tutorial" sections to familiarize yourself with the terminology) |
|
| 3/29/2023 | Cluster Computing via Message Passing Interface (MPI) for Python | (Re-)Read the mpi4py "Overview" and "Tutorial" Sections |
Due: Assignment 1 (11:59pm) | |
| Week 3: GPU-computing | 4/3/2023 | An Introduction to GPU Programming in Python | Read "The basics of CuPy" and Numba for CUDA GPUs "Overview". (Optionally) skim "CuPy Interoperability" and "Writing CUDA Kernels", "Writing Numpy-like ufuncs via CUDA Vectorize" (in comparison to using the @vectorize decorator on CPUs), and "GPU Reduction" |
|
| 4/5/2023 | Running Full Data Science Pipelines on GPU Clusters | "About RAPIDS", "10 Minutes to cuDF" | Due: Assignment 2 (11:59pm) | |
| Week 4: An Introduction to Cloud Computing and Cloud HPC Architectures | 4/10/2023 | Bursting HPC into the Cloud | Skim for a conceptual introduction to the Cloud (the specific technical details are outdated): Jorissen and Bouffler 2017 (Ch. 1, 4-7), Armbrust et al. 2009; Read for a vision of contemporary uses of AWS EC2 in Cloud HPC: HPC Architectural Best Practices (read the "General Design Principles" and "Scenarios" sections) | |
| 4/12/2023 | An Introduction to Boto3 and Serverless HPC | Jonas et al. 2019, "What is AWS Lambda", Boto3 Documentation (skim "Quickstart" and optionally "Code examples" to familiarize yourself with the syntax) | Due: Assignment 3 (11:59 PM) | |
| Week 5: Architecting Scalable Data Solutions in the Cloud | 4/17/2023 | "Data Lake" Architectures | Introduction to AWS Boto in Python (DataCamp Course, Ch. 1-2 and optionally 3-4; Practice working with S3 Data Lake in Python) | |
| 4/19/2023 | Scalable Database Solutions | "Which Database to Use When?" (YouTube), Optional: Data Warehousing on AWS Whitepaper, Big Data Analytics Options on AWS | Due: Assignment 4 (11:59 PM) | |
| Week 6: Engineering Pipelines for Data Ingestion and Processing | 4/24/2023 | Event-Driven Ingestion and Processing | "Scalable serverless event-driven architectures with SNS, SQS & Lambda" (YouTube) Optional: "Using Lambda with Amazon SQS", "Fanout to Amazon SQS Queues", "Using AWS Lambda with Amazon S3" |
|
| 4/26/2023 | Orchestrating large-scale parallel workloads with AWS Step Functions | "What is AWS Step Functions?" | Due: Assignment 5 (11:59 PM) | |
| Week 7: Introduction to Spark for Big Data Workloads | 5/1/2023 | Introduction to EMR and PySpark | "What is Amazon EMR?", "Use an Amazon EMR Studio", "What is Apache Spark?" (read the home page for a high-level overview of what Spark is) | |
| 5/3/2023 | Performing Exploratory Data Analysis at Scale with PySpark | Introduction to PySpark (DataCamp Course, ch. 1-2) | Due: Assignment 6 (11:59 PM) | |
| Week 8: A Deeper Dive into the Spark Ecosystem | 5/8/2023 | Machine Learning with PySpark | Introduction to PySpark (DataCamp Course, ch. 3-4) | |
| 5/10/2023 | Expanding the Spark Universe: SNA and NLP at Scale | Skim through the GraphFrames Documentation for Python and the Spark NLP Documentation | Due: Assignment 7 (11:59 PM) | |
| Week 9: Presenting Data and Insights from Large-Scale Data Pipelines | 5/15/2023 | Considerations for Visualizing Large Data | "What is Apache Zeppelin?", "Introduction to DataShader" | |
| 5/17/2023 | Building and Deploying (Scalable) Public APIs and Web Applications with Flask and AWS Elastic Beanstalk | Read "What is AWS Elastic Beanstalk?" and skim through the Flask "Forward" as well as the current documentation | Due: Assignment 8 (11:59 PM) | |
| Week 10: Finals Week | 5/25/2023 | Final Exam (3:00-5:00pm) | ||
| 5/26/2023 | Due: Assignment 9 (11:59 PM) |
"10 Minutes to cuDF." https://docs.rapids.ai/api/cudf/stable/user_guide/10min.html. Accessed 2/2023.
"A ~5 minute guide to Numba." https://numba.readthedocs.io/en/stable/user/5minguide.html. Accessed 3/2021.
"About RAPIDS." https://rapids.ai/about.html. Accessed 2/2023.
Armbrust, Michael, Fox, Armando, Griffith, Rean, Joseph, Anthony D., Katz, Randy H., Konwinski, Andrew, Lee, Gunho, Patterson, David A., Rabkin, Ariel, Stoica, Ion, and Matei Zaharia. 2009. "Above the Clouds: A Berkeley View of Cloud Computing." Technical report, EECS Department, University of California, Berkeley.
"Big Data Analytics Options on AWS." July 2021. AWS Whitepaper.
"AWS Elastic Beanstalk Developer Guide." https://docs.aws.amazon.com/elasticbeanstalk/latest/dg/Welcome.html. Accessed 3/2021.
Dalcín, Lisandro. "MPI for Python." https://mpi4py.readthedocs.io/en/stable/index.html. Accessed 2/2023.
"Data Warehousing on AWS." January 2021. AWS Whitepaper.
"DataShader Documentation." https://datashader.org/index.html. Accessed 3/2021.
"Fanout to Amazon SQS queues." https://docs.aws.amazon.com/sns/latest/dg/sns-sqs-as-subscriber.html. Accessed 3/2022.
"Flask Documentation." https://flask.palletsprojects.com/. Accessed 2/2023.
"Flask Forward." https://web.archive.org/web/20211106135422/https://flask-doc.readthedocs.io/en/latest/foreword.html. Accessed 2/2023.
"GraphFrames user guide - Python." https://docs.databricks.com/spark/latest/graph-analysis/graphframes/user-guide-python.html. Accessed 3/2020.
"HPC Architectural Best Practices." https://docs.aws.amazon.com/wellarchitected/latest/high-performance-computing-lens/general-design-principles.html. Accessed 2/2023.
Introduction to AWS Boto in Python. https://campus.datacamp.com/courses/introduction-to-aws-boto-in-python. Accessed 3/2020.
Introduction to PySpark. https://learn.datacamp.com/courses/introduction-to-pyspark. Accessed 3/2020.
Jonas, Eric, Schleier-Smith, Johann, Sreekanti, Vikram, and Chia-Che Tsai. 2019. "Cloud Programming Simplified: A Berkeley View on Serverless Computing." Technical report, EECS Department, University of California, Berkeley.
Jorissen, Kevin, and Brendan Bouffler. 2017. AWS Research Cloud Program: Researcher's Handbook. Amazon Web Services.
Petrossian, Tony, and Ian Meyers. November 30, 2017. "Which Database to Use When?" https://youtu.be/KWOSGVtHWqA. AWS re:Invent 2017.
Pirtle, Justin. December 8, 2020. "Scalable serverless event-driven architectures with SNS, SQS, and Lambda." https://www.youtube.com/watch?v=8zysQqxgj0I. AWS re:Invent 2020.
Robey, Robert and Yuliana Zamora. 2021. Parallel and High Performance Computing. Shelter Island, NY: Manning.
"Spark NLP Documentation." https://nlp.johnsnowlabs.com/. Accessed 3/2021.
"The basics of CuPy." https://docs.cupy.dev/en/stable/user_guide/basic.html. Accessed 2/2023.
"Use an Amazon EMR Studio." https://docs.aws.amazon.com/emr/latest/ManagementGuide/use-an-emr-studio.html. Accessed 2/2023.
"Using AWS Lambda with S3." https://docs.aws.amazon.com/lambda/latest/dg/with-s3.html. Accessed 3/2022.
"Using Lambda with Amazon SQS." https://docs.aws.amazon.com/lambda/latest/dg/with-sqs.html. Accessed 3/2022.
"What is Amazon EMR." https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-what-is-emr.html. Accessed 3/2020.
"What is Apache Spark?." https://spark.apache.org/. Accessed 2/2023.
"What is Apache Zeppelin?" https://zeppelin.apache.org/docs/0.7.3/index.html. Accessed 2/2023.
"What is AWS Lambda?" https://docs.aws.amazon.com/lambda/latest/dg/welcome.html. Accessed 3/2022.