In the second half of the course, you will work on a group project in groups of two or three. The idea is to use the systems concepts learned in the course to accelerate and/or parallelize an ML workload. You can select the project topic yourself but you will have to discuss it with the instructors once to ensure that the scope is appropriate. An example project could be writing high performance Triton kernels for an existing ML workflow in your research. Another potential topic could be distributing a single GPU workload to multiple GPUs efficiently. Please reach out to the instructors if you need help coming up with project ideas.
The first deadline is a project proposal and group formation. You should turn in a 1-2 page PDF with the following sections.
The interim report is a short report (2-3 page PDF) detailing progress so far. You should have preliminary profiling/performance results in your interim report.
At the end of the semester, students will present their projects in class and submit a final report. The presentations will be in the last two weeks and each should be 12 minutes with 3-5 minutes for questions. The final report should be written like a research paper (introduction, background, methodology, results, etc...) in the NeurIPS format.
| Topic | Due on* |
|---|---|
| Group formation and project proposal | Mar 4 |
| Interim report | Apr 17 |
| Final presentation | May 6-13 |
| Final report and code | May 15 |
*All deadlines are at 11:59 PM.