Home

Distributed Systems

Lectures

 

Assignments

CS 425 : ECE 428

Resources

          

Contact Course Staff

Fall 2020

 

 

Lectures Schedule(Final)

Note: Slides are marked as "Tentative" before the lecture. These slides are not authoritative until marked as "Final". Note that these slides may feature updates and fixes compared to the Coursera version.

Special Note for Fall 2020: Every week, students must view lecture videos BEFORE week begins (on campus students via Mediaspace, MCS Online/Coursera students via Coursera). Each lecture will briefly cover both topics for that week's listed lectures (brief recap, Q and A, Exercises). The 8/25 and 8/27 lectures are repeats of each other. From 9/1 (Tue) onwards, we will not be repeating sessions, but instead discuss different things in different sessions :

  1. Starting 9/1 (Tuesday): i) Tuesday and Thursday sessions will discuss different topics (not repeats), and ii) you can attend both sessions (we recommend it, if you can!).
  2. (invalid after 8/27) If your last name starts with A-L, please attend the Tuesday lecture.
  3. (invalid after 8/27) If your last name starts with M-Z, please attend the Thursday lecture.
  4. These apply to both "on-campus" and MCS-Coursera registered students.


All class sessions are recorded. By participating in the course and joining Zoom, you are consenting to the recording.

Lecture Videos (view before class session): [Mediaspace] (On-campus Students only, MCS Online Students should watch the Coursera video lectures)

Zoom Class Session Recordings: [Mediaspace] (All Students: On-campus Students, MCS Online)



 

 

 

Lecture # Category Date  Lecture Name  Readings

Slides and Lecture Videos

HWs and MPs, Etc.
1 Welcome! 8/25
 Introduction Relevant parts of Chapter 1.
FA20: This Week's Discussion Topics: L1-L3 (Li is Lecture # i - see Lecture #s on leftmost column)

 

HW1 out, MP0 out

2
 Clouds 8/27
 Introduction to Cloud Computing

 

3
   9/1
 Introduction to Cloud Computing (Contd.) FA20: This Week's Discussion Topics: L1-L4

 

  • See previous lecture for Lecture videos
  • Zoom session Video (Tue 9/1) (Note: Video starts after a few minutes, but doesn't miss anything new, i.e., everything discussed before the recording started (i.e., part of the recap) are already in Video Lectures.)
4
9/3
 Mapreduce/Hadoop
  • [ppt] [pdf] (Final)
  • [Mediaspace Video Lectures A,B,C,D] - View in order (A-D) BEFORE class session
  • Zoom session Video (Thu 9/3) (Note: There was a recording issue, and recording started only after several minutes, but doesn't miss anything new, i.e., everything discussed before the recording started (i.e., part of the recap) are already in Video Lectures.)
 MP0 groups due
5
 Classical Distributed Algorithms
 9/8
 Gossip
 Section 18.4 (Relevant Parts)
FA20: This Week's Discussion Topics: L5-L6		 MP1 out 9/4
6
9/10 Failure Detectors and Membership, Grids
 Section 15.1 and relevant parts of Section 2.4.2
Further readings (papers):

 

 

 

 
7
9/15 P2P Systems Paper - "Gnutella Protocol Specification"
FA20: This Week's Discussion Topics: L7-L8

 
8
9/17 P2P Systems (II) Paper - "Chord" (Sections 1-4, 6-7)
9
9/22 Key-value Stores/NoSQL
FA20: This Week's Discussion Topics: L9-L11 		HW1 due 11 am Central,
HW2 out
10
9/24 Key-value Stores/NoSQL (Contd.)
(See above for lecture video) Zoom session video (Thu 9/24) MP1 due 11.59 PM 9/27, MP1 demos on 9/28 (Mon)
11
9/29 Key-value Stores/NoSQL (Contd.)
FA20: This Week's Discussion Topics: L12-L13 		(This week we will focus on the topic of "Time and Ordering" and "Consensus+Paxos") MP2 out
12



10/1 Time and Ordering Sections 14.1-14.4
13



Classical Distributed Algorithms
 10/6
 Paxos and Consensus

Paper-"Impossibility of Distributed Consensus" (sections 1-3 only), and Section 15.5.2.

This lecture (including FLP proof) is mandatory, NOT optional for all students (all sections of class).

Section 17.3.1, 21.5.2 (Paxos sections)

FA20: This Week's Discussion Topics on Piazza: L12-L24




Note: All material in this lecture, including FLP proof, is mandatory, regardless of what the video says (ignore "optional" mentions).

HW2 due 11 am Central
14
10/8 Snapshots Section 14.5
15   10/10/20 (Saturday) 8 AM US Central - 10/13/20 (Tuesday) 8 AM US Central (Details are posted on Piazza) MIDTERM EXAM (All students except MCS-DS/DSO must take online midterm on these days/times.) (No conflicts given for travel, interviews, course double booking. Conflict requests must be received 2 weeks before, and ack-ed by instructor.)

Syllabus: For all students except MCS: All lecture material from Lectures 1-12, and all HWs1-2.

For MCS Coursera students: All material in Weeks 1-5, including lectures, Coursera quizzes and exams, HWs 1-2, Coursera MP1.

Exam will be timed and offered on Gradescope. Exam will only be available from for a limited period, i.e., during the dates listed (more details coming soon). Exam will last 90 minutes. Please plan appropriately, and start early enough to finish on time!

 FA20: From 10/13 and onwards, there will be NO Zoom Live sessions (we might resume them later in November). All other aspects of the course remain unchanged (HWs, exams, assignments, Piazza, TA office hours). Indy will be available on Piazza to answer questions (but not in the Tue/Thu time). That is, the only change is that the Tue/Thu 11am-12.15pm sessions will not happen starting October 13th (until further notice). Enjoy your extra time, but please keep pace with the lecture videos on a week by week basis!
Midterm is individual work, and open-book/notes, but you cannot use the Web or collaborate with anyone else (it won't help either, so we recommend not wasting precious time surfing during the exam). Calculators ok. No cellphones or other devices allowed.
16
10/15 Multicast Communications Section 15.4 [ppt] [pdf] (Final) [Mediaspace Video Lectures A,B,C,D,E] HW3 out
17
10/20 Leader Election Section 15.3.
FA20: This Week's Discussion Topics on Piazza: L16-L18		 [ppt] [pdf] (Final) [Mediaspace Video Lectures A,B,C,D]
18
10/22 Mutual Exclusion Section 15.2 [ppt] [pdf] (Final) [Mediaspace Video Lectures A,B,C,D] MP2 due 11.59 PM 10/25, MP1 demos on 10/26 (Mon)
19 Concurrency and Replication
 10/27 RPCs and Marshalling, Concurrency Control
FA20: This Week's Discussion Topics on Piazza: L19-L22		 [ppt] [pdf] (Final) [Mediaspace Video Lectures A,B,C,D,E] MP3 out
20
 Concurrency and Replication 10/29 RPCs and Marshalling, Concurrency Control (II),



Sections 4.3, Relevant parts of Chapter 5, Section 16.{1, 2, 4},  17.{1, 2, 3, 5};



 See above

21
   11/3 (Election Day, Holiday. No lecture. If you're a US Citizen, please vote!) Stream Processing and Graph Processing in Clouds
FA20: No session on 11/3 (Voting Day). Go work on MP and HW! If you're a US Citizen and eligible to vote, go vote (please)!

[ppt] [pdf] (Final) [Streams], [Storm Demo] Mediaspace Video Lectures (two) +++

+++ [Graph Processing] Mediaspace Video Lectures (one) +++

+++ [Spark-ppt] [Spark-pdf] (Final) [Mediaspace Video Lecture (one)]

 

 


 

 
22   11/5 Replication Control
    Sections 18.1-18.3, 18.5 FA20: This week's Discussion Topics on Piazza: L19-L22
[ppt] [pdf] (Final)
[Mediaspace Video Lectures A,B]		  

23

  

 

 

Real Behaviors 

 






11/10




Structure of Networks

FA20: This Week's Discussion Topics on Piazza: L23-L26
[ppt] [pdf] (Final)
[Mediaspace Video Lectures (one) ]

HW3 due, HW4 out
24
 Back to Basics
 11/12
 Scheduling
[ppt] [pdf] (Final) [Mediaspace Video Lectures A,B,C]
25
 Old but Still Gold 11/17
 Distributed File Systems
 Chapter 12 (relevant parts).
FA20: This Week's Discussion Topics on Piazza: L23-L26, Leftovers.		 [ppt] [pdf] (Final)
[Mediaspace Video Lectures A,B] (View before class session)
26
11/19
 Distributed Shared Memory




Sensor Networks
 Sections 6.5 (relevant parts).

Optional: Chap 6 from Tanenbaum, Distributed Systems: principles and paradigms

[ppt-A] [pdf-A] (Final)
[Mediaspace Video Lectures (one)] (View before class session) +++

+++ [ppt-B] [pdf-B] (Final)
[Mediaspace Video Lectures (one)] (View before class session) +++


    11/24

 

 

THANKSGIVING BREAK - no class.

 

 

    11/26

 

 

THANKSGIVING BREAK - no class.

MP4 due 11.59 PM 11/29, MP1 demos on 11/28 (Mon)


  
27   12/1 Security


FA20: This Week's Discussion Topics on Piazza: L27-L28, Wrap Up

[ppt] [pdf] (Final)
[Mediaspace Video Lectures A,B,C] (View before class session)		 MP4 due 11.59 PM 11/29, MP1 demos on 11/30 (Mon)
28
Real Behaviors
12/3
Datacenter Disasters  - Case Studies
See links on slides
 [ppt] [pdf] (Final)
[Mediaspace Video Lectures A,B,C,D,E] (View before class session)

HW4 due
29 Onward 12/8 Wrap-up FA20: There IS a session this week! (Wrap up of course) [ppt] [pdf] (Final)
[Mediaspace Video Lectures (one)] (View before class session)
    12/12/20 (Saturday) 8 AM US Central - 12/15/20 (Tuesday) 8 PM US Central (Details are posted on Piazza - please read that post carefully! (@1089) )
 FINAL EXAM for all on-campus and MCS Online/Coursera students. (No conflicts given for travel, holiday travel, interviews, course double booking. Conflict requests must be received 2 weeks before, and ack-ed by instructor.)

Syllabus: For all students except MCS-DS: All lecture material from Lectures 1 through Lecture 29 (both inclusive), and all HWs1-4.

For MCS-DS students: All material in C3 Parts 1 and 2, including lectures, Coursera quizzes and exams, HWs 1-4, Coursera MP1, MP2.

Exam will be timed and offered on Gradescope. Exam will only be available during a window of a few days (see left column), similar to midterm exam. Exam will take 3 hours, but will be available for slightly longer (once you start). Please plan appropriately, and start early enough to finish on time! Please check Piazza for further instructions (@1089).

    Please check Piazza during your exam for updates. Apart from exam-related clarifications, there will be a blackout on Piazza during the exam days. Please check the Piazza Post for more details (@1089).
Final Exam is individual work, and open-book/notes, but you cannot use the Web or collaborate with anyone else (it won't help either, so we recommend not wasting precious time surfing during the exam). Calculators ok. No cellphones or other devices allowed.