Department of Computer Science, Rutgers University
CS 545: Distributed Systems, Spring 2004

Instructor: Thu D. Nguyen, tdnguyen@cs.rutgers.edu
Lecture: Tuesday 2:50-5:50pm , CoRE A
Office hour: M 1-2pm , CoRE 326

Announcements

• Final grades have been officially submitted.  I'm pleased with the hard work that everyone put into this class.  Have a good summer.  For those who graduated, good luck!
• I have posted all the position papers and your reading/commenting assignment to WebCT, discussion topic "Project & Position Papers".  Please remember to read for Tuesday right after Spring Break.

Logistics

Project

Schedule

[Week 1: 1/20] Course organization

• Milestones: Look through topics and reading lists.  Choose papers to present.  Choose area you want to do project in.

[Week 2: 1/27] Internet services

• Readings:
• [von Behren 2002]
  
• [von Behren 2003] - presentation: Brian Russell
• For people needing some more background on Internet services, read [Brewer 2001], which is short but quite useful.
  

[Week 3: 2/3] Internet services

• Readings: [shen 2002], [Doyle 2003]

[Week 4: 2/10] Discuss project proposals

• Milestones: In-class presentation of preliminary project proposals for discussion and feedback.

[Week 5: 2/17] Replication and data consistency

• Milestones: Written project proposal due.
• Readings: [Terry 1998], [Yu 2000]

• Readings: [Chen 2002], [Brown 2003]

[Week 7: 3/2] Fault-tolerance and availability

• Readings: [Nagaraja 2003], [Kalbarczyk 1999]

[Week 8: 3/9] What's going on in my distributed system?

• Milestones: First position papers due.
• Readings: [Aguilera 2003], [Mahajan 2003]

[Week 9: 3/16] Spring recess

[Week 10: 3/23] Security

• Milestones: Discuss position papers and give each other comments.

[Week 11: 3/30] No class

• Milestones: Written project status report due.

• Milestones: Finish discussing position papers and discuss project status report
  
• Readings: [Garfinkel 2003], [Qie 2002]

[Week 13: 4/13] Security & Federated systems

• Readings: [King 2003], [Stoica to-appear], [Cuenca-Acuna 2003], 

[Week 14: 4/20] Federated systems

• Readings: [Fu 2003], [Bavier 2004]

[Week 15: 4/27] Present project results

• Milestones: Written project report due. In-class presentation of project.

Reading List

Internet services

[von Behren 2002] J. Robert von Behren, Eric A. Brewer, Nikita Borisov, Michael Chen, Matt Welsh, Josh MacDonald, Jeremy Lau, Steve Gribble, and David Culler.  Ninja: A Framework for Network Services. USENIX, 2002.

[von Behren 2003] Rob von Behren, Jeremy Condit, Feng Zhou, George C. Necula, Eric Brewer.  Capriccio: scalable threads for internet services.  SOSP, 2003.

[Shen 2002] Kai Shen, Hong Tang, Tao Yang, Lingkun Chu.  Integrated Resource Management for Cluster-based Internet Services.  OSDI, 2002.

[Doyle 2003] Ronald P. Doyle, Jeffrey S. Chase, Omer M. Asad, Wei Jin, and Amin M. Vahdat. Model-Based Resource Provisioning in a Web Service Utility. USITS, 2003.

Additional readings:

• [Brewer 2001] E. Brewer.  Lessons from giant-scale services.  IEEE Internet Computing, Vol. 5, Issue 4, 2001.
  
• Y. Saito, B. Bershad, and H. Levy. Manageability, Availability and Performance in Porcupine: A Highly Scalable Internet Mail Service . Proc. of the 17th ACM Symp. on Operating Systems Principles, Dec. 1999.
• The Berkeley Ninja Project
• Ricardo's papers on PRESS and L2S.  (Ask me if you cannot find the right ones ...)

Replication & data consistency

[Terry 1998] D. B. Terry, K. Petersen, M. J. Spreitzer, and M. M. Theimer. The Case for Non-transparent Replication: Examples from Bayou. IEEE Data Engineering, December 1998.

[Yu 2000] Yu and Vahdat. Design and Evaluation of a Continuous Consistency Model for Replicated Services. OSDI 2000.

Additional readings:

• Bayou

Fault-tolerance & availability

[Chen 2002] Chen, M.Y.; Kiciman, E.; Fratkin, E.; Fox, A.; Brewer, E. Pinpoint: problem determination in large, dynamic Internet services. DSN (IPDS track), 2002.

[Brown 2003] Aaron B. Brown and David A. Patterson. Undo for Operators: Building an Undoable E-mail Store. USENIX, 2003.

[Nagaraja 2003] Kiran Nagaraja, Xiaoyan Li, Bin Zhang, Ricardo Bianchini, Richard P. Martin, Thu D. Nguyen. Using Fault Injection to Evaluate the Performability of Cluster-Based Services. USITS, 2003.

[Kalbarczyk 1999] Kalbarczyk, Z.T.; Iyer, R.K.; Bagchi, S.; Whisnant, K.; Chameleon: a software infrastructure for adaptive fault tolerance.  IEEE Transactions on Parallel and Distributed Systems, Volume: 10 , Issue: 6 , June 1999.

Additional readings:

• The Berkeley and Stanford ROC projects
• Vivo
• The Performability Engineering Research Group at UIUC.  Particularly relevant papers include those on Loki and Intrusion tolerance.
• The DEPEND group at UIUC.

What's going on in my distributed system?

[Aguilera 2003] Marcos K. Aguilera, Jeffrey C. Mogul, Janet L. Wiener, Patrick Reynolds, Athicha Muthitacharoen. Performance debugging for distributed systems of black boxes. SOSP, 2003.

[Mahajan 2003] Ratul Mahajan, Neil Spring, David Wetherall, Thomas Anderson. User-level internet path diagnosis. SOSP, 2003.

Security

[Garfinkel 2003] Tal Garfinkel, Ben Pfaff, Jim Chow, Mendel Rosenblum, Dan Boneh.  Terra: a virtual machine-based platform for trusted computing.  SOSP 2003.

[Qie 2002] Xiaohu Qie, Ruoming Pang, and Larry Peterson.  Defensive Programming: Using an Annotation Toolkit to Build DoS-Resistant Software.  OSDI, 2002.

[King 2003] Samuel T. King and Peter M. Chen.  Backtracking Intrusions.  SOSP 2003.

Additional readings:

Federated systems

[Stoica to-appear] Ion Stoica, Robert Morris, David Liben-Nowell, David R. Karger, M. Frans Kaashoek, Frank Dabek, Hari Balakrishnan. Chord: A Scalable Peer-to-peer Lookup Protocol for Internet Applications. To Appear in IEEE/ACM Transactions on Networking.

[Cuenca-Acuna 2003] F. M. Cuenca-Acuna, C. Peery, R. P. Martin, T. D. Nguyen.  PlanetP: Using Gossiping to Build Content Addressable Peer-to-Peer Information Sharing Communities.  HPDC 2003.

[Fu 2003] Yun Fu, Jeffrey Chase, Brent Chun, Stephen Schwab, and Amin Vahdat.  SHARP: an architecture for secure resource peering.  SOSP 2003.

[Bavier 2004] Andy Bavier, Larry Peterson, Mike Wawrzoniak, Scott Karlin, Tammo Spalink, Timothy Roscoe, David Culler, Brent Chun, and Mic Bowman.  Operating Systems Support for Planetary-Scale Network Services.  NSDI 2004.

2 more NSDI 2004 papers.

Additional readings:

• [Harvey 2003] Nicholas J. A. Harvey, Michael B. Jones, Stefan Saroiu, Marvin Theimer, and Alec Wolman.  SkipNet: A Scalable Overlay Network with Practical Locality Properties.  USITS 2003.
• CHORD
• The Oceanstore Project
• PlanetP Project
• FarsiteGlobus (GRID)