Imperial College  » Dept of Computing  » Peter Pietzuch Teaching » SDSD (16/17)
 
 

PhD Students

I'm always looking for outstanding and motivated PhD students. Starting dates for PhDs are April and October. More information on the application process and funding opportunities is available here.

EBS Book

DEBS Book

 

Scalable Distributed Systems Design (16/17)

Lecturer: Dr Peter Pietzuch
Email: prp@doc (you know the rest)
Office: Huxley 442

Course Schedule

Introduction

Lectures 1+2 (Jan 18): Overview of scalable distributed system design, data centres, design principles (slides PDF)

Scalable Data

Lectures 3+4 (Jan 25)

Google BigTable (slides PDF)
  • "Bigtable: A Distributed Storage System for Structured Data", Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah A. Wallach, Mike Burrows, Tushar Chandra, Andrew Fikes, and Robert E. Gruber, Seventh Symposium on Operating System Design and Implementation (OSDI), Seattle, WA, November, 2006.
  1. What is the problem that this paper tries to solve? How would summarise its main idea in a few sentences? How does it work in more detail?
  2. What is good about the paper? What is not good about the paper?
  3. How does the design of BigTable compare to that of a parallel relational database management system (RDBMS)?
  4. What limits the scalability of the BigTable design?

Amazon Dynamo (slides PDF)
  • "Dynamo: Amazon's Highly Available Key-Value Store", Guiseppe DeCandia, Deniz Hastorun, Madan Jampani, Gunavardhan Kakulapati, Avinash Lakshman, Alex Pilchin, Swami Sivasubramanian, Peter Vosshall, and Werner Vogels, ACM Symposium on Operating Systems Principles (SOSP), Stevenson, WA, October 2007.
  1. What is the problem that this paper tries to solve? How would summarise its main idea in a few sentences? How does it work in more detail?
  2. What is good about the paper? What is not good about the paper?
  3. To what extent is the design of Dynamo inspired by Distributed Hash Tables (DHTs)? What are the advantages and disadvantages of such a design?
  4. How does the design of Dynamo compare to that of BigTable?

Lectures 5+6 (Feb 1)

Google Spanner (slides PDF)
  • "Spanner: Google's Globally-Distributed Database", James C. Corbett, Jeffrey Dean, Michael Epstein, Andrew Fikes, Christopher Frost, JJ Furman, Sanjay Ghemawat, Andrey Gubarev, Christopher Heiser, Peter Hochschild, Wilson Hsieh, Sebastian Kanthak, Eugene Kogan, Hongyi Li, Alexander Lloyd, Sergey Melnik, David Mwaura, David Nagle, Sean Quinlan, Rajesh Rao, Lindsay Rolig, Yasushi Saito, Michal Szymaniak, Christopher Taylor, Ruth Wang, and Dale Woodford, Tenth Symposium on Operating System Design and Implementation (OSDI), Hollywood, CA, October, 2012.
  1. What is the problem that this paper tries to solve? How would summarise its main idea in a few sentences? How does it work in more detail?
  2. What is good about the paper? What is not good about the paper?
  3. How does the performance of Spanner depend on the workload?
  4. What other applications could TrueTime have?
Apache Kafka Eno Thereska, Confluent, Inc. and Imperial College London (guest lecture) (slides PDF)

Scalable Computation

Lectures 7+8 (Feb 8)

Google Map/Reduce (slides PDF)
  1. What is the problem that this paper tries to solve? How would summarise its main idea in a few sentences? How does it work in more detail?
  2. What is good about the paper? What is not good about the paper?
  3. What algorithms cannot be easily expressed in the MapReduce model?
  4. Can you think of other techniques for handling stragglers?
Apache Spark/RDD (slides PDF)
  • "Resilient Distributed Datasets", Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave, Justin Ma, Murphy McCauley, Michael J. Franklin, Scott Shenker, Ion Stoica, 9th USENIX conference on Networked Systems Design and Implementation (NSDI), San Jose, CA, April 2012.
  1. What is the problem that this paper tries to solve? How would summarise its main idea in a few sentences? How does it work in more detail?
  2. What is good about the paper? What is not good about the paper?
  3. Is the comparison with Hadoop fair?
  4. How well can Spark be used to process graph data?

No lectures (Feb 15)

Scalable Services

Lectures 9+10 (Feb 22)

Apache Zookeeper (slides PDF)
  1. What is the problem that this paper tries to solve? How would summarise its main idea in a few sentences? How does it work in more detail?
  2. What is good about the paper? What is not good about the paper?
  3. How is Zookeeper different from a distributed database such as Google Spanner?
  4. What extensions would you propose for Zookeeper?
No lectures (Mar 1)

Lectures 11 (Mar 8) - 10am

"LogDevice: A Log-Oriented Data Store" , Lovro Puzar, Facebook (guest lecture)

Lectures 12+13 (Mar 15)

Revision lecture (slides PDF)

"Azure SQL Data Warehouse", Robin Lester, Microsoft Azure (guest lecture) (slides PDF)

Optional Reading

Google Millwheel
Microsoft Dryad

Last modified on: 15-03-2017 20:54:06 — (C) Peter Pietzuch — Email:prp(at)doc(dot)ic(dot)ac(dot)uk
Powered by Etomite CMS.