CS3DP: Distributed and Parallel Computing

Module code: CS3DP

Module provider: Computer Science; School of Mathematical, Physical and Computational Sciences

Credits: 20

Level: Level 3 (Honours)

When you'll be taught: Semester 2

Module convenor: Dr Xiaomin Chen, email: xiaomin.chen@reading.ac.uk

Pre-requisite module(s): BEFORE TAKING THIS MODULE YOU MUST TAKE CS1PC20 AND TAKE CS2PJ20 (Compulsory)

Co-requisite module(s):

Pre-requisite or Co-requisite module(s):

Module(s) excluded:

Placement information: NA

Academic year: 2024/5

Available to visiting students: Yes

Talis reading list: Yes

Last updated: 21 May 2024

Overview

Module aims and purpose

The module provides students with fundamentals of distributed systems and parallel computing. Students will access state-of-the-art tools that will enable them to understand the concepts and principles underpinning distributed systems and industry standard processes. Students study different distributed systems and supercomputers.  Students are prepared to specialize in the field of distributed systems and parallel computing, e.g., in big data analytics or as scientific programmer.

Students will also be able to demonstrate their abilities in:

• creative problem-solving and critical thinking in solving problems in distributed computing and parallel computing, including team working;
• software design and development in applying advanced programming methods to solve parallel problems; 
• self-reflection on their developed solutions; and
• global outlook by for example considering the process of programming language standards development.

Module learning outcomes

By the end of the module, it is expected that students will be able to:

1. Master key concepts and characterise problems arising from distributed systems;
2. Understand how to solve parallel problems via distributed and parallel algorithms;
3. Understand how different programming models can be applied to solve simple problems;
4. Specialise Linux knowledge and tools for distributed and parallel programming.

Module content

The module covers the following topics:

• Overview of distributed and parallel computing; hardware and software architectures
• Use-cases for distributed applications e.g., web services and standards such as REST
• Issues in designing of distribution and parallel systems e.g., the CAP theorem
• Industry relevant processing models for big data and tools like Hadoop and Spark
• Scientific computing, supercomputers, performance scaling
• Parallel programming paradigms and concepts with a focus on OpenMP and MPI

Structure

Teaching and learning methods

The module consists of weekly 2-hour lectures and weekly 2-hour practical sessions, where students will be encouraged to collaborate with their peers to develop solutions to a series of problems.  During lectures, students will be offered the opportunity to work through theoretical concepts and principles of this subject. These formal sessions are supplemented with several forms of digital resources to support learning.  Skills gained in the lectures and practical sessions will be applied to a set parallel programming exercise and related technical reporting and evaluation of analysis results.

Study hours

At least 44 hours of scheduled teaching and learning activities will be delivered in person, with the remaining hours for scheduled and self-scheduled teaching and learning activities delivered either in person or online. You will receive further details about how these hours will be delivered before the start of the module.

Please note the independent study hours above are notional numbers of hours; each student will approach studying in different ways. We would advise you to reflect on your learning and the number of hours you are allocating to these tasks.

Semester 1 The hours in this column may include hours during the Christmas holiday period.

Semester 2 The hours in this column may include hours during the Easter holiday period.

Summer The hours in this column will take place during the summer holidays and may be at the start and/or end of the module.

Assessment

Requirements for a pass

Students need to achieve an overall module mark of 40% to pass this module.

Summative assessment

Penalties for late submission of summative assessment

The Support Centres will apply the following penalties for work submitted late:

Assessments with numerical marks

• where the piece of work is submitted after the original deadline (or any formally agreed extension to the deadline): 10% of the total marks available for that piece of work will be deducted from the mark for each working day (or part thereof) following the deadline up to a total of three working days;
• the mark awarded due to the imposition of the penalty shall not fall below the threshold pass mark, namely 40% in the case of modules at Levels 4-6 (i.e. undergraduate modules for Parts 1-3) and 50% in the case of Level 7 modules offered as part of an Integrated Masters or taught postgraduate degree programme;
• where the piece of work is awarded a mark below the threshold pass mark prior to any penalty being imposed, and is submitted up to three working days after the original deadline (or any formally agreed extension to the deadline), no penalty shall be imposed;
• where the piece of work is submitted more than three working days after the original deadline (or any formally agreed extension to the deadline): a mark of zero will be recorded.

Assessments marked Pass/Fail

• where the piece of work is submitted within three working days of the deadline (or any formally agreed extension of the deadline): no penalty will be applied;
• where the piece of work is submitted more than three working days after the original deadline (or any formally agreed extension of the deadline): a grade of Fail will be awarded.

The University policy statement on penalties for late submission can be found at: https://www.reading.ac.uk/cqsd/-/media/project/functions/cqsd/documents/qap/penaltiesforlatesubmission.pdf

You are strongly advised to ensure that coursework is submitted by the relevant deadline. You should note that it is advisable to submit work in an unfinished state rather than to fail to submit any work.

Formative assessment

Formative assessment is any task or activity which creates feedback (or feedforward) for you about your learning, but which does not contribute towards your overall module mark.

There will be a weekly formative assessment running in the weekly practicals. Feedback will be then provided through these sessions.

Reassessment

Additional costs