Parallel Computing

Parallel Computing

1. Introduction

2. Machine Architectures

2.1 Introduction

2.2 Multiple Instruction Stream, Multiple Data Stream Machines

Shared Memory

Distributed Memory

2.3 Single Instruction Stream, Multiple Data Stream Machines

2.4 Networks of Machines

2.5 Parallelism Within Processors

3. Languages for Parallel Computers

3.1 Introduction

3.2 Synchronization Operations and Methods

3.3 Established Languages

Compilers

Annotations

Extensions

Library Calls

Summary

3.4 New Languages and Paradigms

3.5 Data Flow Languages

Tutorial

Availability

Applications

Summary

3.6 Linda

Tutorial

Availability

Applications

Summary

3.7 Ada

Tutorial

Availability

Applications

Summary

3.8 Object-Oriented Languages

Tutorial

Availability

Applications

Summary

4. Performance Considerations

4.1 Introduction

4.2 Performance Criteria

Peak Speed

Number of Processors

Communication Bandwidth

Load Balancing

Memory and Storage Considerations

Scalability

Software Environment

4.3 Comparing Machines

Peak versus Sustained Speed

Speedup/Efficiency

Benchmarks

5. Summary and Perspectives

List of References

BIbliography

Appendix A: Descriptions of Individual Machines

Appendix B: Glossary of Terms and Abbreviations