Parallel Computing

1. Introduction2. Machine Architectures 2.1 Introduction 2.2 Multiple Instruction Stream, Multiple Data Stream Machines Shared Memory Distributed Memory 2.3 Single Instruction Stream, Multiple Data Stream Machines 2.4 Networks of Machines 2.5 Parallelism Within Processors3. Languages for Parallel Computers 3.1 Introduction 3.2 Synchronization Operations and Methods 3.3 Established Languages Compilers Annotations Extensions Library Calls Summary 3.4 New Languages and Paradigms 3.5 Data Flow Languages Tutorial Availability Applications Summary 3.6 Linda Tutorial Availability Applications Summary 3.7 Ada Tutorial Availability Applications Summary 3.8 Object-Oriented Languages Tutorial Availability Applications Summary 4. Performance Considerations 4.1 Introduction 4.2 Performance Criteria Peak Speed Number of Processors Communication Bandwidth Load Balancing Memory and Storage Considerations Scalability Software Environment 4.3 Comparing Machines Peak versus Sustained Speed Speedup/Efficiency Benchmarks5. Summary and PerspectivesList of ReferencesBIbliographyAppendix A: Descriptions of Individual MachinesAppendix B: Glossary of Terms and Abbreviations