Computer Science

The Parallel Programming Guide for Every Software Developer

From grids and clusters to next-generation game consoles, parallel computing is going mainstream. Innovations such as Hyper-Threading Technology, HyperTransport Technology, and multicore microprocessors from IBM, Intel, and Sun are accelerating the movement's growth. Only one thing is missing: programmers with the skills to meet the soaring demand for parallel software.

That's where Patterns for Parallel Programming comes in. It's the first parallel programming guide written specifically to serve working software developers, not just computer scientists. The authors introduce a complete, highly accessible pattern language that will help any experienced developer "think parallel"-and start writing effective parallel code almost immediately. Instead of formal theory, they deliver proven solutions to the challenges faced by parallel programmers, and pragmatic guidance for using today's parallel APIs in the real world. Coverage includes:

• Understanding the parallel computing landscape and the challenges faced by parallel developers

• Finding the concurrency in a software design problem and decomposing it into concurrent tasks

• Managing the use of data across tasks

• Creating an algorithm structure that effectively exploits the concurrency you've identified

• Connecting your algorithmic structures to the APIs needed to implement them

• Specific software constructs for implementing parallel programs

• Working with today's leading parallel programming environments: OpenMP, MPI, and Java

Patterns have helped thousands of programmers master object-oriented development and other complex programming technologies. With this book, you will learn that they're the best way to master parallel programming too.

This book uses a patterns approach to help software engineers master the challenges of writing software to run on parallel computers.

• Parallel computing is not a new term, but increased desktop processor power and the advent of grid computing have brought it into greater attention recently
• Helps IT departments better leverage company resources
• A catalog of proven solutions to recurring problems faced by parallel programmers

Preface.

1. A Pattern Language for Parallel Programming.

    Introduction.

    Parallel Programming.

    Design Patterns and Pattern Languages.

    A Pattern Language for Parallel Programming.

2. Background and Jargon of Parallel Computing.

    Concurrency in Parallel Programs Versus Operating Systems.

    Parallel Architectures: A Brief Introduction.

    Parallel Programming Environments.

    The Jargon of Parallel Computing.

    A Quantitative Look at Parallel Computation.

    Communication.

    Summary.

3. The Finding Concurrency Design Space.

    About the Design Space.

    The Task Decomposition Pattern.

    The Data Decomposition Pattern.

    The Group Tasks Pattern.

    The Order Tasks Pattern.

    The Data Sharing Pattern.

    The Design Evaluation Pattern.

    Summary.

4. The Algorithm Structure Design Space.

    Introduction.

    Choosing an Algorithm Structure Pattern.

    Examples.

    The Task Parallelism Pattern.

    The Divide and Conquer Pattern.

    The Geometric Decomposition Pattern.

    The Recursive Data Pattern.

    The Pipeline Pattern.

    The Event-Based Coordination Pattern.

5. The Supporting Structures Design Space.

    Introduction.

    Forces.

    Choosing the Patterns.

    The SPMD Pattern.

    The Master/Worker Pattern.

    The Loop Parallelism Pattern.

    The Fork/Join Pattern.

    The Shared Data Pattern.

    The Shared Queue Pattern.

    The Distributed Array Pattern.

    Other Supporting Structures.

6. The Implementation Mechanisms Design Space.

    Overview.

    UE Management.

    Synchronization.

    Communication.

Appendix A. A Brief Introduction to OpenMP.

Appendix B. A Brief Introduction to MPI.

Appendix C. A Brief Introduction to Concurrent Programming in Java.

Glossary.

Bibliography.

About the Authors.

Index.

Parallel Programming / Concurrent Programming [PTG: AW PROFESSIONAL] (Computer Science)
Parallel Computing [PTG: AW PROFESSIONAL] (Computer Science)

Timothy G. Mattson is Intel's industry manager for life sciences. His research focuses on technologies that simplify parallel computing for general programmers, with an emphasis on computational biology. He holds a Ph.D. in chemistry from the University of California, Santa Cruz.

Beverly A. Sanders is associate professor at the Department of Computer and Information Science and Engineering, University of Florida, Gainesville. Her research focuses on techniques to help programmers construct high-quality, correct programs, including formal methods, component systems, and design patterns. She holds a Ph.D. in applied mathematics from Harvard University.

Berna L. Massingill is assistant professor in the Department of Computer Science at Trinity University, San Antonio, Texas. Her research interests include parallel and distributed computing, design patterns, and formal methods. She holds a Ph.D. in computer science from the California Institute of Technology.

The Parallel Programming Guide for Every Software Developer

From grids and clusters to next-generation game consoles, parallel computing is going mainstream. Innovations such as Hyper-Threading Technology, HyperTransport Technology, and multicore microprocessors from IBM, Intel, and Sun are accelerating the movement's growth. Only one thing is missing: programmers with the skills to meet the soaring demand for parallel software.

That's where Patterns for Parallel Programming comes in. It's the first parallel programming guide written specifically to serve working software developers, not just computer scientists. The authors introduce a complete, highly accessible pattern language that will help any experienced developer "think parallel"-and start writing effective parallel code almost immediately. Instead of formal theory, they deliver proven solutions to the challenges faced by parallel programmers, and pragmatic guidance for using today's parallel APIs in the real world. Coverage includes:

• Understanding the parallel computing landscape and the challenges faced by parallel developers

• Finding the concurrency in a software design problem and decomposing it into concurrent tasks

• Managing the use of data across tasks

• Creating an algorithm structure that effectively exploits the concurrency you've identified

• Connecting your algorithmic structures to the APIs needed to implement them

• Specific software constructs for implementing parallel programs

• Working with today's leading parallel programming environments: OpenMP, MPI, and Java

Patterns have helped thousands of programmers master object-oriented development and other complex programming technologies. With this book, you will learn that they're the best way to master parallel programming too.

View a Sample Chapter PDF:

Pearson Higher Education offers special pricing when you choose to package your text with other student resources. If you're interested in creating a cost-saving package for your students, contact your Pearson Higher Education representative for pricing and ordering information.

This title is a member of the Software Patterns Series, which also contains the titles below . You can also visit the Software Patterns Series page.

Design Patterns Explained, Second Edition is a simple, clear, and practical introduction to patterns.  Using dozens of new C# and updated Java examples, it shows students how to use patterns to design, develop, and deliver software far more effectively. Students should read this book before they they try and tackle Gamma's well-known work, Design Patterns. 

The book starts with a complete overview of the fundamental principles of patterns, and the role of object-oriented analysis and design in contemporary software development. Then, using easy-to-understand sample code, Alan Shalloway and James Trott illuminate dozens of today's most useful patterns: their underlying concepts, advantages, tradeoffs, implementation techniques, and pitfalls to avoid. Many patterns are accompanied by UML diagrams.

Building on their best-selling First Edition, Shalloway and Trott have thoroughly updated this book to reflect new software design trends, patterns, and implementation techniques. Reflecting extensive reader feedback, they have deepened and clarified coverage throughout, and reorganized content for even greater ease of understanding.

• Design Patterns Explained: A New Perspective on Object-Oriented Design, 2/E
  Shalloway & Trott
  © 2005 | Addison-Wesley Professional | Paper; 480 pages | Instock
  ISBN-10: 0321247140 | ISBN-13: 9780321247148
  Brief Description | Buy from myPearsonStore
  
  



Finally, a companion to the seminal book, Design Patterns, 0-201-63361-2, that allows students to learn patterns using Java as opposed to C++, which was used in the original work. By working through the challenges presented in Design Patterns Java™ Workbook, the student will learn to recognize and apply a large portion of the accumulated wisdom of the software community. The author uses a workbook approach because he believes that students will not truly learn the material by reading it, but by “doing it.” The accompanying CD-ROM will include all code examples included in the book as well as some bonus code examples not found in the book. As the title suggests, all samples will be in Java.

• Design Patterns Java™ Workbook
  Metsker
  © 2002 | Addison-Wesley Professional | Paper; 496 pages | Instock
  ISBN-10: 0201743973 | ISBN-13: 9780201743975
  Brief Description | Buy from myPearsonStore
  
  



In this book, intended as a language companion to Design Patterns: Elements of Reusable Object-Oriented Software by Gamma, Helm, Johnson & Vlissides, noted Smalltalk and design patterns experts implement the 23 design patterns using Smalltalk code. Using the same successful format as Design Patterns, this book tailors the topic of design patterns to the Smalltalk programmer - no other book offers this. The authors have worked closely with the Design Patterns authors to ensure that this companion volume is held to the same high quality standards that made the original a best-seller. The full source code is available on Addison-Wesley's web site.

• The Design Patterns Smalltalk Companion
  Alpert, Brown & Woolf
  © 1998 | Addison-Wesley Professional | Paper; 464 pages | Instock
  ISBN-10: 0201184621 | ISBN-13: 9780201184624
  Brief Description | Buy from myPearsonStore
  
  



For students learning in the Microsoft environment, this book is a companion to the original Design Patterns text tailored to the C#. This book is an application book, rather than a theoretical one. It is written for students who want to gain a better understanding of the patterns described in the seminal design patterns book by Gamma et al. The book's intent is to give students the confidence and know-how to apply the original 23 patterns identified in the Gamma book, with all code examples provided in C#.

• Design Patterns in C#
  Metsker
  © 2004 | Addison-Wesley Professional | Cloth; 480 pages | Instock
  ISBN-10: 0321126971 | ISBN-13: 9780321126979
  Brief Description | Buy from myPearsonStore
  
  
• Design Patterns in Java™, 2/E
  Metsker & Wake
  © 2006 | Addison-Wesley Professional | Cloth; 480 pages | Instock
  ISBN-10: 0321333020 | ISBN-13: 9780321333025
  Buy from myPearsonStore
  
  
• Design Patterns in Java™, Safari, 2/E
  Metsker & Wake
  © 2006 | Addison-Wesley Professional | On-line Supplement; 480 pages | Estimated Availability: 06/15/2009
  ISBN-10: 0321630483 | ISBN-13: 9780321630483
  URL: http://safari.informit.com
  
  
  



Software developers now recognize the value of design patterns in helping build better software more efficiently. As a result, design patterns have become extremely popular in the software development community. Pattern Hatching explains and enhances the information from the seminal work in the field, Design Patterns: Elements of Reusable Object-Oriented Software. The hands-on approach offered by John Vlissides, co-author of Design Patterns, enables you to better understand the pattern development process, and therefore identify and write your own patterns. The author's insights will further allow you to apply the original 23 patterns by example.

• Pattern Hatching: Design Patterns Applied
  Vlissides
  © 1998 | Addison-Wesley Professional | Paper; 192 pages | Instock
  ISBN-10: 0201432935 | ISBN-13: 9780201432930
  Brief Description | Buy from myPearsonStore
  
  
• Patterns for Parallel Programming
  Mattson, Sanders & Massingill
  © 2005 | Addison-Wesley Professional | Cloth; 384 pages | Instock
  ISBN-10: 0321228111 | ISBN-13: 9780321228116
  Buy from myPearsonStore
  
  
• Software Configuration Management Patterns: Effective Teamwork, Practical Integration
  Berczuk & Appleton
  © 2003 | Addison-Wesley Professional | Paper; 256 pages | Instock
  ISBN-10: 0201741172 | ISBN-13: 9780201741179
  Buy from myPearsonStore
  
  

Pearson Higher Education offers special pricing when you choose to package your text with other student resources. If you're interested in creating a cost-saving package for your students contact your Pearson Higher Education representative.