1. High-Performance Computing Dr. Guy Tel-Zur tel-zur@computer.org August 5th, 2010

2. Talk Outline The need for High-Performance Computing (HPC) Trends, Architecture, Systems, Models High-Throughput Computing More on Distributed Computing Grid Computing Cloud Computing Summary and Q&As

3. High-Performance Computing (HPC) Trends, Architecture, Systems, Models High-Throughput Computing More on Distributed Computing Grid Computing Cloud Computing Summary and Q&As

4. HPC ->max(FLOPS) -> Parallel Computing Speed: The problem takes too much time Size: The problem doesn’t fit on my machine The Nature of the Problem is CPU Intensive (CFD, Weather Forecast, Bio Informatics, Signal Processing, …) Cost: Can’t afford the real experiment Risk: The real problem is too dangerous Image source: http://www.symscape.com/node/261

5. !Give me a stronger computer Fact #1: Until 2003 Stronger == Faster by Freq. Since 2003 Stronger == Parallel Fact #2: All present and future processors are and will be Parallel Fact #3: CPU intensive computer codes won’t perform well on future architectures using the traditional “Sequential” programming style Fact #4: The Challenge is in the Software

6. The Free lunch is over Herb Sutter, C++ Architect at Microsoft (March 2005) http://www.gotw.ca/publications/concurrency-ddj.htm

7. Modern High-End Parallel Computers Commodities (Intel+AMD ≈ 100% market share) Open Source (Unix/Linux ≈ 100% market share) High Speed Interconnect (Infiniband ) Mostly running MPI (Distributed Memory) and OpenMP (Shared Memory) A Growing trend: GPGPUs “Many-Many” cores: Multi-Threading

8. The Top500

9. Front view of Dawning TC3600 Blade Server. June 2010 Top 3 224,162 cores

10. GPGPU (a demo on my laptop) Source: Fast N-Body Simulation with CUDA. ByLars NylandNVIDIA Corporation, Mark Harris NVIDIA Corporation, Jan Prins University of North Carolina at Chapel Hill.

11. High-Performance Computing (HPC) Trends, Architecture, Systems, Models High-Throughput Computing (HTC) More on Distributed Computing Grid Computing Cloud Computing Summary and Q&As

12. High-Throughput Computing (HTC) FLOPY ≠ 60 X 60 X 24 X 7 X 52 FLOPS Condor May 2010 @ UW-Madison pool:

13. High-Performance Computing (HPC) Trends, Architecture, Systems, Models High-Throughput Computing (HTC) More on Distributed Computing Grid Computing Cloud Computing Summary and Q&As

14. Grid Computing Definition According to Ian Foster* Coordinates resources that are not subject to centralized control Using standard, open, general-purpose protocols and interfaces Delivers nontrivial qualities of service (QoS) * Source: “What is the Grid? A Three Point Checklist” by Ian Foster, Argonne National Laboratory & University of Chicago, July 20, 2002

15. http://rtm.hep.ph.ic.ac.uk/webstart.php Real time monitoring July 25th, 2010 EGEE

16. The Production Service infrastructure is a large multi-science Grid infrastructure, federating some 250 resource centers world-wide, providing some 40.000 CPUs and several Petabytes of storage. This infrastructure is used on a daily basis by several thousands of scientists federated in over 200 Virtual Organizations on a daily basis.

17. High-Performance Computing (HPC) Trends, Architecture, Systems, Models High-Throughput Computing (HTC) More on Distributed Computing Grid Computing Cloud Computing Summary and Q&As

18. My Cloud Computing Group

19. X as a Service (Xaas) Where X can be any Computing resource: Platform, Software, Infrastructure… A major revolution in the IT Virtualization & Outsourcing Pay Per Use (PPU) However, many challenges unsolved yet QoS Security Legal Issues

20. An Example: Amazon Web Services (AWS)

21. HPC Clouds by Amazon EC2 and SGI

22. High-Performance Computing (HPC) Trends, Architecture, Systems, Models High-Throughput Computing (HTC) More on Distributed Computing Grid Computing Cloud Computing Summary and Q&As

23. Summary and Outlook Tera-FLOPs processor by 2015 How about an Israeli Supercomputer? SMP Exa-FLOPs Supercomputer by 2019 HPC Grid Computing Clusters HTC 8.5 cent/hour CPU Open Source Software