OpenCUDA + MPI A Framework for Heterogeneous GP-GPU Distributed Computing

Kenny Ballou

February 15, 2013

Ballou OpenCUDA + MPI

Introduction Parallel and Distributed Computing

What is GP-GPU Distributed Computing? Parallel: Processing concurrently

Distributed: Processing over many computers, typically in parallel, but not always Local Grid Computing

Ballou OpenCUDA + MPI

Applications of Supercomputing What can we do with Parallel and Distributed Computing?

Solving (Large) Linear Systems LINPACK Benchmarks

Fluid Dynamic Simulations N-Body Simulations Brute-Force Password/Hash Cracking Prime Number Searching Protein Folding Image Analysis / Manipulation ...

Ballou OpenCUDA + MPI

Who Uses Distributed Computing?

Google – Page Indexing Created Map-Reduce

Facebook – Data Mining Universities Many Others

Ballou OpenCUDA + MPI

The Problem(s)

”Distributed Programming” is expensive Specificity of Hardware Data Distribution Volume

Fault Tolerance

Ballou OpenCUDA + MPI

A Framework Solutions

Ease Programming Interface for Highly Parallel Distributed Computing Allow for Diversity in Computing Environment Bring together ideas from both types of distributed computing ”Jungle Computing”

Ballou OpenCUDA + MPI

Plan and Goals

Develop a framework for distributed computing over a heterogeneous cluster Develop several different solutions for vascular extraction from CT angiography scans Profile the different solutions Add Cluster/ Node Configuration and Scheduling Options

Ballou OpenCUDA + MPI

Progress

Progressing more slowly than I anticipated CUDA C/C++ and pyCUDA Cluster/ Node Administration (ongoing) mpi4py – Begin learning the MPI interface and intricacies

Ballou OpenCUDA + MPI

Continuing Progress

Continue Learning mpi4py and pyCUDA Combine mpi4py with pyCUDA ... Begin developing framework

Ballou OpenCUDA + MPI

Acknowledgements

Dr. Alark Joshi – Mentor Graphics and Visualization

Nilab Mohammad Mousa – Team Member

Ballou OpenCUDA + MPI

Thank You

Questions?

Ballou OpenCUDA + MPI

OpenCUDA + MPI - GitHub

Feb 15, 2013 - Who Uses Distributed Computing? Google – Page Indexing. Created Map-Reduce. Facebook – Data Mining. Universities. Many Others. Ballou.

115KB Sizes 9 Downloads 227 Views

Recommend Documents

OpenCUDA+MPI - GitHub
A Framework for Heterogeneous GP-GPU Cluster Computing. Kenny Ballou ... Parallel: Processing concurrently. Distributed: Processing over many computers.

OpenCUDA+MPI - GitHub
CPUs consist of a small number of cores (microprocessors) that are best at .... sands) of hosts (nodes), and executing application computations in parallel ... the unused CPU and GPU cycles on a computer to do scientific computing [10]. .... Rajagopa

OpenCUDA+MPI - GitHub
May 3, 2013 - Add process “scheduler” to best utilize available computing resources. Add Cluster ... Host to Device Memory Copies. Device to Host Memory ...

OpenCUDA+MPI - GitHub
Sample/ Test Problem Development. Results — Vector Summation ... Profile (Analyze) solutions. Develop framework ... Provisioning. Software. Configurations.

OpenCUDA+MPI - A Framework for Heterogeneous GP ... - GitHub
CUDA. Compute Unified Device Architecture. Established interface with (nVidia) GPU's. pyCUDA. Deferred CUDA kernel compilation. Familiarity. Ballou. OpenCUDA+MPI ...

OpenCUDA+MPI - A Framework for Heterogeneous GP-GPU ... - GitHub
Kenny Ballou, Boise State University Department of Computer Science ... computing limit scientists and researchers in various ways. The goal of.

Open MPI development - GitHub
Jan 29, 2015 - (ad d_ co… om pi_sh ow. _a ll_m ca_ pa rams op al_p rog ress_ set_e ... 1.0E+01. 1.0E+02. 1.0E+03. 1.0E+04. M emory. Inc rease in. M. C. A. _P. M. L_ ..... Express. PCI. Express. Comm. Engine. (Packet. Processing). Comm.

MPI by Godse.pdf
Page 1. Whoops! There was a problem loading more pages. Retrying... MPI by Godse.pdf. MPI by Godse.pdf. Open. Extract. Open with. Sign In. Main menu.

MPI by Godse.pdf
There was a problem previewing this document. Retrying... Download. Connect more apps... Try one of the apps below to open or edit this item. MPI by Godse.

1ML - People at MPI-SWS
Jun 18, 2015 - explicit injection into and projection from first-class core values, accompanied ... lift the function (and potentially a lot of downstream code) to the.

MPI over InfiniBand: Early Experiences
Aug 18, 2003 - design the next generation clusters and servers with high .... Virtual Data Lanes (VLs) in additon to a Dedicated Management Lane (VL15). 5 ...

High Performance RDMA-Based MPI ... - Semantic Scholar
C.1.4 [Computer System Organization]: Parallel Archi- tectures .... and services can be useful in designing a high performance ..... 4.6 Polling Set Management.

Sop MPI 2.pdf
generando con ello confianza en el jugador. Whoops! There was a problem loading this page. Retrying... Whoops! There was a problem previewing this document. Retrying... Download. Connect more apps... Try one of the apps below to open or edit this ite

UNIT III MPI new.pdf
If an interrupt has been requested, the 8086 processes it by performing the following series of steps: a) Pushes the content of the flag register onto the stack to ...

2016-17 MPI DLPBIL Elem.pdf
#Culture and Language Matter. MMED. @MPI.2016. Page 1 of 65 .... choice pathways. Page 4 of 65. Main menu. Displaying 2016-17 MPI DLPBIL Elem.pdf.

An Introduction to MPI Programming
IBM Loadleveler talks about tasks not processes ... On the IBM all tasks execute the code before MPI_INIT ... useful when doing collective communications.

car m800 bsiii mpi engine specification sheet - Groups
Type of combustion chamber (Hemispherical / squish / others). : Multi- ... Sparking plugs. Make and country of origin ... Spark-gap setting, mm. : 0.8. Nominal ...