OpenCUDA + MPI A Framework for Heterogeneous GP-GPU Distributed Computing

Kenny Ballou

February 15, 2013

Ballou OpenCUDA + MPI

Introduction Parallel and Distributed Computing

What is GP-GPU Distributed Computing? Parallel: Processing concurrently

Distributed: Processing over many computers, typically in parallel, but not always Local Grid Computing

Ballou OpenCUDA + MPI

Applications of Supercomputing What can we do with Parallel and Distributed Computing?

Solving (Large) Linear Systems LINPACK Benchmarks

Fluid Dynamic Simulations N-Body Simulations Brute-Force Password/Hash Cracking Prime Number Searching Protein Folding Image Analysis / Manipulation ...

Ballou OpenCUDA + MPI

Who Uses Distributed Computing?

Google – Page Indexing Created Map-Reduce

Facebook – Data Mining Universities Many Others

Ballou OpenCUDA + MPI

The Problem(s)

”Distributed Programming” is expensive Specificity of Hardware Data Distribution Volume

Fault Tolerance

Ballou OpenCUDA + MPI

A Framework Solutions

Ease Programming Interface for Highly Parallel Distributed Computing Allow for Diversity in Computing Environment Bring together ideas from both types of distributed computing ”Jungle Computing”

Ballou OpenCUDA + MPI

Plan and Goals

Develop a framework for distributed computing over a heterogeneous cluster Develop several different solutions for vascular extraction from CT angiography scans Profile the different solutions Add Cluster/ Node Configuration and Scheduling Options

Ballou OpenCUDA + MPI

Progress

Progressing more slowly than I anticipated CUDA C/C++ and pyCUDA Cluster/ Node Administration (ongoing) mpi4py – Begin learning the MPI interface and intricacies

Ballou OpenCUDA + MPI

Continuing Progress

Continue Learning mpi4py and pyCUDA Combine mpi4py with pyCUDA ... Begin developing framework

Ballou OpenCUDA + MPI

Acknowledgements

Dr. Alark Joshi – Mentor Graphics and Visualization

Nilab Mohammad Mousa – Team Member

Ballou OpenCUDA + MPI

Thank You

Questions?

Ballou OpenCUDA + MPI

OpenCUDA + MPI - GitHub

Feb 15, 2013 - Who Uses Distributed Computing? Google – Page Indexing. Created Map-Reduce. Facebook – Data Mining. Universities. Many Others. Ballou.

115KB Sizes 9 Downloads 94 Views

Recommend Documents

OpenCUDA+MPI - GitHub
CPUs consist of a small number of cores (microprocessors) that are best at .... sands) of hosts (nodes), and executing application computations in parallel ... the unused CPU and GPU cycles on a computer to do scientific computing [10]. .... Rajagopa

OpenCUDA+MPI - GitHub
A Framework for Heterogeneous GP-GPU Cluster Computing. Kenny Ballou ... Parallel: Processing concurrently. Distributed: Processing over many computers.

OpenCUDA+MPI - A Framework for Heterogeneous GP-GPU ... - GitHub
Kenny Ballou, Boise State University Department of Computer Science ... computing limit scientists and researchers in various ways. The goal of.

MPI by Godse.pdf
Page 1. Whoops! There was a problem loading more pages. Retrying... MPI by Godse.pdf. MPI by Godse.pdf. Open. Extract. Open with. Sign In. Main menu.

MPI by Godse.pdf
There was a problem previewing this document. Retrying... Download. Connect more apps... Try one of the apps below to open or edit this item. MPI by Godse.

1ML - People at MPI-SWS
Jun 18, 2015 - explicit injection into and projection from first-class core values, accompanied ... lift the function (and potentially a lot of downstream code) to the.

High Performance RDMA-Based MPI ... - Semantic Scholar
C.1.4 [Computer System Organization]: Parallel Archi- tectures .... and services can be useful in designing a high performance ..... 4.6 Polling Set Management.

Sop MPI 2.pdf
generando con ello confianza en el jugador. Whoops! There was a problem loading this page. Retrying... Whoops! There was a problem previewing this document. Retrying... Download. Connect more apps... Try one of the apps below to open or edit this ite

An Introduction to MPI Programming
IBM Loadleveler talks about tasks not processes ... On the IBM all tasks execute the code before MPI_INIT ... useful when doing collective communications.

2016-17 MPI DLPBIL Elem.pdf
#Culture and Language Matter. MMED. @MPI.2016. Page 1 of 65 .... choice pathways. Page 4 of 65. Main menu. Displaying 2016-17 MPI DLPBIL Elem.pdf.