HYDRA: Using Windows Desktop Systems in Distributed Parallel Computing Arvind Gopu, Douglas Grover, David Hart, Richard Repasky, Joseph Rinkovsky, Steve Simms, Adam Sweeny, Peng Wang University Information Technology Services Indiana University SC'05, Seattle, WA
Problem Description l Turn Windows desktop systems at IUB student labs into a scientific resource. l l 2300 systems, 3 year replacement cycle 1. 5 Teraflops Fast ethernet or better Harvest idle cycles. SC'05, Seattle, WA
Constraints l l l Systems dedicated to students using desktop office applications — not parallel scientific computing Microsoft Windows environment Daily software rebuild SC'05, Seattle, WA
What could these systems be used for? l Many small computations and a few small messages l l l Master-worker Parameter studies Monte Carlo SC'05, Seattle, WA
Assembling small ephemeral resources l Different parallel libraries have constraints of some form or the other l MPI not designed to handle ephemeral resources SC'05, Seattle, WA
Solution l l Simple Message Brokering Library (SMBL) l Limited replacement for MPI Process and Port Manager (PPM) … Plus … l l Condor NT l Job management Web portal l Job submission SC'05, Seattle, WA
The Big Picture We’ll discuss each part in more detail next… The shaded box indicates components hosted on multiple desktop computers SC'05, Seattle, WA
Portal l Creates and submits Condor files, handles data files Apache based PHP web interface §http: //hydra. indiana. edu (IU users) §http: //hydra. iu. teragrid. org (Teragrid users) SC'05, Seattle, WA
Condor l Condor for Windows NT/2000/XP l l “Vanilla universe” -- no support for checkpointing or parallelism Provides: l Security l Match-making l Fair sharing l File transfer l Job submission, suspension, preemption, restart SC'05, Seattle, WA
SMBL l l l In charge of message delivery for each parallel session Client library implements selected MPI-like calls Both server and client library based on TCP socket abstraction SC'05, Seattle, WA
SMBL (Contd … ) Managing Temporary Workers l l l SMBL server maintains a dynamic pool of client process connections Worker job manager hides details of ephemeral workers at the application level Porting from MPI is fairly straight forward SC'05, Seattle, WA
Process and Port Manager (PPM) l l l Assigns port/host to each parallel session Starts the SMBL server and application processes on demand Directs workers to their servers SC'05, Seattle, WA
Once again … the big picture The shaded box indicates components hosted on multiple desktop computers SC'05, Seattle, WA
System Layout l l PPM, SMBL server and web portal running on Linux server -- Dual Intel Xeon 1. 7 GHz, 2 GB memory and Gig. E inter-connect STC Windows worker machines -Combination of different OS (Windows 2000/XP) and network inter-connect speeds (Gig. E/100 Mbps/10 Mbps) SC'05, Seattle, WA
Applications l Fast. DNAml-p l l l Parallel application, master-worker model, small granularity of work Provides generic interface for parallel communication library (MPI, PVM, SMBL) Reliability built in: Foreman process copes with delayed or lost workers Blast Meme SC'05, Seattle, WA
Portal SC'05, Seattle, WA
Applications – Fast. DNAml SC'05, Seattle, WA
Fast. DNAml-p Performance SC'05, Seattle, WA
Other Applications – Parallel MEME SC'05, Seattle, WA
Other Applications – BLAST SC'05, Seattle, WA
Utilization of Idle Cycles Red: total owner Blue: total idle Green: total Condor SC'05, Seattle, WA
Recent Development l Hydra cluster Teragrid’ized! (Oct 2005) l l Allow TG users to use resource Virtual Host based solution – two different URLs for IU and Teragrid users authenticate against different Kerberos server (PSC) Still to-do l Usage accounting SC'05, Seattle, WA
Work in Progress/Future Direction l Once again … Teragrid’ization of Hydra cluster l l l Usage Accounting – Report usage by. Teragrid users New Portal – JSR 168 compliant, certificate based authentication capability Range of applications – Virtual machines, so forth SC'05, Seattle, WA
Summary l Large parallel computing facility created at very low cost l l l SMBL parallel message passing library that can deal with ephemeral resources PPM port broker that can handle multiple parallel sessions SMBL (Open Source) Home – http: //smbl. sourceforge. net SC'05, Seattle, WA
Links and References l Hydra Portal l l l l http: //hydra. indiana. edu (IU users) http: //hydra. iu. teragrid. org (Teragrid users) SMBL home page – http: //smbl. sourceforge. net Condor home page -- http: //www. cs. wisc. edu/condor/ IU Teragrid home page – http: //iu. teragrid. org Parallel Fast. DNAml – http: //www. indiana. edu/~rac/hpc/fast. DNAml Blast -- http: //www. ncbi. nlm. nih. gov/BLAST Meme -- http: //meme. sdsc. edu/meme/intro. html SC'05, Seattle, WA
Скачать презентацию HYDRA Using Windows Desktop Systems in Distributed Parallel
f3748e8c19205a7fdef9fd2a3fc0cf46.ppt