Argonne National Laboratory

Swift: Fast, Reliable, Loosely Coupled Parallel Computation

TitleSwift: Fast, Reliable, Loosely Coupled Parallel Computation
Publication TypeConference Paper
Year of Publication2007
AuthorsZhao, Y, Hategan, M, Clifford, B, Foster, IT, von Laszewski, G, Nefedova, V, Raicu, I, Stef-Praun, I, Wilde, M
Conference NameIEEE 2007 International Conference on Web Services (ICWS)
Conference LocationSalt Lake City, UT
Other NumbersANL/MCS-P1416-0507
AbstractWe present Swift, a system that combines a novel scripting language called SwiftScript with a powerful runtime system based on CoG Karajan, Falkon, and Glubus to allow for the concise specification, and reliable and efficient execution, of largely loosely coupled computations. Swift adopts and adapts ideas first explored in the GriPhyN virtual data system, improving on that system in many regards. We describe the SwiftScript language and its use of XDTM to describe the logical structure of complex file system structures. We also present the Swift runtime system and its use of CoG Karajan, Falkon, and Globus services to dispatch and manage the execution of many tasks in parallel and Grid environments. We describe application experiences and performance experiments that quantify the cost of Swift operations.