Enabling Workflows in GridSolve: Request Sequencing and Service Trading

TitleEnabling Workflows in GridSolve: Request Sequencing and Service Trading
Publication TypeJournal Article
Year of Publication2013
AuthorsLi, Y., A. YarKhan, J. Dongarra, K. Seymour, and A. Hurault
JournalJournal of Supercomputing
Volume64
Issue3
Start Page1133
Pagination1133-1152
Date Published06-2013
ISSN1573-0484
Keywordsgrid computing, gridpac, netsolve, service trading, workflow applications
Abstract

GridSolve employs a RPC-based client-agent-server model for solving computational problems. There are two deficiencies associated with GridSolve when a computational problem essentially forms a workflow consisting of a sequence of tasks with data dependencies between them. First, intermediate results are always passed through the client, resulting in unnecessary data transport. Second, since the execution of each individual task is a separate RPC session, it is difficult to enable any potential parallelism among tasks. This paper presents a request sequencing technique that addresses these deficiencies and enables workflow executions. Building on the request sequencing work, one way to generate workflows is by taking higher level service requests and decomposing them into a sequence of simpler service requests using a technique called service trading. A service trading component is added to GridSolve to take advantage of the new dynamic request sequencing. The features described here include automatic DAG construction and data dependency analysis, direct interserver data transfer, parallel task execution capabilities, and a service trading component.

DOI10.1007/s11227-010-0549-1
Project Tags: