Versions Compared

Old Version 6

changes.mady.by.user Christopher Navarro

Saved on

compared with

New Version Current

changes.mady.by.user Christopher Navarro

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This page will provide a high level overview of different grid standards for the service layer of each system identified as a site that Ergo will nee to communicate with to run need to support for running jobs. For the service layer of each system, some a brief introduction overview will be provided and for more detailed information, follow the links to the different standards mentioned or the overview page for the entire architecture.

Unicore

Service Layer

More information about the Unicore service layer can be found here:  http://www.unicore.eu/unicore/architecture/service-layer.php

...

  • The Service Orchestrator layer is responsible for executing individual tasks in a workflow, handling job execution and monitoring on the grid. Different brokering strategies are implemented to find the best suited resource for each workflow step. Other brokering strategies can be plugged in. 

Clients

  • UCC - Command line client
  • UNICORE Rich Client
    • Eclipse-based UNICORE Rich Client (URC) offers the full set of functionality to the users in a graphical representation. 
    • Uses GridBeans for interacting with Grid Services
    • Download: http://www.unicore.eu/download/unicore6/
  • HiLA - High Level API for Grid Applications
    • This is a layer of abstraction for use with web clients, but it might provide a way to either run jobs directly from the current Ergo architecture or for building DataWolf (Cyberintegrator) Java tools to run jobs
    • Download:  http://www.unicore.eu/download/unicore6/

 

Unicore - XSEDE

https://www.xsede.org/software/unicore

XSEDE

 

Software

  • Globus Toolkit
    • OGSA
    • OGSI
    • WSRF
    • Job Submission Description Language JSDL
    • DRMAA
    • WS-Management
    • WS-BaseNotification
    • SOAP
    • Web Service Description Language (WSDL)
    • Grid Security Infrastructure (GSI)

KISTI HPC Open API

 

Genesis II

Genesis II is an open source, standards based grid middleware designed to support high-throughput computing by the University of Virginia Department of Computer Science and the Virginia Center for Grid Research. Genesis II follows grid standards from the Open Grid Forum (OGF), W3C, and OASIS, including many from the Open Grid Services Architecture (OGSA) and the Web Services Resource Framework (WSRF). Genesis II adheres to parts or all of OGSA Basic Execution Services (BES), Resource Naming Service (RNS), OGSA ByteIO, WS-Security, WS-Naming, WS-Trust, and Job Submission Description Language (JSDL). Genesis II supports X.509 certificates and username/password (based on WS-Security and OGF Basic Security Profile).

Main wiki:  http://genesis2.virginia.edu/wiki/

Clients

The primary access seems to be through a client using the graphical user interface or the terminal. 

 

General Standards

  • Open Grid Forum (OGF)
  • World Wide Web Consortium (W3C)
  • Advancing Open Standards for the Information Society (OASIS)
  • IETF
  • Open Grid Services Architecture (OGSA) - a distributed interaction and computing architecture based around services, assuring interoperability on hetergenous systems so that different types of resources can communicate and share information. OGSA is based on several other web service technologies such as the Web Services Description Language (WSDL) and the Simple Object Access Protocol (SOAP), but it aims to be largely independent of transport-level handling of data.
  • Web Services Resource Framework (WS-RF 1.2)
  • Open Grid Services Infrastructure (OGSI)
  • Job Specification Description Language 1.0 - describes the requirements of computational jobs for submission to resources, particularly in Grid Environments, though not restricted to the Grid.
    • Reference
    • XML based language
    • Adopted by several software platforms - compatible with UNICORE 6, Genesis II, Windows HPC Server 2008, etc
    • Not intended for human consumption

 

 

Grid Software

  • Globus Toolkit - an open source software toolkit used for building grids that follows OGSA standards
  • Simple API for Grid Applications (SAGA) - an abstractions-based suite of well-defined capabilities that are architected for scalable, interoperable and sustainable approaches to support science on a range of high-performance and distributed computing systems

Questions / Notes

  1. What are the target resources to be considered? We should pick one or more current and/or upcoming HPC systems that ERGO must be able to submit to so we can determine if a common standard is used across the systems (e.g. do multiple target systems have client libraries supporting JSDL).
  2. Can we write HPCExecutors for each system and put common operations inside a parent class? For example, if all systems support JSDL, but use a different client library for job submission, the concrete implementation could call the client libraries
  3. How does Taverna submit jobs to Unicore? There is a plugin, but which client library to submit the JSDL?