Header Header Header Header Header

KOALA Tutorial and Hands-on Session

Tuesday, May 10, 2011: 13:00 - 18:00

About KOALA

KOALA is a grid scheduler that has been designed, implemented, and deployed by the PDS group at Delft University of Technology on the DAS-2 and the DAS-3 multicluster systems. The PDS group is currently in the process of porting KOALA to DAS-4. The main features of KOALA are:
  • Processor and data co-allocation: Co-allocation is the simultaneous allocation of resources in multiple clusters to single applications, which consist of multiple components. KOALA supports co-allocation by starting the components of a single application on different clusters simultaneously, after allocating those clusters and transferring necessary files required for the execution of the application.

  • Malleable jobs support: KOALA supports malleable jobs by sending grow messages or shrink messages to the malleable job runners when idle processors have become available or a rigid job of a higher priority is about to run. Runners are job submission and monitoring tools.

  • Parameter sweep application (PSA) support: KOALA supports submitting PSAs, and lets them run in a Cycle-Scavenging way, which means that they have a low priority so are not in the way of the regular users.

  • Extensibility: With KOALA, new scheduling policies can be added and/or new runners for new application types can be added without affecting the operation of KOALA. Users can also write their own runners by following the guidlines provided by KOALA with ease.

  • Fault tolerance: KOALA has been designed with fault tolerance mechanisms that deal with the reliability issues of the grid infrastructure.
For more information on the KOALA system, please visit the KOALA website.



Objective of the Tutorial

In this tutorial we will give an overview of the KOALA project in the general context of scheduling and resource management in grids and clouds. In particular, we will present the main problems and issues of scheduling in grids, we will discuss the toolbox we have created for performing research in scheduling in grids, and we will present the design and the implementation of the KOALA grid scheduler and the experiments on the DAS systems we have performed with it.



Tutorial Contents

TimeTopicLecturerSlides
13:00 - 14:00Resource Management in Grids and CloudsDick Epemaslides
14:00 - 14:45The KOALA SchedulerNezih Yigitbasislides
14:45 - 15:30The Delft Grid and Cloud Research ToolboxAlexandru Iosupslides
15:30 - 16:00Break
16:00 - 16:30Submitting Jobs with KOALANezih Yigitbasislides
16:30 - 18:00Hands-on Session with KOALAslides




Hands-on Session

In the KOALA hands-on session, the participants will learn how to submit and run jobs of different types through the KOALA grid scheduler on the DAS-4 system.

Note: the software you will need for the practical is available here.

Hands-on Session: Exercises.



Relevant Publications




Tutorial Presenters

  • Dick Epema, Delft University of Technology, Delft, The Netherlands.
  • Alexandru Iosup, Delft University of Technology, Delft, The Netherlands.
  • Nezih Yigitbasi, Delft University of Technology, Delft, The Netherlands.