e-learning

Running Jobs on Remote Resources with Pulsar

View material

Abstract

Pulsar is the Galaxy Project's remote job running system. It was written by John Chilton (@jmchilton) of the Galaxy Project. It is a python server application that can accept jobs from a Galaxy server, submit them to a local resource and then send the results back to the originating Galaxy server.

About This Material

This is a Hands-on Tutorial from the GTN which is usable either for individual self-study, or as a teaching material in a classroom.

Questions this will address

  • How does pulsar work?
  • How can I deploy it?

Learning Objectives

  • Have an understanding of what Pulsar is and how it works
  • Install and configure a RabbitMQ message queueing server
  • Install and configure a Pulsar server on a remote linux machine
  • Be able to get Galaxy to send jobs to a remote Pulsar server

Licence: Creative Commons Attribution 4.0 International

Keywords: Galaxy Server administration, ansible, git-gat, jobs

Target audience: Galaxy Administrators

Resource type: e-learning

Version: 48

Status: Active

Prerequisites:

  • A server/VM on which to deploy Pulsar
  • Ansible
  • Connecting Galaxy to a compute cluster
  • Galaxy Installation with Ansible
  • Mapping Jobs to Destinations using TPV
  • Reference Data with CVMFS

Learning objectives:

  • Have an understanding of what Pulsar is and how it works
  • Install and configure a RabbitMQ message queueing server
  • Install and configure a Pulsar server on a remote linux machine
  • Be able to get Galaxy to send jobs to a remote Pulsar server

Date modified: 2024-06-14

Date published: 2019-01-28

Authors: Gianmauro Cuccuru, Helena Rasche, Marius van den Beek, Mira Kuntz, Nate Coraor, Simon Gladman

Contributors: Gianmauro Cuccuru, Helena Rasche, Marius van den Beek, Mira Kuntz, Nate Coraor, Simon Gladman

Activity log