Gobblin Schedulers

Introduction

Quartz

Azkaban

Oozie

[say a few words about Oozie]

Launching Gobblin on Oozie

This guide assumes Oozie is already setup and running on some machine, if this is not the case consult the Oozie documentation.

Launching Gobblin in Local Mode

Following the template workflow.xml and job.properties files in gobblin-oozie/src/main/resources/, make the appropriate changes for any cluster specific configurations:

• In gobblin-oozie-example-workflow.properties update the name.node, resource.manager, and oozie.wf.application.path parameters ** The oozie.wf.application.path should point to a directory on HDFS containing all workflow files
• Update the <arg> tags for the <java> <action> ** The jobconfig arg should point to a file on HDFS containing all job configuration parameters *** An example jobconfig file would be the Gobblin Wikipedia Example ** The sysconfig arg should point to a file on HDFS containing all system configuration parameters *** An example sysconfig file for Oozie can be found here