mirror of
https://github.com/imjasonh/gcloud-help
synced 2026-07-15 09:25:44 +00:00
84 lines
2.4 KiB
Text
84 lines
2.4 KiB
Text
NAME
|
|
gcloud alpha dataproc workflow-templates add-job - add Dataproc jobs to
|
|
workflow template
|
|
|
|
SYNOPSIS
|
|
gcloud alpha dataproc workflow-templates add-job COMMAND
|
|
[GCLOUD_WIDE_FLAG ...]
|
|
|
|
EXAMPLES
|
|
To add a Hadoop MapReduce job, run:
|
|
|
|
$ gcloud alpha dataproc workflow-templates add-job hadoop \
|
|
--workflow-template my_template --jar my_jar.jar -- arg1 arg2
|
|
|
|
To add a Spark Scala or Java job, run:
|
|
|
|
$ gcloud alpha dataproc workflow-templates add-job spark \
|
|
--workflow-template my_template --jar my_jar.jar -- arg1 arg2
|
|
|
|
To add a PySpark job, run:
|
|
|
|
$ gcloud alpha dataproc workflow-templates add-job pyspark \
|
|
--workflow-template my_template my_script.py -- arg1 arg2
|
|
|
|
To add a Spark SQL job, run:
|
|
|
|
$ gcloud alpha dataproc workflow-templates add-job spark-sql \
|
|
--workflow-template my_template --file my_queries.q
|
|
|
|
To add a Pig job, run:
|
|
|
|
$ gcloud alpha dataproc workflow-templates add-job pig \
|
|
--workflow-template my_template --file my_script.pig
|
|
|
|
To add a Hive job, run:
|
|
|
|
$ gcloud alpha dataproc workflow-templates add-job hive \
|
|
--workflow-template my_template --file my_queries.q
|
|
|
|
GCLOUD WIDE FLAGS
|
|
These flags are available to all commands: --help.
|
|
|
|
Run $ gcloud help for details.
|
|
|
|
COMMANDS
|
|
COMMAND is one of the following:
|
|
|
|
hadoop
|
|
(ALPHA) Add a hadoop job to the workflow template.
|
|
|
|
hive
|
|
(ALPHA) Add a Hive job to the workflow template.
|
|
|
|
pig
|
|
(ALPHA) Add a Pig job to the workflow template.
|
|
|
|
presto
|
|
(ALPHA) Add a Presto job to the workflow template.
|
|
|
|
pyspark
|
|
(ALPHA) Add a PySpark job to the workflow template.
|
|
|
|
spark
|
|
(ALPHA) Add a Spark job to the workflow template.
|
|
|
|
spark-r
|
|
(ALPHA) Add a SparkR job to the workflow template.
|
|
|
|
spark-sql
|
|
(ALPHA) Add a SparkSql job to the workflow template.
|
|
|
|
trino
|
|
(ALPHA) Add a Trino job to the workflow template.
|
|
|
|
NOTES
|
|
This command is currently in alpha and might change without notice. If this
|
|
command fails with API permission errors despite specifying the correct
|
|
project, you might be trying to access an API with an invitation-only early
|
|
access allowlist. These variants are also available:
|
|
|
|
$ gcloud dataproc workflow-templates add-job
|
|
|
|
$ gcloud beta dataproc workflow-templates add-job
|
|
|