imjasonh/gcloud-help
1
0
Fork 0
mirror of https://github.com/imjasonh/gcloud-help synced 2026-07-18 06:47:12 +00:00
Code Activity

gcloud: Wed May 25 08:41:12 UTC 2022

Browse source
This commit is contained in:
Automated 2022-05-25 08:41:12 +00:00
parent bda2bf9142
commit 5b5ff68a0d
Failed to extract signature
154 changed files with 3252 additions and 284 deletions
Download patch file Download diff file Expand all files Collapse all files

19
gcloud/beta/dataproc/workflow-templates/add-job/hadoop
View file

@ -8,7 +8,7 @@ SYNOPSIS
(--workflow-template=WORKFLOW_TEMPLATE : --region=REGION)
[--archives=[ARCHIVE,...]] [--driver-log-levels=[PACKAGE=LEVEL,...]]
[--files=[FILE,...]] [--jars=[JAR,...]] [--labels=[KEY=VALUE,...]]
[--properties=[PROPERTY=VALUE,...]]
[--properties=[PROPERTY=VALUE,...]] [--properties-file=PROPERTIES_FILE]
[--start-after=STEP_ID,[STEP_ID,...]] [GCLOUD_WIDE_FLAG ...]
[-- JOB_ARGS ...]
@ -104,6 +104,23 @@ OPTIONAL FLAGS
--properties=[PROPERTY=VALUE,...]
A list of key value pairs to configure Hadoop.
--properties-file=PROPERTIES_FILE
Path to a local file or a file in a Cloud Storage bucket containing
configuration properties for the job. The client machine running this
command must have read permission to the file.
Specify properties in the form of property=value in the text file. For
example:
# Properties to set for the job:
key1=value1
key2=value2
# Comment out properties not used.
# key3=value3
If a property is set in both --properties and --properties-file, the
value defined in --properties takes precedence.
--start-after=STEP_ID,[STEP_ID,...]
(Optional) List of step IDs to start this job after.

18
gcloud/beta/dataproc/workflow-templates/add-job/hive
View file

@ -8,6 +8,7 @@ SYNOPSIS
(--workflow-template=WORKFLOW_TEMPLATE : --region=REGION)
[--continue-on-failure] [--jars=[JAR,...]] [--labels=[KEY=VALUE,...]]
[--params=[PARAM=VALUE,...]] [--properties=[PROPERTY=VALUE,...]]
[--properties-file=PROPERTIES_FILE]
[--start-after=STEP_ID,[STEP_ID,...]] [GCLOUD_WIDE_FLAG ...]
DESCRIPTION
@ -86,6 +87,23 @@ OPTIONAL FLAGS
--properties=[PROPERTY=VALUE,...]
A list of key value pairs to configure Hive.
--properties-file=PROPERTIES_FILE
Path to a local file or a file in a Cloud Storage bucket containing
configuration properties for the job. The client machine running this
command must have read permission to the file.
Specify properties in the form of property=value in the text file. For
example:
# Properties to set for the job:
key1=value1
key2=value2
# Comment out properties not used.
# key3=value3
If a property is set in both --properties and --properties-file, the
value defined in --properties takes precedence.
--start-after=STEP_ID,[STEP_ID,...]
(Optional) List of step IDs to start this job after.

18
gcloud/beta/dataproc/workflow-templates/add-job/pig
View file

@ -9,6 +9,7 @@ SYNOPSIS
[--continue-on-failure] [--driver-log-levels=[PACKAGE=LEVEL,...]]
[--jars=[JAR,...]] [--labels=[KEY=VALUE,...]]
[--params=[PARAM=VALUE,...]] [--properties=[PROPERTY=VALUE,...]]
[--properties-file=PROPERTIES_FILE]
[--start-after=STEP_ID,[STEP_ID,...]] [GCLOUD_WIDE_FLAG ...]
DESCRIPTION
@ -91,6 +92,23 @@ OPTIONAL FLAGS
--properties=[PROPERTY=VALUE,...]
A list of key value pairs to configure Pig.
--properties-file=PROPERTIES_FILE
Path to a local file or a file in a Cloud Storage bucket containing
configuration properties for the job. The client machine running this
command must have read permission to the file.
Specify properties in the form of property=value in the text file. For
example:
# Properties to set for the job:
key1=value1
key2=value2
# Comment out properties not used.
# key3=value3
If a property is set in both --properties and --properties-file, the
value defined in --properties takes precedence.
--start-after=STEP_ID,[STEP_ID,...]
(Optional) List of step IDs to start this job after.

19
gcloud/beta/dataproc/workflow-templates/add-job/presto
View file

@ -8,7 +8,7 @@ SYNOPSIS
(--workflow-template=WORKFLOW_TEMPLATE : --region=REGION)
[--client-tags=[CLIENT_TAG,...]] [--continue-on-failure]
[--driver-log-levels=[PACKAGE=LEVEL,...]] [--labels=[KEY=VALUE,...]]
[--properties=[PARAM=VALUE,...]]
[--properties=[PARAM=VALUE,...]] [--properties-file=PROPERTIES_FILE]
[--query-output-format=QUERY_OUTPUT_FORMAT]
[--start-after=STEP_ID,[STEP_ID,...]] [GCLOUD_WIDE_FLAG ...]
@ -89,6 +89,23 @@ OPTIONAL FLAGS
--properties=[PARAM=VALUE,...]
A list of key value pairs to set Presto session properties.
--properties-file=PROPERTIES_FILE
Path to a local file or a file in a Cloud Storage bucket containing
configuration properties for the job. The client machine running this
command must have read permission to the file.
Specify properties in the form of property=value in the text file. For
example:
# Properties to set for the job:
key1=value1
key2=value2
# Comment out properties not used.
# key3=value3
If a property is set in both --properties and --properties-file, the
value defined in --properties takes precedence.
--query-output-format=QUERY_OUTPUT_FORMAT
The query output display format. See the Presto documentation for
supported output formats.

23
gcloud/beta/dataproc/workflow-templates/add-job/pyspark
View file

@ -8,9 +8,9 @@ SYNOPSIS
(--workflow-template=WORKFLOW_TEMPLATE : --region=REGION)
[--archives=[ARCHIVE,...]] [--driver-log-levels=[PACKAGE=LEVEL,...]]
[--files=[FILE,...]] [--jars=[JAR,...]] [--labels=[KEY=VALUE,...]]
[--properties=[PROPERTY=VALUE,...]] [--py-files=[PY_FILE,...]]
[--start-after=STEP_ID,[STEP_ID,...]] [GCLOUD_WIDE_FLAG ...]
[-- JOB_ARGS ...]
[--properties=[PROPERTY=VALUE,...]] [--properties-file=PROPERTIES_FILE]
[--py-files=[PY_FILE,...]] [--start-after=STEP_ID,[STEP_ID,...]]
[GCLOUD_WIDE_FLAG ...] [-- JOB_ARGS ...]
DESCRIPTION
(BETA) Add a PySpark job to the workflow template.
@ -100,6 +100,23 @@ OPTIONAL FLAGS
properties, see:
https://spark.apache.org/docs/latest/configuration.html#available-properties.
--properties-file=PROPERTIES_FILE
Path to a local file or a file in a Cloud Storage bucket containing
configuration properties for the job. The client machine running this
command must have read permission to the file.
Specify properties in the form of property=value in the text file. For
example:
# Properties to set for the job:
key1=value1
key2=value2
# Comment out properties not used.
# key3=value3
If a property is set in both --properties and --properties-file, the
value defined in --properties takes precedence.
--py-files=[PY_FILE,...]
Comma separated list of Python files to be provided to the job. Must be
one of the following file formats ".py, .zip, or .egg".

19
gcloud/beta/dataproc/workflow-templates/add-job/spark
View file

@ -7,7 +7,7 @@ SYNOPSIS
(--workflow-template=WORKFLOW_TEMPLATE : --region=REGION)
[--archives=[ARCHIVE,...]] [--driver-log-levels=[PACKAGE=LEVEL,...]]
[--files=[FILE,...]] [--jars=[JAR,...]] [--labels=[KEY=VALUE,...]]
[--properties=[PROPERTY=VALUE,...]]
[--properties=[PROPERTY=VALUE,...]] [--properties-file=PROPERTIES_FILE]
[--start-after=STEP_ID,[STEP_ID,...]]
[--class=MAIN_CLASS --jar=MAIN_JAR] [GCLOUD_WIDE_FLAG ...]
[-- JOB_ARGS ...]
@ -96,6 +96,23 @@ OPTIONAL FLAGS
properties, see:
https://spark.apache.org/docs/latest/configuration.html#available-properties.
--properties-file=PROPERTIES_FILE
Path to a local file or a file in a Cloud Storage bucket containing
configuration properties for the job. The client machine running this
command must have read permission to the file.
Specify properties in the form of property=value in the text file. For
example:
# Properties to set for the job:
key1=value1
key2=value2
# Comment out properties not used.
# key3=value3
If a property is set in both --properties and --properties-file, the
value defined in --properties takes precedence.
--start-after=STEP_ID,[STEP_ID,...]
(Optional) List of step IDs to start this job after.

19
gcloud/beta/dataproc/workflow-templates/add-job/spark-r
View file

@ -8,7 +8,7 @@ SYNOPSIS
(--workflow-template=WORKFLOW_TEMPLATE : --region=REGION)
[--archives=[ARCHIVE,...]] [--driver-log-levels=[PACKAGE=LEVEL,...]]
[--files=[FILE,...]] [--labels=[KEY=VALUE,...]]
[--properties=[PROPERTY=VALUE,...]]
[--properties=[PROPERTY=VALUE,...]] [--properties-file=PROPERTIES_FILE]
[--start-after=STEP_ID,[STEP_ID,...]] [GCLOUD_WIDE_FLAG ...]
[-- JOB_ARGS ...]
@ -96,6 +96,23 @@ OPTIONAL FLAGS
properties, see:
https://spark.apache.org/docs/latest/configuration.html#available-properties.
--properties-file=PROPERTIES_FILE
Path to a local file or a file in a Cloud Storage bucket containing
configuration properties for the job. The client machine running this
command must have read permission to the file.
Specify properties in the form of property=value in the text file. For
example:
# Properties to set for the job:
key1=value1
key2=value2
# Comment out properties not used.
# key3=value3
If a property is set in both --properties and --properties-file, the
value defined in --properties takes precedence.
--start-after=STEP_ID,[STEP_ID,...]
(Optional) List of step IDs to start this job after.

19
gcloud/beta/dataproc/workflow-templates/add-job/spark-sql
View file

@ -8,7 +8,7 @@ SYNOPSIS
(--workflow-template=WORKFLOW_TEMPLATE : --region=REGION)
[--driver-log-levels=[PACKAGE=LEVEL,...]] [--jars=[JAR,...]]
[--labels=[KEY=VALUE,...]] [--params=[PARAM=VALUE,...]]
[--properties=[PROPERTY=VALUE,...]]
[--properties=[PROPERTY=VALUE,...]] [--properties-file=PROPERTIES_FILE]
[--start-after=STEP_ID,[STEP_ID,...]] [GCLOUD_WIDE_FLAG ...]
DESCRIPTION
@ -88,6 +88,23 @@ OPTIONAL FLAGS
--properties=[PROPERTY=VALUE,...]
A list of key value pairs to configure Hive.
--properties-file=PROPERTIES_FILE
Path to a local file or a file in a Cloud Storage bucket containing
configuration properties for the job. The client machine running this
command must have read permission to the file.
Specify properties in the form of property=value in the text file. For
example:
# Properties to set for the job:
key1=value1
key2=value2
# Comment out properties not used.
# key3=value3
If a property is set in both --properties and --properties-file, the
value defined in --properties takes precedence.
--start-after=STEP_ID,[STEP_ID,...]
(Optional) List of step IDs to start this job after.