Configure whether the GCP BigQuery Data Transfer API is enabled.

GCP > BigQuery Data Transfer

GCP > Project

GCP > BigQuery Data Transfer > Set API Enabled

Delete the GCP BigQuery Data Transfer transfer config from the cloud provider, as well as the CMDB.


GCP > BigQuery Data Transfer > Transfer Config

GCP > BigQuery Data Transfer > Transfer Config > Delete

Process events for GCP BigQuery Data Transfer service Transfer Config resources.

The router receives events from the event handler and creates, updates, or deletes Transfer Config resources in the CMDB.


GCP > BigQuery Data Transfer > Transfer Config > Router

Check whether GCP BigQuery Data Transfer API is enabled.&#92;n&#92;nAPI Enabled refers specifically to the API state of a service in a cloud project.&#92;nThis control determines whether the API state is set as per desired level.&#92;n&#92;nThe `GCP &gt; BigQuery Data Transfer &gt; API Enabled` control compares&#92;nthe API state against the API Enabled policies,&#92;nraises an alarm, and takes the defined enforcement action.&#92;n

GCP > BigQuery Data Transfer > Enabled

GCP > BigQuery Data Transfer > API Enabled

Record and synchronize details for the GCP BigQuery Data Transfer into the CMDB.&#92;n&#92;nThe [CMDB](https://turbot.com/guardrails/docs/concepts/guardrails/cmdb) control is&#92;nresponsible for populating and updating all the attributes for that&#92;nresource type in the Guardrails CMDB.&#92;n&#92;n**Note:** If CMDB is set to Skip for a resource, then it will not be added&#92;nto the CMDB, and no controls that target it will run.&#92;n

GCP > BigQuery Data Transfer > CMDB

Discover GCP BigQuery Data Transfer resources and add them to the CMDB.&#92;n&#92;nThe [Discovery](https://turbot.com/guardrails/docs/concepts/guardrails/discovery)&#92;ncontrol is tasked with identifying instances for a particular resource.&#92;nThe Discovery control will periodically search for new target resources and&#92;nsave them to the Guardrails CMDB. Once discovered, resources are then&#92;nresponsible for tracking changes to themselves through the&#92;n[CMDB](https://turbot.com/guardrails/docs/concepts/guardrails/cmdb) control.&#92;n

GCP > BigQuery Data Transfer > Discovery

Take an action when an GCP BigQuery Data Transfer transfer config is not active based on the&#92;n`GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Active &gt; *` policies.&#92;n&#92;nThe Active control determines whether the resource is in active use, and if not, has&#92;nthe ability to delete / cleanup the resource. When running an automated compliance&#92;nenvironment, it&#39;s common to end up with a wide range of alarms that are difficult&#92;nand time consuming to clear. The Active control brings automated, well-defined&#92;ncontrol to this process.&#92;n&#92;nThe Active control checks the status of all defined Active policies for the&#92;nresource (`GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Active &gt; *`),&#92;nraises an alarm, and takes the defined enforcement action. Each Active&#92;nsub-policy can calculate a status of active, inactive or skipped. Generally,&#92;nif the resource appears to be Active for any reason it will be considered Active.&#92;n&#92;n**Note** the contrast with Approved, where if the resource appears to be Unapproved&#92;nfor any reason it will be considered Unapproved.&#92;n&#92;nSee [Active](https://turbot.com/guardrails/docs/concepts/guardrails/active) for more information.&#92;n

GCP > BigQuery Data Transfer > Transfer Config > Active > Age

GCP > BigQuery Data Transfer > Transfer Config > Active > Last Modified

GCP > BigQuery Data Transfer > Transfer Config > Active

Take an action when a GCP BigQuery Data Transfer transfer config is not approved based on `GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Approved &gt; *` policies.&#92;n&#92;nThe Approved control checks the status of the defined Approved sub-policies for the resource. If the resource is not approved according to any of these policies, this control raises an alarm and takes the defined enforcement action.&#92;n&#92;nFor any enforcement actions that specify `if new`, e.g., `Enforce: Delete unapproved if new`, this control will only take the enforcement actions for resources created within the last 60 minutes.&#92;n&#92;nSee [Approved](https://turbot.com/guardrails/docs/concepts/guardrails/approved) for more information.&#92;n

GCP > BigQuery Data Transfer > Transfer Config > Approved > Custom

GCP > BigQuery Data Transfer > Transfer Config > Approved > Usage

GCP > BigQuery Data Transfer > Transfer Config > Approved

Record and synchronize details for the GCP BigQuery Data Transfer transfer config into the CMDB.&#92;n&#92;nThe [CMDB](https://turbot.com/guardrails/docs/concepts/guardrails/cmdb) control is&#92;nresponsible for populating and updating all the attributes for that&#92;nresource type in the Guardrails CMDB.&#92;n&#92;n**Note:** If CMDB is set to Skip for a resource, then it will not be added&#92;nto the CMDB, and no controls that target it will run.&#92;n

GCP > BigQuery Data Transfer > Transfer Config > CMDB

Discover GCP BigQuery Data Transfer transfer config resources and add them to the CMDB.&#92;n&#92;nThe [Discovery](https://turbot.com/guardrails/docs/concepts/guardrails/discovery)&#92;ncontrol is tasked with identifying instances for a particular resource.&#92;nThe Discovery control will periodically search for new target resources and&#92;nsave them to the Guardrails CMDB. Once discovered, resources are then&#92;nresponsible for tracking changes to themselves through the&#92;n[CMDB](https://turbot.com/guardrails/docs/concepts/guardrails/cmdb) control.&#92;n&#92;nNote that Discovery and CMDB controls also use the Regions policy&#92;nassociated with the resource. If the region is not in `GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Regions` policy, the CMDB&#92;ncontrol will delete the resource from the CMDB.&#92;n

GCP > BigQuery Data Transfer > Transfer Config > Regions

GCP > BigQuery Data Transfer > Regions

GCP > Multi-Region

GCP > BigQuery Data Transfer > Transfer Config > Discovery

The Usage control determines whether the number of GCP BigQuery Data Transfer transfer config resources exceeds the configured usage limit for this multiRegion.&#92;nYou can configure the behavior of this control with the  `GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Usage` policy, and set the limit with the `GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Usage &gt; Limit` policy.&#92;n

GCP > BigQuery Data Transfer > Transfer Config > Usage > Limit

GCP > BigQuery Data Transfer > Transfer Config > Usage

projects/932405488407/services/bigquerydatatransfer.googleapis.com

Bigquerydatatransfer

GCP Bigquerydatatransfer

bigQueryDataTransfer

bigQueryDataTransferAka

bigQueryDataTransferName

emailPreferences

encryptionConfiguration

ownerInfo

scheduleOptions

state

projects/1035367865236/locations/us/transferConfigs/663b6798-0000-25c9-821f-747446fc8aac

a123456789a123456789a123456789a123456789a123456789a123456789a12

transerConfig

transferConfigAka

invalid - invalid characters in project ID

transferConfigName

gcp-bigquerydatatransfer

A list of GCP regions in which GCP BigQuery Data Transfer resources are approved for use.&#92;n&#92;nThe expected format is an array of regions names. You may use the &#39;*&#39; and&#92;n&#39;?&#39; wildcard characters.&#92;n&#92;nThis policy is the default value for all GCP BigQuery Data Transfer resources&#39; Approved &gt; Regions policies.&#92;n

GCP > BigQuery Data Transfer > Approved Regions [Default]

Configure whether to record and synchronize details for the GCP BigQuery Data Transfer bigquery data transfer into the CMDB.&#92;n&#92;nThe [CMDB](https://turbot.com/guardrails/docs/concepts/guardrails/cmdb) control is responsible for populating and updating all the attributes for that resource type in the Guardrails CMDB.&#92;nAll policies and controls in Guardrails are based around the resource, so usually the CMDB policy is set to **&quot;Enforce: Enabled&quot;**.&#92;n&#92;nIf set to Skip then all changes to the CMDB are paused - no new resources will be discovered, no updates will be made and deleted resources will not be removed.&#92;n&#92;nTo cleanup resources and stop tracking changes, set this policy to **&quot;Enforce: Disabled&quot;**.&#92;n&#92;nCMDB controls also use the Regions policy associated with the resource. If region is not in `GCP &gt; BigQuery Data Transfer &gt; BigQuery Data Transfer &gt; Regions` policy, the CMDB control will delete the resource from the CMDB.&#92;n&#92;n(**Note**: Setting CMDB to **&quot;Skip&quot;** will also pause these changes.)&#92;n

A GCP logs [advanced filter](https://cloud.google.com/logging/docs/view/advanced-filters)&#92;nused to specify a subset of log entries that will be forwarded by the logging sink on behalf of the gcp-bigquerydatatransfer mod.&#92;nThis is a read-only policy that is used internally by Turbot.&#92;n

GCP > Turbot > Event Handlers > Logging > Sink > Compiled Filter

GCP > Turbot > Event Handlers > Logging > Sink > Compiled Filter > @turbot/gcp-bigquerydatatransfer

GCP > BigQuery Data Transfer > Permissions > Levels

Configure whether permissions policies are in effect for GCP BigQuery Data Transfer.&#92;nThis setting does not affect Project level permissions (GCP/Admin, GCP/Owner, etc).&#92;n&#92;n**Note:** The behavior of this policy depends on the value of GCP &gt; Permissions.&#92;n

GCP > BigQuery Data Transfer > Permissions

GCP > BigQuery Data Transfer > Permissions > Levels > Modifiers

Define the permissions levels that can be used to grant access to BigQuery Data Transfer&#92;nan GCP project. Permissions levels defined will appear in the UI to assign access to Guardrails users.&#92;n&#92;n**Note:** Some services do not use all permissions levels, and any permissions level that has&#92;nno permissions associated will not be created even if it is selected here.&#92;n

A map of GCP API to Guardrails Permission Level used to customize Guardrails&#39; standard permissions.&#92;nYou can add, remove or redefine the mapping of GCP API operations to Guardrails permissions levels here.&#92;n&#92;n**Note:** Modifiers are cumulative - if you add a permission to the metadata level, it is also added&#92;n to readOnly, operator and admin. Modifier policies set here will “roll up” to the GCP level too - if&#92;n you add a permission to Admin, it will be granted to GCP/Storage/Admin and also GCP/Admin&#92;n&#92;n```&#92;nexample:&#92;n  - &quot;storage.bucket.create&quot;: admin&#92;n  - &quot;sql.database.create&quot;: metadata&#92;n```&#92;n

A list of GCP regions in which GCP BigQuery Data Transfer resources are supported for use.&#92;n&#92;nThe expected format is an array of regions names. You may use the &#39;*&#39; and&#92;n&#39;?&#39; wildcard characters.&#92;n&#92;nThis policy is the default value for all GCP BigQuery Data Transfer resources&#39; Regions policies.&#92;n

A calculated policy that Guardrails uses to create a compiled list of ALL&#92;npermissions for GCP BigQuery Data Transfer that is used as&#92;ninput to the control that manages the IAM stack.&#92;n

GCP > Turbot > Permissions > Compiled > Service Permissions

GCP > Turbot > Permissions > Compiled > Service Permissions > @turbot/gcp-bigquerydatatransfer

A calculated policy that Guardrails uses to create a compiled list of ALL permission&#92;nlevels for GCP BigQuery Data Transfer that is used as input to&#92;nthe stack that manages the Guardrails IAM permissions objects.&#92;n

GCP > Turbot > Permissions > Compiled > Levels

GCP > Turbot > Permissions > Compiled > Levels > @turbot/gcp-bigquerydatatransfer

Determine the action to take when an GCP BigQuery Data Transfer transfer config, based on the `GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Active &gt; *` policies.&#92;n&#92;nThe control determines whether the resource is in active use, and if not,&#92;nhas the ability to delete / cleanup the resource. When running an automated&#92;ncompliance environment, it&#39;s common to end up with a wide range of alarms&#92;nthat are difficult and time consuming to clear. The Active control brings&#92;nautomated, well-defined control to this process.&#92;n&#92;nThe Active control checks the status of all defined Active policies for the&#92;nresource (`GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Active &gt; *`), raises an alarm, and takes the defined enforcement&#92;naction. Each Active sub-policy can calculate a status of active, inactive&#92;nor skipped. Generally, if the resource appears to be Active for any reason&#92;nit will be considered Active.&#92;n**Note** the contrast with Approved, where if the&#92;nresource appears to be Unapproved for any reason it will be considered&#92;nUnapproved.&#92;n&#92;nSee [Active](https://turbot.com/guardrails/docs/concepts/guardrails/active) for more information.&#92;n

The age after which the GCP BigQuery Data Transfer transfer config&#92;nis no longer considered active. If a create time is unavailable, the time Guardrails discovered the resource is used.&#92;n&#92;nThe [Active](https://turbot.com/guardrails/docs/concepts/guardrails/active)&#92;ncontrol determines whether the resource is in active use, and if not, has&#92;nthe ability to delete / cleanup the resource. When running an automated&#92;ncompliance environment, it&#39;s common to end up with a wide range of alarms&#92;nthat are difficult and time consuming to clear. The Active control brings&#92;nautomated, well-defined control to this process.&#92;n&#92;nThe Active control checks the status of all defined Active policies for the&#92;nresource (`GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Active &gt; *`),&#92;nraises an alarm, and takes the defined enforcement action. Each Active&#92;nsub-policy can calculate a status of active, inactive or skipped. Generally,&#92;nif the resource appears to be Active for any reason it will be considered Active.&#92;n**Note** the contrast with Approved, where if the resource appears to be Unapproved&#92;nfor any reason it will be considered Unapproved.&#92;n&#92;nSee [Active](https://turbot.com/guardrails/docs/concepts/guardrails/active) for more information.&#92;n

The number of days since the GCP BigQuery Data Transfer transfer config was last modified before it is considered&#92;ninactive.&#92;n&#92;nThe [Active](https://turbot.com/guardrails/docs/concepts/guardrails/active)&#92;ncontrol determines whether the resource is in active use, and if not, has&#92;nthe ability to delete / cleanup the resource. When running an automated&#92;ncompliance environment, it&#39;s common to end up with a wide range of alarms&#92;nthat are difficult and time consuming to clear. The Active control brings&#92;nautomated, well-defined control to this process.&#92;n&#92;nThe Active control checks the status of all defined Active policies for the&#92;nresource (`GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Active &gt; *`), raises an alarm, and takes the defined enforcement&#92;naction. Each Active sub-policy can calculate a status of active, inactive&#92;nor skipped. Generally, if the resource appears to be Active for any reason&#92;nit will be considered Active.&#92;n**Note** the contrast with Approved, where if the&#92;nresource appears to be Unapproved for any reason it will be considered&#92;nUnapproved.&#92;n

Determine the action to take when a GCP BigQuery Data Transfer transfer config is not approved based on `GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Approved &gt; *` policies.&#92;n&#92;nThe Approved control checks the status of the defined Approved sub-policies for the resource. If the resource is not approved according to any of these policies, this control raises an alarm and takes the defined enforcement action.&#92;n&#92;nFor any enforcement actions that specify `if new`, e.g., `Enforce: Delete unapproved if new`, this control will only take the enforcement actions for resources created within the last 60 minutes.&#92;n&#92;nSee [Approved](https://turbot.com/guardrails/docs/concepts/guardrails/approved) for more information.&#92;n

Determine whether the GCP BigQuery Data Transfer transfer config is allowed to exist.&#92;nThis policy will be evaluated by the Approved control. If a GCP BigQuery Data Transfer transfer config is not approved, it will be subject to the action specified in the `GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Approved` policy.&#92;nSee [Approved](https://turbot.com/guardrails/docs/concepts/guardrails/approved) for more information.&#92;n&#92;n**Note**: The policy value must be a string with a value of `Approved`, `Not approved` or `Skip`, or in the form of YAML objects. The object(s) must contain the key `result` with its value as `Approved` or `Not approved`. A custom title and message can also be added using the keys `title` and `message` respectively.&#92;n

string

Determine whether the GCP BigQuery Data Transfer transfer config is allowed to exist.&#92;n&#92;nThis policy will be evaluated by the Approved control. If a GCP BigQuery Data Transfer transfer config is not approved, it will be subject to the action specified in the `GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Approved` policy.&#92;n&#92;nSee [Approved](https://turbot.com/guardrails/docs/concepts/guardrails/approved) for more information.&#92;n

Configure whether to record and synchronize details for the GCP BigQuery Data Transfer transfer config into the CMDB.&#92;n&#92;nThe [CMDB](https://turbot.com/guardrails/docs/concepts/guardrails/cmdb) control is responsible for populating and updating all the attributes for that resource type in the Guardrails CMDB.&#92;nAll policies and controls in Guardrails are based around the resource, so usually the CMDB policy is set to **&quot;Enforce: Enabled&quot;**.&#92;n&#92;nIf set to Skip then all changes to the CMDB are paused - no new resources will be discovered, no updates will be made and deleted resources will not be removed.&#92;n&#92;nTo cleanup resources and stop tracking changes, set this policy to **&quot;Enforce: Disabled&quot;**.&#92;n&#92;nCMDB controls also use the Regions policy associated with the resource. If region is not in `GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Regions` policy, the CMDB control will delete the resource from the CMDB.&#92;n&#92;n(**Note**: Setting CMDB to **&quot;Skip&quot;** will also pause these changes.)&#92;n

A list of GCP regions in which GCP BigQuery Data Transfer transfer configs are supported for use.&#92;n&#92;nAny transfer configs in a region not listed here will not be recorded in CMDB.&#92;n&#92;nThe expected format is an array of regions names. You may use the &#39;*&#39; and&#92;n&#39;?&#39; wildcard characters.&#92;n

Configure the number of GCP BigQuery Data Transfer transfer configs that can be used for this multiRegion and the current consumption against the limit.&#92;nYou can configure the behavior of the control with this  `GCP &gt; BigQuery Data Transfer &gt; Transfer Config &gt; Usage` policy.&#92;n

Maximum number of items that can be created for this multiRegion&#92;n

The BigQuery Data Transfer service provides automated data movement to BigQuery on Google Cloud Platform (GCP). It allows users to schedule and manage data transfers from different online sources, known as data sources, into BigQuery.&#92;n

The Transfer Config resource type is a data transfer configuration that can be used to automate data movement from various sources into Big Query.&#92;n

Mod: gcp-bigquerydatatransfer

Recommended Version

Resource Types

Controls

IAM Roles

Policies