GCP BigQuery audit logs

In this mode, the package will monitor all the jobs that written to a GCP BigQuery Audit logs table instead of using INFORMATION_SCHEMA.JOBS one.

tip

To get the best out of this mode, you should enable the should_combine_audit_logs_and_information_schema setting to combine both sources. More details on the related page.

To enable the "cloud audit logs mode", you'll need to define explicitly mandatory settings to set in the dbt_project.yml file:

vars:
  enable_gcp_bigquery_audit_logs: true
  gcp_bigquery_audit_logs_storage_project: 'my-gcp-project'
  gcp_bigquery_audit_logs_dataset: 'my_dataset'
  gcp_bigquery_audit_logs_table: 'my_table'
  # should_combine_audit_logs_and_information_schema: true # Optional, default to false but you might want to combine both sources

You might use environment variable as well.