BigQuery

Learn how to connect to your BigQuery data warehouse to Select Star and retrieve metadata from your datasets. This guide will provide you with the necessary steps to get started.

Before you start

To connect BigQuery to Select Star, you will need...

• Admin access to your BigQuery instance.

Complete all of the following steps to see BigQuery metadata, lineage, and popularity in Select Star.

1. Create a service account for Select Star

2. Create a new JSON key

3. Connect BigQuery to Select Star

4. Choose databases and schemas

1. Create a Service Account for Select Star

Go to https://console.cloud.google.com/iam-admin/serviceaccounts.

Click + Create Service Account.

Grant the following roles to the service account:

• BigQuery Job User

• BigQuery Metadata Viewer

• BigQuery Resource Viewer

• BigQuery Data Viewer (optional: when this is turned off we won’t be able to show the detailed table information including table size, row count, etc)

Grant the [e-mail] user the Service account admin role.

Click Done.

Adding more projects

In order to add more projects in your Data Source you will need to have already created service account for one of the projects and:

1. Select your first project in which you have created the service account

2. Navigate to IAM & Admin → Service accounts in the project you have created the service account in and copy the email.

   

   Copy the email and save it for later.

   

3. Go to the destination project, i.e. the one that we want to grant the service account

   

4. In IAM & Admin → IAM and click on “ADD” at the top.

   a. Select IAM in menu and follow the link.

   

   b. Once in IAM, click "ADD"

   

5. Use the email of service account from step 2 (that you copied) and grant the roles from step 1

   

6. You have successfully granted your service account permissions in another project, continue those steps if you want to add more projects.

2. Create a new JSON Key

Once the Service Account is created, click the Select Star Service Account in the list.

Go to Keys tab, and click Add Key → Create new key.

Leave the Key type as JSON, and click Create. It will begin downloading the JSON file.

Save this JSON file to easily complete step 3.

3. Connect BigQuery to Select Star

Go to the Select Star Settings. Click Data in the sidebar, then + Add to create a new Data Source.

Choose BigQuery in the Source Type dropdown and provide the following information:

• Display Name: This value is BigQuery by default, but you can override it if desired.

• Service Account: The JSON file created in step 2 above. The JSON file will automatically populate all other fields in the modal.

4. Choose databases and schemas

After you fill in the information, you'll be asked to select the databases you'd like to load into Select Star.

Select Star will not read queries or metadata or generate lineage for databases, schemas, or tables that are not loaded. Please load all data for which you expect to see lineage.

You can change the databases and schemas you have loaded if needed.

Select the database and click Next.

For each database you selected, you'll be able to select the schemas.

Your metadata should start loading automatically. Please allow 24-48 hours to completely generate popularity and lineage.

When the sync is complete, you'll be able to explore your BigQuery instance in Select Star. See the link below for more information on BigQuery in Select Star.

Getting Started: BigQueryBigQuery Description Sync (beta)