BigQuery
Last updated
Last updated
To connect BigQuery to Select Star, you will need...
Admin access to your BigQuery instance.
Complete all of the following steps to see BigQuery metadata, lineage, and popularity in Select Star.
Go to https://console.cloud.google.com/iam-admin/serviceaccounts.
Click + Create Service Account.
Grant the following roles to the service account:
BigQuery Job User
BigQuery Metadata Viewer
BigQuery Resource Viewer
BigQuery Data Viewer (optional: when this is turned off we won’t be able to show the detailed table information including table size, row count, etc)
Grant the selectstar@getselectstar.com user the Service account admin role.
Click Done.
In order to add more projects in your Data Source you will need to have already created service account for one of the projects and:
Navigate to IAM & Admin → Service accounts in the project you have created the service account in and copy the email.
Copy the email and save it for later.
Go to the destination project, i.e. the one that we want to grant the service account
In IAM & Admin → IAM and click on “ADD” at the top.
a. Select IAM in menu and follow the link.
b. Once in IAM, click "ADD"
Use the email of service account from step 2 (that you copied) and grant the roles from step 1
You have successfully granted your service account permissions in another project, continue those steps if you want to add more projects.
Once the Service Account is created, click the Select Star Service Account in the list.
Go to Keys tab, and click Add Key → Create new key.
Leave the Key type as JSON, and click Create. It will begin downloading the JSON file.
Save this JSON file to easily complete step 3.
Go to the Select Star Settings. Click Data in the sidebar, then + Add to create a new Data Source.
Choose BigQuery in the Source Type dropdown and provide the following information:
Display Name: This value is BigQuery by default, but you can override it if desired.
Service Account: The JSON file created in step 2 above. The JSON file will automatically populate all other fields in the modal.
After you fill in the information, you'll be asked to select the databases you'd like to load into Select Star.
Select Star will not read queries or metadata or generate lineage for databases, schemas, or tables that are not loaded. Please load all data for which you expect to see lineage.
You can change the databases and schemas you have loaded if needed.
Select the database and click Next.
For each database you selected, you'll be able to select the schemas.
Your metadata should start loading automatically. Please allow 24-48 hours to completely generate popularity and lineage.
When the sync is complete, you'll be able to explore your BigQuery instance in Select Star. See the link below for more information on BigQuery in Select Star.
Select your first project in which you have created the service account
