Manual setup
Last updated
Was this helpful?
Last updated
Was this helpful?
This guide provides comprehensive instructions for manually setting up Redshift integration with Select Star. The setup process includes creating an IAM role, configuring Redshift logging, managing databases and users, and establishing network access. Follow these steps carefully to ensure a successful integration.
Use this manual process if automatic integration using the AWS CloudFormation template is not possible. However, it is strongly recommended to to minimize manual errors and ensure all necessary steps are completed efficiently.
1. Go to the Select Star Settings. Click Data in the sidebar, then + Add to create a new Data Source.
2. Fill in the required information:
zSource Type:** Select "Redshift"
Display Name: This value is Redshift by default, but you can override it if desired.
Cluster Name: The name of your AWS Redshift cluster in the AWS management console. Also known as "Cluster identifier" by AWS.
Database: The name of the database in AWS Redshift you've given us access to.
AWS Region: ID of the AWS region where the cluster was created. For example us-east-2, us-west-1, eu-central-1.
3. Click Connect.
Log into the AWS Management Console
Ensure you have the necessary permissions to manage Redshift clusters and VPC.
Ensure the Cluster is Available
The cluster should be publicly accessible. Modify the cluster if necessary.
In the “Properties” Tab Scroll to the “Database Configurations” Section
Enable Audit Logging:
Use the "Edit" button to enable audit logging by specifying an S3 bucket for logs.
If the Current Parameter Group is Default, Create a New Custom Parameter Group
Base it on the family of the existing parameter group.
Apply This New Parameter Group to Your Cluster
Modify the Custom Parameter Group
Set the enable_user_activity_logging parameter to true.
Reboot the Cluster if Changes Require It
Operations such as switching the parameter group or modifying its parameters may require a restart to apply.
If required by your organization's management policy, ensure to schedule downtime before restarting the cluster.
Go to the “Query Editor” in Redshift
Run SQL Commands to Create Users or Grant Permissions:
Retry operation in context of each database which should be ingested in SelectStar
1. Navigate to the AWS IAM Console 2. Create a new IAM Role 3. Note ARN of AWS IAM Role
It will be required in Select Star UI. 4. Use In-line Permission Policy:
Replace placeholders like {cluster_name}, {region_id}, {account_id}, {bucket}, etc., with your specific details.
5. Use for AWS IAM Role Assume Policy:
Replace placeholders like {select_star_principal_id} and {external_id} with values specific for your data source instance. Please contact Select Star support to obtain values after creating the data source. They are also encoded in the link "Open CloudFormation" in Select Star UI.
To create an AWS VPC ingress rule for your Redshift cluster to allow access from specific IP addresses of the Select Star platform (3.23.108.85/32 and 3.20.56.105/32) via the AWS Management Console, follow these steps:
Navigate to the VPC Console: In the AWS Management Console, go to "Services" and select "VPC".
Open Security Groups: In the VPC dashboard, locate and click on "Security Groups" in the left-hand navigation pane.
Find the Redshift Cluster’s Security Group: If you know the Security Group ID associated with your Redshift cluster, find it directly. Otherwise, navigate to the Redshift dashboard, select your cluster, and note the Security Group under its properties.
Select the Security Group: Click on the relevant Security Group for your Redshift cluster.
Switch to the “Inbound Rules” Tab: Click on the “Inbound rules” tab.
Click on “Edit Inbound Rules”: Click the "Edit inbound rules" button.
Add a Rule for the First IP:
Click “Add Rule”.
For “Type”, select “Redshift” (default port is TCP 5439).
Select "Custom" in "Source" and enter 3.23.108.85/32.
Optionally, add a description.
Add a Rule for the Second IP:
Click “Add Rule” again.
Repeat the same steps but enter 3.20.56.105/32 in “Source”.
Review and Save the Rules: Ensure the rules are correctly set up, then click “Save rules” to apply the new inbound rules.
Always confirm that you are modifying the correct security group associated with your Redshift cluster to avoid any unintended access issues.
1. Return to Select Star. You should see a form that allows you to provide the "Role ARN". Fill in the required information:
Role ARN: Identifier of the AWS IAM Role to use by Select Star. You'll see this after creating the new IAM Role.
2. Click Connect.
After you fill in the information, you'll be asked to select the databases you'd like to load into Select Star.
Select the database and click Next.
For each database you selected, you'll be able to select the schemas.
Your metadata should start loading automatically. Please allow 24-48 hours to completely generate popularity and lineage.
When the sync is complete, you'll be able to explore Redshift in Select Star.
Replace placeholders like {cluster}, {role}, {bucket}, {db}, etc., with your specific details.
Some steps may require waiting for the cluster to become available after changes.
Always verify changes and ensure they align with your infrastructure and security policies.
For instances operating within a non-publicly accessible environment, such as an AWS VPC, please refer to our guide on for detailed instructions and best practices.
For details, refers to AWS documentation about .
For details, refers to AWS documentation about .
You can you have loaded if needed.
