Connecting to AWS S3 Storage
Amazon S3 is AWS’s object storage solution for the cloud. Object storage is optimized for storing massive amounts of unstructured data.
Last updated
Amazon S3 is AWS’s object storage solution for the cloud. Object storage is optimized for storing massive amounts of unstructured data.
Last updated
© DNAstack. All rights reserved.
Step 1: Navigate to your instance of Publisher and select menu "Data Sources" in the side navigation bar.
Step 2: On the Data Sources page, click "Connect Data Source" button.
Step 3: Click on the "AWS S3 Object Store" option from the list of connectors.
Step 4: Click "Next"
Step 5: You will require the following in order to create a connection to AWS S3 Storage:
The name of the bucket that contains the data.
The region of the bucket that contains the data.
An Access Key ID and Secret Access Key to the AWS account that contains the bucket.
If you do not have credentials for the AWS account that contains the bucket and you want to access the bucket using anonymous access, set your Access Key ID and Secret Access Key to "Anonymous"
Tip!
You can read more how to create AWS access keys here.
Step 6: Type the Bucket Name, Access Key ID, Secret Access Key, and Bucket Region. Click "Next".
Step 7: Choose the data update frequency:
Use S3 event notifications with SQS
Create an SQS that will be dedicated to consuming event notifications from your designated S3 bucket.
If not already done, grant Amazon S3 permissions to publish messages to SQS.
Enter the name of the SQS.
Regularly, on a schedule. Select the time interval.
Never, I'll turn on scheduling later.
Step 8: Click "Next".
Step 9: Type a name for the data source and click "Done".
Step 10: Once the data source has been connected, you may optionally publish a collection containing the data on available Networks by clicking "Share Collection"
