AWS Data Exchange is a service that allows AWS users to quickly identify, subscribe to, and use third-party data in the AWS Cloud. Using the AWS Data Exchange console or APIs, you can create, browse, manage, and retrieve data sets for use across a number of AWS analytics and machine learning services.
In this blog, we will discuss Amazon Data Exchange:
- Overview of AWS Data Exchange
- Why AWS Data Exchange?
- How does it work?
- Features
- Benefits
- Security
- Pricing
- FAQ’S
What is AWS Data Exchange?
AWS Data Exchange is a service that allows users to quickly identify, subscribe to, and use third-party data in the AWS Cloud. It provides you with a secure and effective distribution mechanism for your data to reach millions of AWS customers. It eliminates the requirement for data storage, delivery, billing, and entitlement infrastructure to be established and maintained.
In addition to attracting new clients, you can provide free entitlements to your existing customers. It provides a single API through which new and existing customers can consume your data in the AWS Cloud.
Why AWS Exchange Data?
There is no other place where you can find data files, data tables, and data APIs from a wide range of data sets and data categories.
AWS Exchange Data is the world’s most comprehensive service for third-party data sets-
- It is the only data marketplace with over 3,000 products from 250 providers delivered directly to the data lakes, applications, analytics, and machine learning models that use it via files, APIs, or Amazon Redshift queries.
- It allows you to centralize all third-party data consumption, from existing subscriptions — which you can migrate at no additional cost to you or the provider — to future data subscriptions.
- Data Exchange AWS, as an AWS service, is secure and compliant, integrates with AWS and third-party tools and services, and provides consolidated billing and subscription management.
How does it work?
Data is classified into three types: data sets, revisions, and assets. A data set is a collection of connected data (for example, end-of-day pricing for US stocks trading). Data sets go through a succession of updates that data providers publish as needed to make new assets available.
An asset is any file that may be saved in Amazon Simple Storage Service (S3) (for example, CSV, Parquet, or picture files). A product allows subscribers to access data sets. A product consists of one or more data sets, metadata that allows the product to be found in AWS Marketplace, pricing, and a Data Subscription Agreement that your consumers must agree to before subscribing.
Features of Data AWS exchange-
- Hundreds of commercial data products- You can easily search the AWS Data Exchange catalog for a variety of current commercial data products relevant to financial services, healthcare, life sciences, geospatial, consumer, media and entertainment, and other industries.
- Hundreds of free and open data products- You can easily search the AWS Data Exchange catalog for a variety of current commercial data products relevant to financial services, healthcare, life sciences, geospatial, consumer, media and entertainment, and other industries.
- Simple yet sensible setup- It has registration wizards that guide you through the process of creating a profile page and completing registration in minutes.
- Customize the offer terms-You can also make private offers with terms that differ from those offered to the general public for chosen subscribers. You can also set the price, length, payment schedule, data subscription agreement, and return policy.
- Fast, direct access to data- Because data providers have already published data sets to AWS Data Exchange, you can consume the data in the cloud quickly without having to build custom tools and infrastructure for each data provider.
- Integration with the entire AWS service portfolio-AWS Data Exchange data can be exported fast to Amazon Simple Storage Service (S3) and analyzed with Amazon Athena and Amazon Redshift.
Benefits-
- Easily package and publish data products- You can package and publish data sets inside free or paid products in minutes for the price and terms you specify, and customers are billed through their AWS invoice.
- Reach millions of AWS customers- Customers will be able to find, subscribe to, and integrate your published data products into the data lakes, applications, analytics, and machine learning (ML) that they run on AWS.
- Built-in security and compliance controls- End-to-end encryption is provided by AWS Data Exchange, which secures all data in transit and at rest. You can also enable subscription verification on any product.
Security –
At AWS, cloud security is of the utmost importance. As an AWS customer, you have access to multiple data centers and network architecture designed to meet the needs of the most secure organizations.
Security is a shared responsibility between AWS and you. The shared responsibility model describes this as security of the cloud and security in the cloud:
- Security of the cloud – AWS is in charge of safeguarding the infrastructure that enables AWS services to be delivered in the AWS Cloud. AWS also provides you with security services. Third-party auditors regularly test and verify the effectiveness of our security as part of AWS compliance programs.
- Security in the cloud – The AWS services you use determine your responsibility. You are also responsible for other factors such as the sensitivity of your data, the requirements of your organization, and applicable laws and regulations.
AWS Data Exchange Pricing-
It enables AWS customers to exchange and use third-party data in the cloud in a secure manner. The fees for using AWS Data Exchange are determined by your actions as a data subscriber or data provider.
- Data product fees-
Subscription-based products: On the product detail page for products that support subscription pricing, you can see a list of prices that vary by subscription durations set by the data provider.
Pay-as-you-go based products: You will be charged for your usage during the calendar month, as well as any applicable sales taxes. - Data transfer fees- When importing or exporting file-based assets across AWS Regions, the standard Amazon Simple Storage Service (S3) rates apply. Standard internet transfer rates apply when using signed URLs to export file-based assets.
-
AWS service costs- You will be charged if you use AWS services to store, process, or analyze data products. Each service’s charges are billed to your AWS account in accordance with your pricing plan.
-
Tiered fulfillment fees- It charges tiered fulfillment fees for all new subscriptions to your data products that are collected by AWS.
Frequently Asked Questions
What AWS Regions is AWS Data Exchange available in?
It features a unified global product library that suppliers can access from any supported AWS Region. The product's resources (data sets, revisions, and assets) are regional resources in specific AWS Regions that you control programmatically or using the AWS Data Exchange UI. AWS Regions where AWS Data Exchange is currently available are listed in service endpoints.
What is the difference between AWS Data Exchange and the Registry of Open Data on AWS?
AWS Data Exchange requires customers to explicitly agree to the Data Subscription Agreement, which outlines the terms that the data provider set when publishing their product, whereas open data has no terms of use and is governed solely by the provider-specific open data license. Customers must use an AWS account to subscribe to commercial or free data sets, whereas open data sets can be accessed via S3 APIs without requiring any authentication.
What type of data can I subscribe to on AWS Data Exchange?
It now has over 3,000 data products from a variety of domains, including financial services (for example, top US businesses by revenue); healthcare and life sciences (for example, population health management); geospatial (for example, satellite imagery); weather (for example, historical and future temperature trajectories); and mapping (for example, street-level imagery and foot traffic patterns).
What happens if I need to remove data from AWS Data Exchange?
A product’s price or Data Subscription Agreement (DSA) can be removed or changed at any time, but existing subscriptions will remain in effect until their next renewal. If a data provider publishes data incorrectly, you can open a support case to have the data removed.
Related Links/References
- AWS Certified Solutions Architect Associate SAA-CO3
- AWS Free Tier: Create an Account
- Overview of Amazon Web Services & Concepts
- Storage – Amazon Elastic Compute Cloud – AWS Documentation
- What is Cloud Storage?
- AWS Management Console Walkthrough
Next Task For You
Begin your journey towards an AWS Cloud by joining our FREE Informative Class on Amazon Cloud Free Class by clicking on the below image.
Leave a Reply