Upload Your Catalog File
You upload your catalog files to acatalogs folder inside the S3 bucket that was set up for you. Use any S3 tool to upload your catalog file to this bucket and folder. (If you haven’t yet set up your AWS account, see Step 3: Set Up Your AWS Account for Catalog Ingestion first.)
To upload a catalog file to an S3 bucket:
-
Type the following command, substituting your catalog file name for
<catalog_file_name.xml>and S3 bucket name for<s3_bucket_name>. Note that the--acl bucket-owner-full-controloption is required so that Amazon will be able to read the file that you upload upload, and thus ingest your catalog.This command successfully uploads files up to 2GB in size. If successful, the AWS CLI will display a set of tags for the VersionID, ETag, and Expiration for the file. -
Verify that you see your catalog file in your S3 bucket. Type the following command to list all files in your S3 bucket:
(Replace
<s3_bucket_name>with your bucket name.) You can upload multiple catalogs to the catalog bucket. However, Amazon uses only the most recently uploaded catalog, regardless of its name. If you find a problem with your catalog, or need to update the data in the catalog file, just upload a new file.
Example Workflow
The following example command uploads a catalog file namedmy-catalog.xml to an S3 bucket named cdf-bucket:
Automating the Validation and Upload Process
You can usually write a script that will automate the validation and upload process. Amazon strongly recommends validating your catalog file before attempting to upload. If you create a script, please include a validation step as part of your upload process.Additional Resources for AWS
These links provide further information on AWS and Amazon S3.- Amazon Web Services: All AWS products
- Amazon Simple Storage Service (S3): Secure object storage
- Amazon Identity and Access Management (IAM): Define users and roles for your AWS account
- Start Developing with AWS: Documentation, SDKs, and sample apps for various languages and platforms
- AWS Command Line Interface (CLI): Simple access to AWS services
- Tools for Amazon Web Services: All SDKs and sample code
- AWS SDK For Java: Integrate AWS with your Java apps
- Amazon S3 Client: Java class for accessing Amazon S3
- Upload an Object Using the AWS SDK for Java: Sample code for uploading your data to Amazon S3
Catalog Uploading FAQ
Troubleshooting
The following are common errors when uploading catalog files. “AccessDenied” response when when calling the PutObject operation. Check two things:- Make sure that when you upload your catalog file via the
aws s3api put-objectcommand, you include the--acl bucket-owner-full-controlparameter. - Make sure you set up your IAM user S3 bucket permissions properly. Review the section Grant IAM Users Access to Your Amazon S3 Bucket (this section appears in Step D in Step 3: Set Up Your AWS Account for Catalog Ingestion).

