Use the Alexa Automated Testing Service (Beta)

Smart home skills are now called smart home add-ons. No action is needed, and your existing integration will continue to operate normally.

Important: Amazon offers this feature as beta. The feature might change as Amazon receives feedback and iterates on the functionality.

Use the Alexa Automated Testing Service (ATS) in the Alexa developer console to test device control for your Alexa-connected smart home devices. ATS supports both smart home add-ons and Matter protocol implementations. The testing service lets you create test plans by using natural language instead of complex JSON definitions. Choose from pre-built templates or build custom tests that meet your specific requirements.

For details about other test tools, see Test and Debug Your Smart Home Add-on.

How it works

ATS provides pre-defined templates, or you can create custom test plans. To build a test, you describe what you want to test as natural-language utterances and ATS creates a test plan. For example, to test a light bulb with color control, you might add the utterance, "Alexa, set the ${deviceName} to blue."

When you run the test plan, ATS sends voice commands to your device through Alexa and validates the device response and state change reports. After the test completes, you receive a detailed test report with pass and fail results and error descriptions for any failures.

Supported templates

ATS provides pre-defined templates for the following Alexa interfaces:

For template details and the test cases included in each template, see Pre-Built Template Library.

When to use ATS

You can use the testing service throughout the development lifecycle to perform the following tasks:

Test during development – Validate your smart home add-on or Matter integration as you build.
Debug device integration issues – Identify and resolve device integration problems.
Prepare for certification – Validate device behavior before you submit your product for Works with Alexa (WWA) certification.
Create regression tests – Build reusable test plans to verify that updates don't break existing functionality.

Note: You can only see information for the Amazon developer account that you use to sign in to the Alexa developer console. ATS doesn't show information from other developer accounts.

Prerequisites

Before you start, make sure that you have the following items:

An Amazon developer account.
An Alexa-enabled device, such as an Amazon Echo. Make sure that you sign in to the Echo device with the same credentials as your Amazon developer account.
At least one test device connected to your developer account. Make sure your device is discoverable and responds to Alexa commands.
The device under test and Echo device registered to the same account and available in the Alexa app.
For add-on-enabled devices, you must meet the following prerequisites:
- Your smart home add-on must be available in the developer console and you must configure the minimum configuration for a smart home add-on.
- Deploy your add-on code in an AWS Lambda function to provide communication between Alexa and your device.
- Enable your add-on in the Alexa app. Make sure that you sign in to the Alexa app with the same credentials as your Alexa developer account.
- Configure account linking and successfully link your device account with your Alexa account.
For Matter-enabled devices, you must meet the following prerequisites:
- Commission your device on the same Alexa fabric as your Echo device.
- Have your device local ID available.

Get started

To get started testing your device, create a test plan and run tests against your device.

Create a test plan – Choose from a pre-built template, customize a template, or build a custom test plan. For step-by-step instructions, see Create Test Plans.
Run the test plan – Select your test plan, choose your devices, and run the test. For step-by-step instructions, see Run Test Plans.

Was this page helpful?

Provide feedback

Last updated: Sep 21, 2026