Snoring Detection (Syntiant NDP120) - Deployment

Edge Impulse Experts / Snoring Detection (Syntiant NDP120) Public

Target: Cortex-M4F 80MHz Clone this project

Configure your deployment

You can deploy your impulse to any device. This makes the model run without an internet connection, minimizes latency, and runs with minimal power consumption. Read more.

Run your model as a Docker container

To run your model as a container with an HTTP interface on NVIDIA Jetson's GPUs (JetPack 4.6.x), use:

Container:

public.ecr.aws/g7a8t7v6/inference-container-jetson:bd33296863cd39365a00dec8863c5ab51da275f1

Arguments:

--api-key ei_a4ccb59377b1c1d8d36185597f28d2595a04e1d9fb23c3d7ee7fbde7df88453e --run-http-server 1337

Ports to expose:

1337

For example, in a one-liner locally:

docker run --rm -it --runtime=nvidia --gpus all \
    -p 1337:1337 \
    public.ecr.aws/g7a8t7v6/inference-container-jetson:bd33296863cd39365a00dec8863c5ab51da275f1 \
        --api-key ei_a4ccb59377b1c1d8d36185597f28d2595a04e1d9fb23c3d7ee7fbde7df88453e \
        --run-http-server 1337

This automatically builds and downloads the latest model (incl. hardware optimizations), and runs an HTTP endpoint at http://localhost:1337 with instructions.

Read the docs for information, like bundling in your model inside the container and selecting extra hardware optimizations.

Run your model as a Docker container

To run your model as a container with an HTTP interface on NVIDIA Jetson Orin's GPUs (JetPack 5.1.x), use:

Container:

public.ecr.aws/g7a8t7v6/inference-container-jetson-orin:7ec1726b36fe1bec368959ce8bca11651ce7d99f

Arguments:

--api-key ei_a4ccb59377b1c1d8d36185597f28d2595a04e1d9fb23c3d7ee7fbde7df88453e --run-http-server 1337

Ports to expose:

1337

For example, in a one-liner locally:

docker run --rm -it --runtime=nvidia --gpus all \
    -p 1337:1337 \
    public.ecr.aws/g7a8t7v6/inference-container-jetson-orin:7ec1726b36fe1bec368959ce8bca11651ce7d99f \
        --api-key ei_a4ccb59377b1c1d8d36185597f28d2595a04e1d9fb23c3d7ee7fbde7df88453e \
        --run-http-server 1337

This automatically builds and downloads the latest model (incl. hardware optimizations), and runs an HTTP endpoint at http://localhost:1337 with instructions.

Read the docs for information, like bundling in your model inside the container and selecting extra hardware optimizations.

Run your model as a Docker container

To run your model as a container with an HTTP interface on NVIDIA Jetson Orin's GPUs (JetPack 6.0), use:

Container:

public.ecr.aws/g7a8t7v6/inference-container-jetson-orin-6-0:8615f331755ad6256a1891d2a67b920ae56870b7

Arguments:

--api-key ei_a4ccb59377b1c1d8d36185597f28d2595a04e1d9fb23c3d7ee7fbde7df88453e --run-http-server 1337

Ports to expose:

1337

For example, in a one-liner locally:

docker run --rm -it --runtime=nvidia --gpus all \
    -p 1337:1337 \
    public.ecr.aws/g7a8t7v6/inference-container-jetson-orin-6-0:8615f331755ad6256a1891d2a67b920ae56870b7 \
        --api-key ei_a4ccb59377b1c1d8d36185597f28d2595a04e1d9fb23c3d7ee7fbde7df88453e \
        --run-http-server 1337

This automatically builds and downloads the latest model (incl. hardware optimizations), and runs an HTTP endpoint at http://localhost:1337 with instructions.

Read the docs for information, like bundling in your model inside the container and selecting extra hardware optimizations.

Clone this project to deploy this impulse.

Configure your deployment

Deploy to any Linux-based development board

Run your model as a Docker container

Run your model as a Docker container

Run your model as a Docker container

Run your model as a Docker container

Latest build

Run this model

Build output

Model testing output