Tutorial: Recognize sounds from audio - NN Classifier

Edge Impulse Inc. / Tutorial: Recognize sounds from audio Public

Target: Raspberry Pi 4 Clone this project

Model

Model version:

Last training performance (validation set)

Accuracy

100.0%

Loss

0.00

Confusion matrix (validation set)

Loading...

Metrics (validation set)

Metric	Value
Area under ROC Curve	1.00
Weighted average Precision	1.00
Weighted average Recall	1.00
Weighted average F1 score	1.00

Data explorer (full training set)

Loading...

On-device performance

Engine:

Inferencing time

1 ms.

Peak RAM usage

15.7K

Flash usage

33.1K

Did you know? You have access to the full set of Keras layers through the Expert view (click on to switch),
or can even bring your own model (in PyTorch, Keras or scikit-learn).

Layer type
Dense Fully connected layer, the simplest form of a neural network layer. Use this for processed data, such as the output of a spectral analysis DSP block.
1D Convolution / pooling Learn features that take spatial information into account along a single dimension. Use this for raw data, or for DSP blocks that output spatial data, such as the MFCC block.
2D Convolution / pooling Learn features that take spatial information into account along two dimensions. Use this for raw data, or for DSP blocks that output spatial data, such as the MFCC block.
Reshape Turn one-dimensional data from a DSP block into multi-dimensional data. Use this as an input to a convolutional layer. Use this for deep learning on raw data, or to process MFCC output.
Flatten Flatten multi-dimensional data into a single dimension. You need to flatten data from a convolutional layer before returning.
Dropout Reduce the risk of a model overfitting your dataset by randomly cutting a fraction of network connections during training. Can be helpful if your model's training performance is better than its validation performance.

Complete architectures

Model	Author
PyTorch MLP example (20x10 hidden layers) Enterprise Custom ML block with PyTorch	Edge Impulse Inc.
MCSA Enterprise A learning block designed specifically for the MCSA project.	Edge Impulse Inc.
Linear regression (scikit-learn) Enterprise Implementation of sklearn.linear_model.LogisticRegression	Edge Impulse Inc.
LGBM Random Forest Enterprise LGBM Random Forest	Edge Impulse Inc.
LGBM Binary Classification Enterprise LGBM Binary Classification	Edge Impulse Inc.
LGBM Random Forest Classifier Professional Enterprise The LightGBM Random Forest Classifier is an efficient, gradient-boosting framework that builds multiple decision trees in parallel for robust and scalable classification tasks.	Edge Impulse Inc.
XGBoost Random Forest Classifier Professional Enterprise The XGBoost Random Forest Classifier leverages the strengths of both gradient boosting and random forest methodologies to provide a powerful, efficient, and scalable solution for classification tasks.	Edge Impulse Inc.
SVM Classifier Professional Enterprise The scikit-learn SVM classifier is a powerful algorithm that constructs a hyperplane or set of hyperplanes in a high-dimensional space for classification, effectively handling both linear and non-linear data.	Edge Impulse Inc.
Random Forest Classifier Professional Enterprise The scikit-learn Random Forest Classifier is a versatile machine learning algorithm that builds multiple decision trees and merges their predictions for robust and accurate classification.	Edge Impulse Inc.
Logistic Regression Professional Enterprise The scikit-learn Logistic Regressor is a linear model for classification that estimates probabilities using a logistic function, effectively handling binary and multiclass classification tasks.	Edge Impulse Inc.
Ridge Classifier Professional Enterprise The scikit-learn Ridge classifier employs L2 regularization to optimize a linear classification model, mitigating overfitting by penalizing large coefficients, thereby enhancing model generalizability across diverse datasets.	Edge Impulse Inc.
RidgeCV Classifier Professional Enterprise The scikit-learn RidgeCV classifier is a linear regression model with built-in cross-validation that applies ridge regularization to prevent overfitting and improve prediction accuracy.	Edge Impulse Inc.

The backbone is the foundational element of a neural network model, responsible for extracting meaningful features from input data, enabling subsequent parts to perform anomaly scoring or classification.

Description	Author
EfficientNet V2B0 Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.35 Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.50 Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.75 Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 1.0 Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.1 Supports both RGB and grayscale.	Edge Impulse

The scoring function operates on the features extracted by the backbone, and returns anomaly scores for each segment of the image.

Description	Author	Recommended
PyTorch MLP example (20x10 hidden layers) Custom ML block with PyTorch	Edge Impulse
MCSA A learning block designed specifically for the MCSA project.	Edge Impulse
Linear regression (scikit-learn) Implementation of sklearn.linear_model.LogisticRegression	Edge Impulse
LGBM Random Forest LGBM Random Forest	Edge Impulse
LGBM Binary Classification LGBM Binary Classification	Edge Impulse
LGBM Random Forest Classifier The LightGBM Random Forest Classifier is an efficient, gradient-boosting framework that builds multiple decision trees in parallel for robust and scalable classification tasks.	Edge Impulse
XGBoost Random Forest Classifier The XGBoost Random Forest Classifier leverages the strengths of both gradient boosting and random forest methodologies to provide a powerful, efficient, and scalable solution for classification tasks.	Edge Impulse
SVM Classifier The scikit-learn SVM classifier is a powerful algorithm that constructs a hyperplane or set of hyperplanes in a high-dimensional space for classification, effectively handling both linear and non-linear data.	Edge Impulse
Random Forest Classifier The scikit-learn Random Forest Classifier is a versatile machine learning algorithm that builds multiple decision trees and merges their predictions for robust and accurate classification.	Edge Impulse
Logistic Regression The scikit-learn Logistic Regressor is a linear model for classification that estimates probabilities using a logistic function, effectively handling binary and multiclass classification tasks.	Edge Impulse
Ridge Classifier The scikit-learn Ridge classifier employs L2 regularization to optimize a linear classification model, mitigating overfitting by penalizing large coefficients, thereby enhancing model generalizability across diverse datasets.	Edge Impulse
RidgeCV Classifier The scikit-learn RidgeCV classifier is a linear regression model with built-in cross-validation that applies ridge regularization to prevent overfitting and improve prediction accuracy.	Edge Impulse

These users will be notified over email when this job finishes.

	Name
	Louis Moreau Edge Impulse staff

Neural Network settings

Training settings

Augmentation settings

Advanced training settings

Audio training options

Neural network architecture

Architecture presets

Model

Last training performance (validation set)

Accuracy

Loss

Confusion matrix (validation set)

Metrics (validation set)

Data explorer (full training set)

Settings

On-device performance

Inferencing time

Peak RAM usage

Flash usage

Last training performance (validation set)

Accuracy

Loss

Confusion matrix (validation set)

Metrics (validation set)

Data explorer (full training set)

Settings

On-device performance

Inferencing time

Peak RAM usage

Flash usage