AI Cart - Object detection

Shebin Jose Jacob / AI Cart Public

Target: Cortex-M7 216MHz Clone this project

Neural Network settings

Training settings

Number of training cycles

Please provide a valid number of training cycles (numeric only)

Learning rate

Please provide a valid number for the learning rate (between 0 and 1)

Training processor

Please provide a valid training processor option

Advanced training settings

Validation set size

Please provide a valid number for the train/validate split (between 0 and 1)

Split train/validation set on metadata key

Batch size

Profile int8 model

Neural network architecture

Save

sys.path.append('./resources/libraries') import ei_tensorflow.object_detection EPOCHS = args.epochs or 80 LEARNING_RATE = args.learning_rate or 0.005 ei_tensorflow.object_detection.train(classes, LEARNING_RATE, EPOCHS, train_dataset, validation_dataset) # The 'model' variable is expected to be a Keras model. For this model type there is no keras model, # so we just set it to None. model = None

Input layer (307,200 features)

MobileNetV2 SSD FPN-Lite 320x320

Output layer (3 classes)

Model

Model version:

Last training performance (validation set)

Precision score

83.0%

On-device performance

Engine:

Inferencing time

2687 ms.

Peak RAM usage

0.0K

Flash usage

11.0M

Did you know? You can customize your model through the Expert view (click on to switch),
or can even bring your own model (in PyTorch, Keras or scikit-learn).

Model	Author
MobileNetV2 SSD FPN-Lite (320x320 only) Officially supported A pre-trained object detection model designed to locate up to 10 objects within an image, outputting a bounding box for each object detected. The model is around 3.7MB in size. It supports an RGB input at 320x320px. For other resolutions, use FOMO or an NVIDIA TAO model.	Edge Impulse
FOMO (Faster Objects, More Objects) MobileNetV2 0.1 Officially supported An object detection model based on MobileNetV2 (alpha 0.1) designed to coarsely segment an image into a grid of background vs objects of interest. These models are designed to be <100KB in size and support a grayscale or RGB input at any resolution.	Edge Impulse
FOMO (Faster Objects, More Objects) MobileNetV2 0.35 Officially supported An object detection model based on MobileNetV2 (alpha 0.35) designed to coarsely segment an image into a grid of background vs objects of interest. These models are designed to be <100KB in size and support a grayscale or RGB input at any resolution.	Edge Impulse
YOLOv5 for Renesas DRP-AI Community Transfer learning model using YOLOv5 v5 branch with yolov5s.pt weights. This block is only compatible with Renesas DRP-AI.	Renesas
YOLOv5 Community Transfer learning model based on Ultralytics YOLOv5 using yolov5n.pt weights, supports RGB input at any resolution (square images only).	Community blocks
YOLOX for TI TDA4VM Community TI's EDGEAI YOLOX. https://github.com/TexasInstruments/edgeai-yolox. Outputs ONNX v7 model format both with and without final detect layers using PyTorch 1.7.1. See the implementation https://github.com/edgeimpulse/example-custom-ml-block-ti-yolox/tree/onnx-v7	Texas Instruments
NVIDIA TAO RetinaNet Professional Enterprise Object detection model with superior performance on smaller objects. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse Inc.
NVIDIA TAO YOLOV3 Professional Enterprise Object detection model that is fast and accurate. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse Inc.
NVIDIA TAO YOLOV4 Professional Enterprise Object detection model that is fast and accurate. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse Inc.
NVIDIA TAO SSD Professional Enterprise Object detection model for general purpose use. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse Inc.

The backbone is the foundational element of a neural network model, responsible for extracting meaningful features from input data, enabling subsequent parts to perform anomaly scoring or classification.

Description	Author
EfficientNet V2B0 Uses around 1379K RAM based on your input size, and between 240-1675K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.35 Uses around 1217K RAM based on your input size, and between 69-134K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.50 Uses around 1221K RAM based on your input size, and between 78-168K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.75 Uses around 2421K RAM based on your input size, and between 109-266K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 1.0 Uses around 2431K RAM based on your input size, and between 126-372K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.1 Uses around NaNK RAM based on your input size, and 58K ROM, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse

The scoring function operates on the features extracted by the backbone, and returns anomaly scores for each segment of the image.

Description	Author	Recommended
MobileNetV2 SSD FPN-Lite (320x320 only) A pre-trained object detection model designed to locate up to 10 objects within an image, outputting a bounding box for each object detected. The model is around 3.7MB in size. It supports an RGB input at 320x320px. For other resolutions, use FOMO or an NVIDIA TAO model.	Edge Impulse
FOMO (Faster Objects, More Objects) MobileNetV2 0.1 An object detection model based on MobileNetV2 (alpha 0.1) designed to coarsely segment an image into a grid of background vs objects of interest. These models are designed to be <100KB in size and support a grayscale or RGB input at any resolution.	Edge Impulse
FOMO (Faster Objects, More Objects) MobileNetV2 0.35 An object detection model based on MobileNetV2 (alpha 0.35) designed to coarsely segment an image into a grid of background vs objects of interest. These models are designed to be <100KB in size and support a grayscale or RGB input at any resolution.	Edge Impulse
YOLOv5 for Renesas DRP-AI Transfer learning model using YOLOv5 v5 branch with yolov5s.pt weights. This block is only compatible with Renesas DRP-AI.	Edge Impulse
YOLOv5 Transfer learning model based on Ultralytics YOLOv5 using yolov5n.pt weights, supports RGB input at any resolution (square images only).	Edge Impulse
YOLOX for TI TDA4VM TI's EDGEAI YOLOX. https://github.com/TexasInstruments/edgeai-yolox. Outputs ONNX v7 model format both with and without final detect layers using PyTorch 1.7.1. See the implementation https://github.com/edgeimpulse/example-custom-ml-block-ti-yolox/tree/onnx-v7	Edge Impulse
NVIDIA TAO RetinaNet Object detection model with superior performance on smaller objects. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse
NVIDIA TAO YOLOV3 Object detection model that is fast and accurate. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse
NVIDIA TAO YOLOV4 Object detection model that is fast and accurate. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse
NVIDIA TAO SSD Object detection model for general purpose use. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse

These users will be notified over email when this job finishes.

	Name
	Shebin Jose Jacob

Neural Network settings

Training settings

Augmentation settings

Advanced training settings

Neural network architecture

Model

Last training performance (validation set)

Precision score

Confusion matrix (validation set)

Data explorer (full training set)

On-device performance

Inferencing time

Peak RAM usage

Flash usage

MobileNetV2 SSD FPN-Lite (320x320 only)
Officially supported

FOMO (Faster Objects, More Objects) MobileNetV2 0.1
Officially supported

FOMO (Faster Objects, More Objects) MobileNetV2 0.35
Officially supported

YOLOv5 for Renesas DRP-AI
Community

YOLOv5
Community

YOLOX for TI TDA4VM
Community

NVIDIA TAO RetinaNet
Professional

Enterprise

NVIDIA TAO YOLOV3
Professional

Enterprise

NVIDIA TAO YOLOV4
Professional

Enterprise

NVIDIA TAO SSD
Professional

Enterprise

EfficientNet V2B0

MobileNetV2 0.35

MobileNetV2 0.50

MobileNetV2 0.75

MobileNetV2 1.0

MobileNetV2 0.1

MobileNetV2 SSD FPN-Lite (320x320 only)

FOMO (Faster Objects, More Objects) MobileNetV2 0.1

FOMO (Faster Objects, More Objects) MobileNetV2 0.35

YOLOv5 for Renesas DRP-AI

YOLOv5

YOLOX for TI TDA4VM

NVIDIA TAO RetinaNet

NVIDIA TAO YOLOV3

NVIDIA TAO YOLOV4

NVIDIA TAO SSD

Neural Network settings

Training settings

Augmentation settings

Advanced training settings

Neural network architecture

Model

Last training performance (validation set)

Precision score

Confusion matrix (validation set)

Data explorer (full training set)

Settings

On-device performance

Inferencing time

Peak RAM usage

Flash usage