AI-driven Interactive Lab Assistant - Object detection

Edge Impulse Experts / AI-driven Interactive Lab Assistant Public

Target: Cortex-M4F 80MHz Clone this project

Neural Network settings

Training settings

Number of training cycles

Please provide a valid number of training cycles (numeric only)

Use learned optimizer

Learning rate

Please provide a valid number for the learning rate (between 0 and 1)

Training processor

Please provide a valid training processor option

Data augmentation

Advanced training settings

Validation set size

Please provide a valid number for the train/validate split (between 0 and 1)

Split train/validation set on metadata key

Batch size

Profile int8 model

Neural network architecture

Save

1
2
sys.path.append('./resources/libraries')
import os
 
 
הההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההה
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX

Input layer (90,000 features)

FOMO (Faster Objects, More Objects) MobileNetV2 0.35

Output layer (10 classes)

Model

Model version:

Last training performance (validation set)

F1 score

100.0%

Confusion matrix (validation set)

	background	alcohol_burner	bunsen_burner	dynamometer	forcep	hatchery	microscope	microscope_slide	skeleton_model	spoon_spatula	test_tube
background	100%	0%	0%	0%	0%	0%	0%	0%	0%	0%	0%
alcohol_burner	-	-	-	-	-	-	-	-	-	-	-
bunsen_burner	-	-	-	-	-	-	-	-	-	-	-
dynamometer	0%	0%	0%	100%	0%	0%	0%	0%	0%	0%	0%
forcep	0%	0%	0%	0%	100%	0%	0%	0%	0%	0%	0%
hatchery	0%	0%	0%	0%	0%	100%	0%	0%	0%	0%	0%
microscope	0%	0%	0%	0%	0%	0%	100%	0%	0%	0%	0%
microscope_slide	0%	0%	0%	0%	0%	0%	0%	100%	0%	0%	0%
skeleton_model	-	-	-	-	-	-	-	-	-	-	-
spoon_spatula	0%	0%	0%	0%	0%	0%	0%	0%	0%	100%	0%
test_tube	-	-	-	-	-	-	-	-	-	-	-
f1 score	1.00			1.00	1.00	1.00	1.00	1.00		1.00

Data explorer (full training set)

Retrain this model to enable the feature explorer.

On-device performance

Engine:

Inferencing time

8803 ms.

Peak RAM usage

2.1M

Flash usage

78.3K

Did you know? You can customize your model through the Expert view (click on to switch),
or can even bring your own model (in PyTorch, Keras or scikit-learn).

Model	Author
MobileNetV2 SSD FPN-Lite (320x320 only) Officially supported A pre-trained object detection model designed to locate up to 10 objects within an image, outputting a bounding box for each object detected. The model is around 3.7MB in size. It supports an RGB input at 320x320px. For other resolutions, use FOMO or an NVIDIA TAO model.	Edge Impulse
FOMO (Faster Objects, More Objects) MobileNetV2 0.1 Officially supported An object detection model based on MobileNetV2 (alpha 0.1) designed to coarsely segment an image into a grid of background vs objects of interest. These models are designed to be <100KB in size and support a grayscale or RGB input at any resolution.	Edge Impulse
FOMO (Faster Objects, More Objects) MobileNetV2 0.35 Officially supported An object detection model based on MobileNetV2 (alpha 0.35) designed to coarsely segment an image into a grid of background vs objects of interest. These models are designed to be <100KB in size and support a grayscale or RGB input at any resolution.	Edge Impulse
YOLOv5(added by Solomon Githu) Enterprise Object Detection using YOLOv5	Edge Impulse Experts
YOLOx Enterprise YOLOx fork for TI TDA4VM	Edge Impulse Experts
YOLOX for TI TDA4VM Community TI's EDGEAI YOLOX. https://github.com/TexasInstruments/edgeai-yolox. Outputs ONNX v7 model format both with and without final detect layers using PyTorch 1.7.1. See the implementation https://github.com/edgeimpulse/example-custom-ml-block-ti-yolox/tree/onnx-v7	Texas Instruments

The backbone is the foundational element of a neural network model, responsible for extracting meaningful features from input data, enabling subsequent parts to perform anomaly scoring or classification.

Description	Author
EfficientNet V2B0 Uses around 1379K RAM based on your input size, and between 240-1675K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.35 Uses around 1217K RAM based on your input size, and between 69-134K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.50 Uses around 1221K RAM based on your input size, and between 78-168K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.75 Uses around 2421K RAM based on your input size, and between 109-266K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 1.0 Uses around 2431K RAM based on your input size, and between 126-372K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.1 Uses around NaNK RAM based on your input size, and 58K ROM, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse

The scoring function operates on the features extracted by the backbone, and returns anomaly scores for each segment of the image.

Description	Author	Recommended
MobileNetV2 SSD FPN-Lite (320x320 only) A pre-trained object detection model designed to locate up to 10 objects within an image, outputting a bounding box for each object detected. The model is around 3.7MB in size. It supports an RGB input at 320x320px. For other resolutions, use FOMO or an NVIDIA TAO model.	Edge Impulse
FOMO (Faster Objects, More Objects) MobileNetV2 0.1 An object detection model based on MobileNetV2 (alpha 0.1) designed to coarsely segment an image into a grid of background vs objects of interest. These models are designed to be <100KB in size and support a grayscale or RGB input at any resolution.	Edge Impulse
FOMO (Faster Objects, More Objects) MobileNetV2 0.35 An object detection model based on MobileNetV2 (alpha 0.35) designed to coarsely segment an image into a grid of background vs objects of interest. These models are designed to be <100KB in size and support a grayscale or RGB input at any resolution.	Edge Impulse
YOLOv5(added by Solomon Githu) Object Detection using YOLOv5	Edge Impulse
YOLOx YOLOx fork for TI TDA4VM	Edge Impulse
YOLOv5 for Renesas DRP-AI Transfer learning model using YOLOv5 v5 branch with yolov5s.pt weights. This block is only compatible with Renesas DRP-AI.	Edge Impulse
YOLOv5 Transfer learning model based on Ultralytics YOLOv5 using yolov5n.pt weights, supports RGB input at any resolution (square images only).	Edge Impulse
YOLOX for TI TDA4VM TI's EDGEAI YOLOX. https://github.com/TexasInstruments/edgeai-yolox. Outputs ONNX v7 model format both with and without final detect layers using PyTorch 1.7.1. See the implementation https://github.com/edgeimpulse/example-custom-ml-block-ti-yolox/tree/onnx-v7	Edge Impulse
NVIDIA TAO RetinaNet Object detection model with superior performance on smaller objects. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse
NVIDIA TAO YOLOV3 Object detection model that is fast and accurate. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse
NVIDIA TAO YOLOV4 Object detection model that is fast and accurate. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse
NVIDIA TAO SSD Object detection model for general purpose use. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse

These users will be notified over email when this job finishes.

	Name
	Kutluhan Aktar

Neural Network settings

Training settings

Augmentation settings

Advanced training settings

Neural network architecture

Model

Last training performance (validation set)

F1 score

Confusion matrix (validation set)

Data explorer (full training set)

Settings

On-device performance

Inferencing time

Peak RAM usage

Flash usage

Last training performance (validation set)

F1 score

Confusion matrix (validation set)

Data explorer (full training set)

Settings

On-device performance

Inferencing time

Peak RAM usage

Flash usage