Surgery Inventory Synthetic - Object detection

Edge Impulse Experts / Surgery Inventory Synthetic Public

Target: Arduino Nicla Vision (Cortex-M7 480MHz) Clone this project

Neural Network settings

Training settings

Number of training cycles

Please provide a valid number of training cycles (numeric only)

Use learned optimizer

Learning rate

Please provide a valid number for the learning rate (between 0 and 1)

Training processor

Please provide a valid training processor option

Data augmentation

Advanced training settings

Validation set size

Please provide a valid number for the train/validate split (between 0 and 1)

Split train/validation set on metadata key

Batch size

Profile int8 model

Neural network architecture

Save

1
2
sys.path.append('./resources/libraries')
import os
 
 
הההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההההה
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX

Input layer (9,216 features)

FOMO (Faster Objects, More Objects) MobileNetV2 0.35

Output layer (4 classes)

Model

Model version:

Last training performance (validation set)

F1 score

84.4%

Confusion matrix (validation set)

	background	scalpel	scissors	sponge	tweezers
background	99.6%	0.1%	0.0%	0.1%	0.1%
scalpel	15.7%	84.3%	0%	0%	0%
scissors	14.0%	0%	86.0%	0%	0%
sponge	13.1%	0%	0%	86.9%	0%
tweezers	23.1%	0%	0%	0%	76.9%
f1 score	1.00	0.81	0.89	0.89	0.80

Data explorer (full training set)

Retrain this model to enable the feature explorer.

On-device performance

Engine:

Inferencing time

80 ms.

Peak RAM usage

239.4K

Flash usage

78.0K

	background	scalpel	scissors	sponge	tweezers
background	99.6%	0.1%	0.1%	0.1%	0.1%
scalpel	16.7%	83.3%	0%	0%	0%
scissors	10.6%	0%	89.4%	0%	0%
sponge	13.1%	0%	0%	86.9%	0%
tweezers	23.6%	0%	0%	0%	76.4%
f1 score	1.00	0.81	0.89	0.89	0.80

Did you know? You can customize your model through the Expert view (click on to switch),
or can even bring your own model (in PyTorch, Keras or scikit-learn).

Model	Author
MobileNetV2 SSD FPN-Lite (320x320 only) Officially supported A pre-trained object detection model designed to locate up to 10 objects within an image, outputting a bounding box for each object detected. The model is around 3.7MB in size. It supports an RGB input at 320x320px. For other resolutions, use FOMO or an NVIDIA TAO model.	Edge Impulse
FOMO (Faster Objects, More Objects) MobileNetV2 0.1 Officially supported An object detection model based on MobileNetV2 (alpha 0.1) designed to coarsely segment an image into a grid of background vs objects of interest. These models are designed to be <100KB in size and support a grayscale or RGB input at any resolution.	Edge Impulse
FOMO (Faster Objects, More Objects) MobileNetV2 0.35 Officially supported An object detection model based on MobileNetV2 (alpha 0.35) designed to coarsely segment an image into a grid of background vs objects of interest. These models are designed to be <100KB in size and support a grayscale or RGB input at any resolution.	Edge Impulse
YOLOv5(added by Solomon Githu) Enterprise Object Detection using YOLOv5	Edge Impulse Experts
YOLOx Enterprise YOLOx fork for TI TDA4VM	Edge Impulse Experts

The backbone is the foundational element of a neural network model, responsible for extracting meaningful features from input data, enabling subsequent parts to perform anomaly scoring or classification.

Description	Author
EfficientNet V2B0 Uses around 339K RAM based on your input size, and between 240-1675K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.35 Uses around 249K RAM based on your input size, and between 69-134K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.50 Uses around 256K RAM based on your input size, and between 78-168K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.75 Uses around 489K RAM based on your input size, and between 109-266K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 1.0 Uses around 499K RAM based on your input size, and between 126-372K ROM depending on the number of layers, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse
MobileNetV2 0.1 Uses around 238K RAM based on your input size, and 58K ROM, with default compiler settings. Supports both RGB and grayscale.	Edge Impulse

The scoring function operates on the features extracted by the backbone, and returns anomaly scores for each segment of the image.

Description	Author	Recommended
MobileNetV2 SSD FPN-Lite (320x320 only) A pre-trained object detection model designed to locate up to 10 objects within an image, outputting a bounding box for each object detected. The model is around 3.7MB in size. It supports an RGB input at 320x320px. For other resolutions, use FOMO or an NVIDIA TAO model.	Edge Impulse
FOMO (Faster Objects, More Objects) MobileNetV2 0.1 An object detection model based on MobileNetV2 (alpha 0.1) designed to coarsely segment an image into a grid of background vs objects of interest. These models are designed to be <100KB in size and support a grayscale or RGB input at any resolution.	Edge Impulse
FOMO (Faster Objects, More Objects) MobileNetV2 0.35 An object detection model based on MobileNetV2 (alpha 0.35) designed to coarsely segment an image into a grid of background vs objects of interest. These models are designed to be <100KB in size and support a grayscale or RGB input at any resolution.	Edge Impulse
YOLOv5(added by Solomon Githu) Object Detection using YOLOv5	Edge Impulse
YOLOx YOLOx fork for TI TDA4VM	Edge Impulse
YOLOv5 for Renesas DRP-AI Transfer learning model using YOLOv5 v5 branch with yolov5s.pt weights. This block is only compatible with Renesas DRP-AI.	Edge Impulse
YOLOv5 Transfer learning model based on Ultralytics YOLOv5 using yolov5n.pt weights, supports RGB input at any resolution (square images only).	Edge Impulse
NVIDIA TAO RetinaNet Object detection model with superior performance on smaller objects. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse
NVIDIA TAO YOLOV3 Object detection model that is fast and accurate. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse
NVIDIA TAO YOLOV4 Object detection model that is fast and accurate. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse
NVIDIA TAO SSD Object detection model for general purpose use. Configurable backbones optimized for targets from MCU to GPU. Supports rectangular input. Image width and height must be multiples of 32. Training requires GPU.	Edge Impulse

These users will be notified over email when this job finishes.

	Name
	Eivind

Neural Network settings

Training settings

Augmentation settings

Advanced training settings

Neural network architecture

Model

Last training performance (validation set)

F1 score

Confusion matrix (validation set)

Data explorer (full training set)

Settings

On-device performance

Inferencing time

Peak RAM usage

Flash usage

Last training performance (validation set)

F1 score

Confusion matrix (validation set)

Data explorer (full training set)

Settings

On-device performance

Inferencing time

Peak RAM usage

Flash usage