Person Detection - Create impulse

Harvard University / Person Detection Public

Clone this project

An impulse takes raw data, uses signal processing to extract features, and then uses a learning block to classify new data.

Description	Recommended
Images Processes discrete images for object detection or classification.
Time series data Operates on time series sensor data like vibration or audio data. Lets you slice up data into windows.

Did you know? You can bring your own DSP code.

Description	Author	Recommended
Image Preprocess and normalize image data, and optionally reduce the color depth.	Edge Impulse
Raw Data Use data without pre-processing. Useful if you want to use deep learning to learn features.	Edge Impulse
Image Preprocess and normalize image data, and optionally reduce the color depth.	Edge Impulse
Flatten Flatten an axis into a single value, useful for slow-moving averages like temperature data, in combination with other blocks.	Edge Impulse
Audio (MFCC) Extracts features from audio signals using Mel Frequency Cepstral Coefficients, great for human voice.	Edge Impulse
Audio (MFE) Extracts a spectrogram from audio signals using Mel-filterbank energy features, great for non-voice audio.	Edge Impulse
Spectral Analysis Great for analyzing repetitive motion, such as data from accelerometers. Extracts the frequency and power characteristics of a signal over time.	Edge Impulse
Spectrogram Extracts a spectrogram from audio or sensor data, great for non-voice audio or data with continuous frequencies.	Edge Impulse
Audio (Syntiant) Syntiant only. Compute log Mel-filterbank energy features from an audio signal.	Syntiant
IMU (Syntiant) Syntiant only. Great for analyzing repetitive motion, such as data from accelerometers. Extracts the frequency and power characteristics of a signal over time.	Syntiant
Raw Data Use data without pre-processing. Useful if you want to use deep learning to learn features.	Edge Impulse

Did you know? You can bring your own model in PyTorch, Keras or scikit-learn.

Description	Author	Recommended
Transfer Learning (Images) Fine tune a pre-trained image classification model on your data. Good performance even with relatively small image datasets.	Edge Impulse
Classification Learns patterns from data, and can apply these to new data. Great for categorizing movement or recognizing audio.	Edge Impulse
Regression Learns patterns from data, and can apply these to new data. Great for predicting numeric continuous values.	Edge Impulse
Classification - BrainChip Akida™ Learns patterns from data, and can apply these to new data. Great for categorizing movement or recognizing audio. Only works with BrainChip AKD1000 MINI PCIe board.	BrainChip
Transfer Learning (Images) - BrainChip Akida™ Fine tune a pre-trained image classification model on your data. Good performance even with relatively small image datasets. Only works with BrainChip AKD1000 MINI PCIe board.	BrainChip
Transfer Learning (Images) Fine tune a pre-trained image classification model on your data. Good performance even with relatively small image datasets.	Edge Impulse
Classification Learns patterns from data, and can apply these to new data. Great for categorizing movement or recognizing audio.	Edge Impulse
Object Detection (Images) Fine tune a pre-trained object detection model on your data. Good performance even with relatively small image datasets.	Edge Impulse
Regression Learns patterns from data, and can apply these to new data. Great for predicting numeric continuous values.	Edge Impulse
Transfer Learning (Keyword Spotting) Fine tune a pre-trained keyword spotting model on your data. Good performance even with relatively small keyword datasets.	Edge Impulse
Anomaly Detection (GMM) Find outliers in new data. A Gaussian mixture model (GMM) models the shape of data using a probability distribution. New data that is unlikely according to this model can be considered anomalous.	Edge Impulse
Anomaly Detection (K-means) Find outliers in new data. Good for recognizing unknown states, and to complement classifiers. Works best with low dimensionality features like the output of the spectral features block.	Edge Impulse
Classification - BrainChip Akida™ Learns patterns from data, and can apply these to new data. Great for categorizing movement or recognizing audio. Only works with BrainChip AKD1000 MINI PCIe board.	BrainChip
Transfer Learning (Images) - BrainChip Akida™ Fine tune a pre-trained image classification model on your data. Good performance even with relatively small image datasets. Only works with BrainChip AKD1000 MINI PCIe board.	BrainChip
Object Detection (Images) - BrainChip Akida™ Fine tune a pre-trained object detection model on your data. Good performance even with relatively small image datasets. Only works with BrainChip AKD1000 MINI PCIe board.	BrainChip

Image data

Input axes

image

Image width

Image height

Resize mode

Image

Name

Input axes (1)

image

Transfer Learning (Images)

Name

Input features

Image

Output features

2 (non_person, person)

Output features

2 (non_person, person)

Images

Time series data

Image

Raw Data

Image

Flatten

Audio (MFCC)

Audio (MFE)

Spectral Analysis

Spectrogram

Audio (Syntiant)

IMU (Syntiant)

Raw Data

Transfer Learning (Images)

Classification

Regression

Classification - BrainChip Akida™

Transfer Learning (Images) - BrainChip Akida™

Transfer Learning (Images)

Classification

Object Detection (Images)

Regression

Transfer Learning (Keyword Spotting)

Anomaly Detection (GMM)

Anomaly Detection (K-means)

Classification - BrainChip Akida™

Transfer Learning (Images) - BrainChip Akida™

Object Detection (Images) - BrainChip Akida™

Image data

Image

Transfer Learning (Images)

Output features

No data collected yet

Description

Personal

Enterprise

Public

Private

( of remaining)