Fall_Detection_using_Transformer - Classifier

Edge Impulse Experts / Fall_Detection_using_Transformer Public

Clone this project

Target: Arduino Portenta H7 (Cortex-M7 480MHz)

Neural Network settings

Training settings

Number of training cycles

Please provide a valid number of training cycles (numeric only)

Use learned optimizer

Learning rate

Please provide a valid number for the learning rate (between 0 and 1)

Training processor

Please provide a valid training processor option

Advanced training settings

Validation set size

Please provide a valid number for the train/validate split (between 0 and 1)

Split train/validation set on metadata key

Batch size

Auto-weight classes

Profile int8 model

Neural network architecture

import tensorflow as tf from tensorflow.keras import Model from tensorflow.keras.layers import Dense, Input, MultiHeadAttention, Reshape, Dropout, GlobalAveragePooling1D, Conv1D, LayerNormalization, Normalization from tensorflow.keras.optimizers import Adam EPOCHS = 10 LEARNING_RATE = 0.0005 BATCH_SIZE = 32 # model architecture def transformer_encoder(inputs, head_size, num_heads, ff_dim, dropout=0): # Normalization and Attention x = LayerNormalization(epsilon=1e-6)(inputs) x = MultiHeadAttention( key_dim=head_size, num_heads=num_heads, dropout=dropout )(x, x) x = Dropout(dropout)(x) res = x + inputs # Feed Forward Part x = LayerNormalization(epsilon=1e-6)(res) x = Conv1D(filters=ff_dim, kernel_size=1, activation="relu")(x) x = Dropout(dropout)(x) x = Conv1D(filters=inputs.shape[-1], kernel_size=1)(x) return x + res def build_model( input_shape, head_size, num_heads, ff_dim, num_transformer_blocks, mlp_units, dropout=0, mlp_dropout=0, ): inputs = Input(shape=input_shape) x = Reshape([int(input_length/3), 3])(inputs) # pre-calculated mean and variance x = Normalization(axis=-1, mean=[-0.047443, -6.846333, -1.057524], variance=[16.179484, 33.019396, 22.892909])(x) for _ in range(num_transformer_blocks): x = transformer_encoder(x, head_size, num_heads, ff_dim, dropout) x = GlobalAveragePooling1D(data_format="channels_first")(x) for dim in mlp_units: x = Dense(dim, activation="relu")(x) x = Dropout(mlp_dropout)(x) outputs = Dense(classes, activation="softmax")(x) return Model(inputs, outputs) input_shape = (input_length, ) model = build_model( input_shape, head_size=64, num_heads=2, ff_dim=4, num_transformer_blocks=1, mlp_units=[32], mlp_dropout=0.40, dropout=0.25, ) # this controls the learning rate opt = Adam(learning_rate=LEARNING_RATE, beta_1=0.9, beta_2=0.999) callbacks.append(BatchLoggerCallback(BATCH_SIZE, train_sample_count, epochs=EPOCHS)) # train the neural network model.compile(loss='categorical_crossentropy', optimizer=opt, metrics=['accuracy']) model.summary() train_dataset = train_dataset.batch(BATCH_SIZE, drop_remainder=False) validation_dataset = validation_dataset.batch(BATCH_SIZE, drop_remainder=False) model.fit(train_dataset, epochs=EPOCHS, validation_data=validation_dataset, verbose=2, callbacks=callbacks) disable_per_channel_quantization = False

Input layer (600 features)

Dense layer (20 neurons)

Dense layer (10 neurons)

Output layer (2 classes)

Model

Model version:

Did you know? You have access to the full set of Keras layers through the Expert view (click on to switch),
or can even bring your own model (in PyTorch, Keras or scikit-learn).

Layer type
Dense Fully connected layer, the simplest form of a neural network layer. Use this for processed data, such as the output of a spectral analysis DSP block.
1D Convolution / pooling Learn features that take spatial information into account along a single dimension. Use this for raw data, or for DSP blocks that output spatial data, such as the MFCC block.
2D Convolution / pooling Learn features that take spatial information into account along two dimensions. Use this for raw data, or for DSP blocks that output spatial data, such as the MFCC block.
Reshape Turn one-dimensional data from a DSP block into multi-dimensional data. Use this as an input to a convolutional layer. Use this for deep learning on raw data, or to process MFCC output.
Flatten Flatten multi-dimensional data into a single dimension. You need to flatten data from a convolutional layer before returning.
Dropout Reduce the risk of a model overfitting your dataset by randomly cutting a fraction of network connections during training. Can be helpful if your model's training performance is better than its validation performance.

Complete architectures

Model	Author
LGBM Random Forest Classifier Enterprise The LightGBM Random Forest Classifier is an efficient, gradient-boosting framework that builds multiple decision trees in parallel for robust and scalable classification tasks.	Edge Impulse Inc.
XGBoost Random Forest Classifier Enterprise The XGBoost Random Forest Classifier leverages the strengths of both gradient boosting and random forest methodologies to provide a powerful, efficient, and scalable solution for classification tasks.	Edge Impulse Inc.
SVM Classifier Enterprise The scikit-learn SVM classifier is a powerful algorithm that constructs a hyperplane or set of hyperplanes in a high-dimensional space for classification, effectively handling both linear and non-linear data.	Edge Impulse Inc.
Random Forest Classifier Enterprise The scikit-learn Random Forest Classifier is a versatile machine learning algorithm that builds multiple decision trees and merges their predictions for robust and accurate classification.	Edge Impulse Inc.
Logistic Regression Enterprise The scikit-learn Logistic Regressor is a linear model for classification that estimates probabilities using a logistic function, effectively handling binary and multiclass classification tasks.	Edge Impulse Inc.
Ridge Classifier Enterprise The scikit-learn Ridge classifier employs L2 regularization to optimize a linear classification model, mitigating overfitting by penalizing large coefficients, thereby enhancing model generalizability across diverse datasets.	Edge Impulse Inc.
RidgeCV Classifier Enterprise The scikit-learn RidgeCV classifier is a linear regression model with built-in cross-validation that applies ridge regularization to prevent overfitting and improve prediction accuracy.	Edge Impulse Inc.

These users will be notified over email when this job finishes.

	Name
	Naveen

Neural Network settings

Training settings

Augmentation settings

Advanced training settings

Neural network architecture

Model

Dense

1D Convolution / pooling

2D Convolution / pooling

Reshape

Flatten

Dropout

LGBM Random Forest Classifier
Enterprise

XGBoost Random Forest Classifier
Enterprise

SVM Classifier
Enterprise

Random Forest Classifier
Enterprise

Logistic Regression
Enterprise

Ridge Classifier
Enterprise

RidgeCV Classifier
Enterprise

Description

Last training performance (validation set)

Accuracy

Loss

Confusion matrix (validation set)

Feature explorer (full training set)

Personal

Enterprise

Public

Private

( of remaining)

Select a version

Neural Network settings

Training settings

Augmentation settings

Advanced training settings

Neural network architecture

Model

Description

Last training performance (validation set)

Accuracy

Loss

Confusion matrix (validation set)

Feature explorer (full training set)

Settings