Intelligent Media Center (IMC)

IMC Lab

Multimodal Humanoid Robotic Activity Recognition

Hierarchical IMU-RGB Feature Fusion with Genetic Optimization and Deep ConvLSTM

Ahmad Jalal Hanzla

Project Overview

A hierarchical fusion framework for robust humanoid activity recognition using IMU and RGB modalities, enhanced with genetic optimization for feature selection and Deep ConvLSTM for temporal modeling. Single-modality recognition collapses under occlusion and sensor drift — humanoids need redundant perception.

System Architecture

Inputs

IMU Sensors

Accel + Gyro

RGB Video

Processing Pipeline

Signal Preprocessing

Genetic Feature Selection

Hierarchical Fusion

Deep ConvLSTM

Outputs

Activity Label

Confidence

Related Publications (8)

Curated from publications by Professor Dr. Hafiz Ahmad Jalal

2026journal

Multimodal Neural Network Framework for Individual and Social Activity Recognition in UAV Surveillance

I Zahra, H Alsolai, B Alabdullah, F Alhayan, A Jalal, H Liu

IEEE Access, 2026

View on Scholar

2026journal

CrowdVoxel-Net: Voxelized Geometry and Transformer-Based Multimodal Fusion for Activity Recognition and Anomaly Detection in UAV-Based Crowded Scenes

S Harris, A Bayan, N Shaheryar, A Hadeel, A Fatimah, J Ahmad, L Hui

Egyptian Informatics Journal, 2026

View on Scholar

2026conference

Multimodal Sports Group Activity Recognition using Dynamic Graph Neural Networks

Z Ishrat, J Ahmad

ICIT26, 2026

View on Scholar

2026journal

Multimodal Healthcare System for Human Activity Recognition using Multiple Features and Advanced Ensemble Classifier

N Fakhra, W Yanfeng, A Hanan, J Ahmad, L Hui

Digital Health, 2026

View on Scholar

2026journal

Transformer-Driven Multimodal for Human-Object Detection and Recognition for Intelligent Robotic Surveillance

AA Ullah, Y Wu, S Najam, NA Almujally, J Ahmad, H Liu

Computers, Materials, & Continua 87 (1), 2026

View on Scholar

2026journal

Multimodal Human Interaction Recognition Framework Using Multi-Features and Deep Learning Approach.

TFN Bukht, H Alhaston, N Alshamrari, NA Almujally, A Jalal

International Arab Journal of Information Technology (IAJIT) 23 (1), 2026

View on Scholar

2025journal

Multimodal Scene Recognition using Semantic Segmentation and Deep Learning Integration

N Aysha, A Mohammed, FA Haifa, A Mohammed, AAH Dina, J Ahmad, ...

PeerJ CS, 2025

View on Scholar

2024conference

Intelligent Multimodal Human Behavior Recognition using Inertial and Video Sensors

A Iqra Aijaz, J Ahmad

FIT2024, 2024

View on Scholar

Back to IMC Lab Home