Skip to main content
Intelligent Media Center (IMC)
HomeIMC 2 LabProject 18
IMC 2 Lab

Multimodal EEG-ECG Pipeline for Emotion Recognition

Integrating Brain and Cardiac Signals for Affective Computing

Dr Shahryar Najam Aleena Kamal Mahnoor Iftikhar

Project Overview

A multimodal EEG-ECG pipeline for emotion recognition, integrating brain and cardiac signal analysis for affective computing and mental health monitoring. The system synchronizes electroencephalogram and electrocardiogram signals through temporal alignment, extracts spectral and HRV features, and employs deep fusion networks to classify emotional states such as happiness, sadness, stress, and relaxation for human-computer interaction and mental wellness applications.

System Architecture

EEG
ECG
Temporal Alignment
Spectral + HRV
Deep Fusion
Emotional State
Wellness Index

Related Publications (8)

Curated from publications by Dr. Shaheryar Najam

2026journal

CrowdVoxel-Net: Voxelized Geometry and Transformer-Based Multimodal Fusion for Activity Recognition and Anomaly Detection in UAV-Based Crowded Scenes

S Harris, A Bayan, N Shaheryar, A Hadeel, A Fatimah, J Ahmad, L Hui

Egyptian Informatics Journal, 2026

View on Scholar
2026journal

Transformer-Driven Multimodal for Human-Object Detection and Recognition for Intelligent Robotic Surveillance

AA Ullah, Y Wu, S Najam, NA Almujally, J Ahmad, H Liu

Computers, Materials, & Continua 87 (1), 2026

View on Scholar
2025journal

Attention-driven emotion recognition in EEG: a transformer-based approach with cross-dataset fine-tuning

G Ghous, S Najam, M Alshehri, A Alshahrani, Y AlQahtani, A Jalal, H Liu

IEEE Access 13, 69369-69394, 2025

View on Scholar
2025conference

Human Emotion Recognition from EEG-brain Signals using Enhanced Machine Learning Method

G Ghulam, N Shaheryar, J Ahmad

ICACS+�G�G��25, 2025

View on Scholar
2026conference

Vision-Based Sign Language Recognition Using MediaPipe and Silhouette-Driven Feature Extraction

A Sheikh, S Najam, A Jalal

2026 International Conference on IT and Industrial Technologies (ICIT), 1-6, 2026

View on Scholar
2026journal

Deep Hand Segmentation and Multi-Modal Gesture Recognition for Human-Robot Interaction via 3D Volumetric Encoding

K Zarnab, N Shaheryar, A Hadeel, A Bayan, A Fatimah, J Ahmad, L Hui

Computers, Materials & Continua, 2026

View on Scholar
2026journal

UAV-MultiAct: A Lightweight Fusion-based Transformer for Robust Multi-Person Action Recognition in UAV Surveillance

S Harris, N Shaheryar, J Ahmad

KHI HTC 2026, 2026

View on Scholar
2026journal

Spectral-Topological Early Fusion for Hierarchical Multi-Person Activity Recognition in Sports Videos

A Shahzaib, N Shaheryar, J Ahmad

KHI HTC 2026, 2026

View on Scholar