Classifying highly imbalanced datasets remains a significant challenge in machine learning because conventional Support Vector Machine (SVM) classifiers often generate decision boundaries biased towards majority-class samples, resulting in poor recognition of minority-class instances. This study proposes an Adaptive Imbalance-Aware Hybrid SVM (AIH-SVM) Framework for robust classification of noisy, overlapping, skewed, and highly imbalanced datasets. It employs a unified SVM architecture that adaptively identifies informative minority-class samples while integrating feature optimization, deep learning-assisted SVM hyperparameter optimization, and geometry-aware slack-guided learning.
This study consists of six sequential stages: data preprocessing, imbalance analysis, feature optimization, adaptive learning, Deep Learning-assisted SVM hyperparameter optimization and geometry-aware slack-guided classification. Initially, Imbalance characteristics are analysed to find informative samples, by reducing noise, redundancy and overlapping distributions. Then, optimal feature set is used to train an adaptive SVM classifier, while deep learning identifies optimal hyperparameters, allowing for the creation of a robust hyperplane. Finally, geometry-aware slack-guided learning selectively reinforces informative minority-class samples located near the decision boundary.
A proposed framework is evaluated on synthetic and benchmark imbalanced datasets and compared with conventional SVM classifiers using Precision, Recall, F1-score, G-Mean, Area Under the ROC Curve (AUC), and Matthews Correlation Coefficient (MCC) as performance metrics. On synthetic overlapping datasets the proposed framework improved classification accuracy from 94.5% to 95.1%, increased minority-class recall from 0.82 to 0.84, and improved the minority-class F1-score from 0.90 to 0.91. Similar improvements were also observed on highly imbalanced credit card fraud and breast cancer datasets with a fewer false negatives and improved classification stability. Thus, these findings demonstrate the effectiveness of the proposed framework for intelligent imbalance-aware classification and highlight its potential to outperform existing imbalance learning techniques.