AdaBoost.SDM: Similarity and dissimilarity-based manifold regularized adaptive boosting algorithm
Mukhamediya A. Zollanvari A.
October 2025Elsevier B.V.
Pattern Recognition Letters
2025#19666 - 71 pp.
AdaBoost is a successful ensemble learning algorithm that generates a sequence of base learners, where each base learner is encouraged to focus more on those data points that are misclassified by the previous learner. That being said, AdaBoost, in its original form, lacks any mechanism to explicitly leverage the underlying geometric structure of data or manifold. Recent studies have shown that a training process that penalizes model outputs that do not align with the data manifold can lead to better generalization. In this paper, we aim to define a convex objective function for training AdaBoost that enforces a smooth variation of the model predictions over the data manifold. In this regard, we adopt a mixed-graph Laplacian that in contrast with the conventional Laplacian regularization can handle both label similarity and dissimilarity knowledge between data points. Compared with the original form of AdaBoost, the results demonstrate the effectiveness of the proposed similarity and dissimilarity-based manifold regularized AdaBoost (AdaBoost.SDM) in exploiting the data manifold and, at the same time, encoding the label similarity and dissimilarity to improve the classification performance. Our experimental results show that AdaBoost.SDM is highly competitive with state-of-the-art manifold regularized algorithms, including LapRLS and LapSVM.
Adaptive boosting , Ensemble learning , Manifold regularization
Text of the article Перейти на текст статьи
Department of Electrical and Computer Engineering, School of Engineering and Digital Sciences, Nazarbayev University, Astana, 010000, Kazakhstan
Department of Electrical and Computer Engineering
10 лет помогаем публиковать статьи Международный издатель
Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026