GMDM: A generalized multi-dimensional distribution overlap metric for data and model quality evaluation


Park S. Ibrahim M.S. Wahab A. Khan S.
15 April 2023Elsevier Inc.

Digital Signal Processing: A Review Journal
2023#134

In this article, we design and analyze a generalized multi-dimensional distribution overlap metric (GMDM) as a generic tool for quantifying similarity or difference between two multivariate distributions for the evaluation of data and model quality. Our experiments on different real-world datasets substantiate that the proposed metric is an apposite intuitive alternative for quantification of the performance of training models and the consistency of multiple datasets. The proposed metric is suitable, for example, for image quality assessment, evaluation of unsupervised training models trained using unpaired data, image denoising models, feature embedding in protein sequence classification, and the estimation of class-specific consistency in datasets of variable dimensions such as the MNIST, ORL, and CIFAR. Furthermore, it is substantiated that the proposed metric can serve as a batch-wise consistency score to evaluate the reproducibility of the surface-enhanced Raman spectroscopy (SERS) based molecule identification model and is also applied to the domain adaptation problem in the anomaly detection task. Our results on diverse applications confirm the generalization of the proposed method and indicate a good agreement of the GMDM with conventional data quality and performance metrics.

Distribution overlap , Domain adaptation , Generalized contrast-to-noise ratio , Image denoising , Style transfer , Unsupervised learning

Text of the article Перейти на текст статьи

Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141, South Korea
College of Electrical Engineering, Zhejiang University, China
Department of Mathematics, School of Sciences and Humanities, Nazarbayev University, 53 Kabanbay Batyr Avenue, Nur-Sultan, 010000, Kazakhstan

Department of Bio and Brain Engineering
College of Electrical Engineering
Department of Mathematics

10 лет помогаем публиковать статьи Международный издатель

Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026