Advancing multi-class classification: innovations, challenges, and ethical perspectives in machine learning

Yousef Qawqzeh, Abdullah Alourani, Fayez Alharbi, Mahdi Jemmali, Ghaith M. Jaradat

This review examines recent advances and persistent challenges in multi-class classification within machine learning (ML) and deep learning (DL), a core task underpinning many real-world applications in healthcare, finance, social media, and other high-impact domains. The review provides a structured analytical synthesis of major methodological directions, including problem transformation methods, algorithm-level approaches, ensemble and hybrid strategies, class-imbalance handling, evaluation metrics, and deployment-related considerations such as interpretability, uncertainty, and ethics. Recent progress in deep learning architectures, ensemble learning, and active learning has substantially improved predictive accuracy, robustness, and data efficiency across diverse application settings. At the same time, important challenges remain, including imbalanced datasets, noisy labels, scalability constraints, computational cost, and the need for trustworthy and transparent decision-making. The review also examines the trade-offs among predictive performance, interpretability, fairness, and deployment feasibility, highlighting the importance of selecting methods and evaluation metrics that are appropriate to application context. Rather than proposing a new algorithm, this work offers an integrative framework that connects technical advances with practical and ethical considerations in multi-class classification. Finally, it identifies key future directions, including semi-supervised and transfer learning, few-shot and federated multi-class systems, robustness under label noise, energy-efficient model design, and scalable interpretability frameworks for high-stakes deployment.