Ilmu Komputer & AI editorial
Prediction of Diabetes Disease Using an Ensemble of Machine Learning Multi-Classifier Models
The core problem
Innovation
The proposed framework incorporates multiple pre-processing steps: duplicate sample removal, attribute conversion, missing value imputation, data normalization and standardization, feature selection, and k-fold cross-validation. Several machine learning models are implemented: k-Nearest Neighbors (k-NN), Support Vector Machine (SVM), Decision Tree (DT), Random Forest (RF), AdaBoost, and Gaussian Naive Bayes (GNB). To address dataset imbalance, a weighted ensemble approach based on the Area Under the Receiver Operating Characteristic Curve (AUC) is introduced. Hyperparameter tuning is performed using grid search and Bayesian optimization. The pipeline can be represented as:
The weighted ensemble combines predictions from base models using weights proportional to their AUC scores. The ensemble output can be expressed as:
where is the weight for model based on its AUC, and is the predicted probability for class .
Why it matters
Who should read this
Opening member contentโฆ