Document Type
Article
Source Publication Title
Conference on AI Engineering Software Engineering for AI
DOI
https://dl.acm.org/doi/10.1145/3644815.3644941
Abstract
In machine learning, hyperparameter optimization (HPO) is essential for effective model training and significantly impacts model performance. Hyperparameters are predefined model settings which fine-tune the model’s behavior and are critical to modeling complex data patterns. Traditional HPO approaches such as Grid Search, Random Search, and Bayesian Optimization have been widely used in this field. However, as datasets grow and models increase in complexity, these approaches often require a significant amount of time and resources for HPO. This research introduces a novel approach using 𝑡-way testing—a combinatorial approach to software testing used for identifying faults with a test set that covers all 𝑡-way interactions—for HPO. 𝑇 -way testing substantially narrows the search space and effectively covers parameter interactions. Our experimental results show that our approach reduces the number of necessary model evaluations and significantly cuts computational expenses while still outperforming traditional HPO approaches for the models studied in our experiments.
Publication Date
6-11-2024
Language
English
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Recommended Citation
Khadka, Krishna; Lei, Yu; Chandrasekaran, Jaganmohan; Kacker, Raghu N.; and Kuhn, D. Richard, "A Combinatorial Approach to Hyperparameter Optimization" (2024). Association of Computing Machinery Open Access Agreement Publications-Archive. 98.
https://mavmatrix.uta.edu/utalibraries_acmoapubs/98