Study on Acquisition Functions

Conference: ICMLCA 2021 - 2nd International Conference on Machine Learning and Computer Application
12/17/2021 - 12/19/2021 at Shenyang, China

Proceedings: ICMLCA 2021

Pages: 5Language: englishTyp: PDF

Personal VDE Members are entitled to a 10% discount on this title

Authors:
Sun, Yiming (Wellington School Ayr, Ayrshire, UK)
Wu, Zhengyang (Guanghua Cambridge International School, Shanghai, China)
Gu, Haoyu (Shanghai Experimental Foreign Language School, Shanghai, China)
Zhou, Yuguang (International Department, The Affiliated High School of SCNU, Guangzhou, China)

Abstract:
This paper is about statistical Machine Learning’s hyperparameter tuning, using Bayesian Optimization and its Acquisition Functions (AF). We coded on Python and carried out a simple SVM classification task. In conclusion, by comparison the most balanced in exploration and exploitation and well performed AF is the Expected Improvement (EI) AF. Then, an enhanced Acquisition function is proposed, the Modified EI, including noise. Future attempts are needed to be carried out on different task types to prove its superiority.