Abstract: With the wide application of machine learning and data-driven decision-making in various fields, the Multi-armed Bandit problem has received much attention due to its importance in balance ...