刘昊辰
(2025-01-24 14:04):
#paper Proof Number Based Monte-Carlo Tree Search. 这篇论文提出了 PN-MCTS 算法,将蒙特卡洛树搜索(MCTS)和证明数搜索(PNS)相结合,通过在多个游戏领域实验,验证了该算法在部分游戏上相比传统 MCTS 的优势,为游戏搜索算法改进提供了新方向。下载地址:https://arxiv.org/pdf/2303.09449
arXiv,
2023-03-16T16:27:07Z.
DOI: 10.48550/arXiv.2303.09449
Proof Number Based Monte-Carlo Tree Search
翻译
Abstract:
This paper proposes a new game-search algorithm, PN-MCTS, which combinesMonte-Carlo Tree Search (MCTS) and Proof-Number Search (PNS). These twoalgorithms have been successfully applied for decision making in a range ofdomains. We define three areas where the additional knowledge provided by theproof and disproof numbers gathered in MCTS trees might be used: final moveselection, solving subtrees, and the UCB1 selection mechanism. We test allpossible combinations on different time settings, playing against vanilla UCTon several games: Lines of Action ($7$$\times$$7$ and $8$$\times$$8$ boardsizes), MiniShogi, Knightthrough, and Awari. Furthermore, we extend this newalgorithm to properly address games with draws, like Awari, by adding anadditional layer of PNS on top of the MCTS tree. The experiments show thatPN-MCTS is able to outperform MCTS in all tested game domains, achieving winrates up to 96.2% for Lines of Action.
翻译
Related Links: