On the Refinement of Conflict History Search Through Multi-Armed Bandit - Aix-Marseille Université Access content directly
Conference Papers Year : 2020

On the Refinement of Conflict History Search Through Multi-Armed Bandit

Mohamed Sami Cherif
  • Function : Author
  • PersonId : 1290539
  • IdHAL : sami-cherif
Djamal Habet
  • Function : Author
  • PersonId : 1090275
Cyril Terrioux

Abstract

Reinforcement learning has shown its relevance in designing search heuristics for backtracking algorithms dedicated to solving decision problems under constraints. Recently, an efficient heuristic, called Conflict History Search (CHS), based on the history of search failures was introduced for the Constraint Satisfaction Problem (CSP). The Exponential Recency Weighted Average (ERWA) is used to estimate the hardness of constraints and CHS favors the variables that often appear in recent failures. The step parameter is important in CHS since it controls the estimation of the hardness of constraints and its refinement may lead to notable improvements. The current research aims to achieve this objective. Indeed, a Multi-Armed Bandits (MAB) framework can select an appropriate value of this parameter during the restarts performed by the search algorithm. Each arm represents a CHS with a given value for the step parameter and it is rewarded by its ability to improve the search. A training phase is introduced earlier in the search to help MAB choose a relevant arm. The experimental evaluation shows that this approach leads to significant improvements regarding CHS and other state-ofthe-art heuristics.
Fichier principal
Vignette du fichier
mab.pdf (1.02 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03132228 , version 1 (04-02-2021)

Identifiers

Cite

Mohamed Sami Cherif, Djamal Habet, Cyril Terrioux. On the Refinement of Conflict History Search Through Multi-Armed Bandit. IEEE 32nd International Conference on Tools with Artificial Intelligence (ICTAI), Nov 2020, Baltimore, United States. pp.264-271, ⟨10.1109/ICTAI50040.2020.00050⟩. ⟨hal-03132228⟩
163 View
75 Download

Altmetric

Share

Gmail Facebook X LinkedIn More