A Novel Framework for Uncertainty-Driven Adaptive Exploration

What is it about?

This is the most general adaptive exploration framework, which includes, as special cases, all previous adaptive exploration works. Intuitively, it utilizes uncertainty to decide whether an agent should explore or exploit. Any instance of this framework can be instantiated with different (tailored to a specific domain) definitions of uncertainty.

Featured Image

Photo by julien Tromeur on Unsplash

Photo by julien Tromeur on Unsplash

Why is it important?

This work simplifies the use of adaptive exploration, an approach that has been shown to address the exploration vs. exploitation dilemma. All previous adaptive exploration works can be seen as special cases of this work. Our formulation allows for effective exploration only when required.

Perspectives