The act of maximizing an agent's knowledge of its environment.

The exploration problem from the wiki is about maximizing a robot's knowledge of its environment. In cases where the environment is dynamic and/or has many obstacles, this can be a very hard problem to solve computationally.