ray.rllib.utils.schedules.schedule.Schedule#

class ray.rllib.utils.schedules.schedule.Schedule(framework)[source]#

Bases: object

Schedule classes implement various time-dependent scheduling schemas.

  • Constant behavior.

  • Linear decay.

  • Piecewise decay.

  • Exponential decay.

Useful for backend-agnostic rate/weight changes for learning rates, exploration epsilons, beta parameters for prioritized replay, loss weights decay, etc..

Each schedule can be called directly with the t (absolute time step) value and returns the value dependent on the Schedule and the passed time.

Methods

value(t)

Generates the value given a timestep (based on schedule's logic).