memory_offline

class xuance.common.memory_offline.OfflineBuffer_D4RL(observation_space: gymnasium.Space, action_space: gymnasium.Space, auxiliary_shape: dict | None, n_envs: int, buffer_size: int, batch_size: int)

Bases: Buffer

Replay buffer for OfflineBuffer DRL algorithms.

Parameters:

• observation_space – the observation space of the environment.

• action_space – the action space of the environment.

• auxiliary_shape – data shape of auxiliary information (if exists).

• n_envs – number of parallel environments.

• buffer_size – the total size of the replay buffer.

• batch_size – size of transition data for a batch of sample.

clear()

d4rl2buffer(dataset)

sample(batch_size=None)

store(obs, acts, rews, terminals, next_obs)