PPO-DDP-PusherV2 / README.md
winkin119's picture
upload via upload_folder 2025-08-07T18:45:06.794303+00:00
2eda34c verified
metadata
env_name: Pusher-v5
tags:
  - Pusher-v5
  - ppo
  - reinforcement-learning
  - custom-implementation
  - mujoco
  - pytorch
  - ddp
model-index:
  - name: PPO-DDP-PusherV2
    results:
      - task:
          type: reinforcement-learning
          name: reinforcement-learning
        dataset:
          name: Pusher-v5
          type: Pusher-v5
        metrics:
          - type: mean_reward
            value: '-34.84 +/- 4.74'
            name: mean_reward
            verified: false

PPO Agent playing Pusher-v5

This is a trained model of a PPO agent playing Pusher-v5.

Usage

create the conda env in https://github.com/GeneHit/drl_practice

conda create -n drl python=3.12
conda activate drl
python -m pip install -r requirements.txt

play with full model

# load the full model
model = load_from_hub(repo_id="winkin119/PPO-DDP-PusherV2", filename="full_model.pt")

# Create the environment. 
env = gym.make("Pusher-v5")
state, _ = env.reset()
action = model.action(state)
...

There is also a state dict version of the model, you can check the corresponding definition in the repo.