Last modified: Apr 03, 2025 By Alexander Williams

Install OpenAI Gym in Python Step by Step

OpenAI Gym is a toolkit for developing reinforcement learning algorithms. It provides environments to test and train AI models. This guide will help you install it easily.

Prerequisites

Before installing OpenAI Gym, ensure you have Python 3.6 or later. You also need pip, Python's package installer. Check your Python version with:

 
import sys
print(sys.version)


3.8.5 (default, Jan 27 2021, 15:41:15)

If you don't have Python, download it from the official website. For pip issues, see our guide on How To Solve ModuleNotFoundError.

Step 1: Install OpenAI Gym

Open your terminal or command prompt. Use pip to install OpenAI Gym:


pip install gym

This installs the base Gym package. Wait for the installation to complete. You should see a success message.

Step 2: Verify Installation

Check if Gym is installed correctly. Run Python in your terminal:


python

Then, import Gym:

 
import gym
print(gym.__version__)


0.21.0

If you see the version number, Gym is installed. If not, check for errors.

Step 3: Install Additional Dependencies

Some environments need extra packages. Install them with:


pip install gym[all]

This includes Box2D, Atari, and other dependencies. It may take a few minutes.

Step 4: Test an Environment

Let's test a simple environment. Create a Python script:

 
import gym
env = gym.make('CartPole-v1')
env.reset()
for _ in range(1000):
    env.render()
    env.step(env.action_space.sample())
env.close()

Run the script. You should see a cart-pole simulation. This confirms Gym is working.

Common Issues

If you face errors like ModuleNotFoundError, check our guide on solving module issues. Ensure all dependencies are installed.

Conclusion

You've successfully installed OpenAI Gym in Python. Now you can start building reinforcement learning models. Explore different environments and have fun experimenting!