Technology 3 min read

OpenAI Unveils Massive Reinforcement Learning Simulator for AI Agents

Image via OpenAI

Image via OpenAI

Yesterday, OpenAI announced its release of a massive multiagent game environment for reinforcement learning agents. The company’s newest Neural MMO platform reportedly supports a “large, variable number of agents” within a “persistent and open-ended task.”

In a statement, OpenAI wrote:

“In recent years, multiagent settings have become an effective platform for deep reinforcement learning research. Despite this progress, there are still two main challenges for multiagent reinforcement learning. We need to create open-ended tasks with a high complexity ceiling: current environments are either complex but too narrow or open-ended but too simple.”

According to OpenAI, more benchmark environments are required to quantify the learning progress of AI agents in large population scales and persistence. Apparently, an MMO structure is the best solution as it simulates a vast ecosystem where a variable number of players can persistently compete within large environments.

A demo of OpenAI's Neural MMO reinforcement learning simulation for AI agents
A demo of OpenAI’s Neural MMO reinforcement learning simulation for AI agents | OpenAI

MMO Reinforcement Learning Simulation

OpenAI claims that its Neural MMO reinforcement learning simulator can address the critical challenges of training AI agents. These challenges include persistence, scale, efficiency, and expansion.

The MMO simulator allows players or agents to join available servers or environments containing an auto-generated tile-based game map of configurable size. There are traversable tiles like food-bearing forests and grass tiles along with non-traversable tiles like water and solid stone tiles.

Agents will spawn at random locations along the edges of the environment where they need to gather food and water while avoiding damage from other agents.

OpenAI reported that they trained their AI system to reward agents for staying alive during simulation. The researchers observed that the longer the AI agents communicate with each other, the better they execute tasks.

OpenAi further wrote:

“In the natural world, competition among animals can incentivize them to spread out to avoid conflict. We observe that map coverage increases as the number of concurrent agents increases. Agents learn to explore only because the presence of other agents provides a natural incentive for doing so.”

This is not the first time that OpenAI released an environment for AI agents. Last year, the company released a tool called CoinRun to measure an agent’s ability to transfer its experiences of unfamiliar scenarios.

The Neural MMO reinforcement learning simulation is now available for download on GitHub.

Read More: OpenAI’s Text Generator Could Fuel Future Fake News Fire

First AI Web Content Optimization Platform Just for Writers

Found this article interesting?

Let Chelle Fuertes know how much you appreciate this article by clicking the heart icon and by sharing this article on social media.

Profile Image

Chelle Fuertes

Chelle is the Product Management Lead at INK. She's an experienced SEO professional as well as UX researcher and designer. She enjoys traveling and spending time anywhere near the sea with her family and friends.

Comment (1)
Most Recent most recent
  1. Profile Image
    Hugh Demson March 05 at 12:05 pm GMT

    Maybe this will finally let me play a game without watching the AI blindly run into walls for half the campaign.

share Scroll to top

Link Copied Successfully

Sign in

Sign in to access your personalized homepage, follow authors and topics you love, and clap for stories that matter to you.

Sign in with Google Sign in with Facebook

By using our site you agree to our privacy policy.