Forgot password
Enter the email address you used when you joined and we'll send you instructions to reset your password.
If you used Apple or Google to create your account, this process will create a password for your existing account.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Reset password instructions sent. If you have an account with us, you will receive an email within a few minutes.
Something went wrong. Try again or contact support if the problem persists.
Microsoft, Ms. Pac-Man

Microsoft Creates AI to Achieve Max Score in Ms. Pac-Man

Can't beat this AI.
This article is over 7 years old and may contain outdated information

Researchers at Microsoft have created a system of artificial intelligence that learned how to reach the maximum possible score of 999,990 points in the Atari 2600 version of Ms. Pac-Man.

Recommended Videos

Developed by Maluuba, a startup acquired by Microsoft last January, the Hybrid Reward Architecture is a method that breaks down the game into simple tasks and divided among over 150 AI agents. These agents each had a specific task, such as collecting pellets or avoiding ghosts, while a top level agent was in charge of deciding where to move Ms. Pac-Man based on the agents’ suggestions. Check out how it works in the video below.

Maluuba says Ms. Pac-Man was chosen for this experiment because it was less predictable than regular Pac-Man, which made it perfect for teaching AI agents how to respond to random environments. Reinforcement learning was used to achieve the perfect game, where the agents learned over time how to achieve rewards and lessen negative responses for every action tried. The company believes this method could be used for natural language processing in AI research or help a company’s sales by predicting potential customers at specific times.

CHECK OUT MORE


Twinfinite is supported by our audience. When you purchase through links on our site, we may earn a small affiliate commission. Learn more about our Affiliate Policy
Author
Image of Tom Meyer
Tom Meyer
Follow on Twitter @tomeyerz for musings on video games and things that confound him.