1 / 43

Adaptive Intelligent agent in real-time strategy games

Adaptive Intelligent agent in real-time strategy games. An Introduction. Project Members. Omar Enayet. Abdelrahman Al- Ogail. Ahmed Atta. Amr Saqr. Dr. Mostafa Aref. Dr. Ibrahim Fathy. Agenda. Problem Definition Theoretical Areas of Problem. Project Domain.

leal
Download Presentation

Adaptive Intelligent agent in real-time strategy games

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Adaptive Intelligent agent in real-time strategy games An Introduction

  2. Project Members Omar Enayet Abdelrahman Al-Ogail Ahmed Atta AmrSaqr Dr. MostafaAref Dr. Ibrahim Fathy

  3. Agenda • Problem Definition • Theoretical Areas of Problem. • Project Domain. • Specific Problem Definition. • Motivations. • Objectives. • Project Background • Survey & Approach. • Domain Platform. • AI Engine Architecture. • Expected Deliverables. • Development Tools. • Project Time Plan. • Web Resources & References.

  4. Theoretical Areas Learning Make the machine learn.

  5. Theoretical Areas Planning Plan then re-plan according to new givens.

  6. Theoretical Areas Knowledge Sharing Let everyone know instantly what you knew through experience.

  7. Theoretical Areas - Summary • Learning • Planning • Knowledge Sharing

  8. Project Domain RTS Games Real-Time Strategy Games.

  9. Problem Definition Predictability Computer Opponent actions easily predicted.

  10. Problem Definition Non-Adaptability Computer Opponent doesn’t adapt to changes in human actions.

  11. Problem Definition Static Scripts Computer AI relies on static scripting techniques.

  12. Problem Definition Experience Loss The Absence of sharing experience costs a lot.

  13. Problem Definition - Summary • Predictability • Non-Adaptability • Static Scripting • Experience Loss

  14. Motivations Interested In Machine Learning

  15. Motivations Interested In RTS Games

  16. Motivations Meets Our Career Ambitions as AI Programmers

  17. Why this Domain Rich Environment. Severe Time Constraints – Real-Time AI – Many Objects – Imperfect Information – Micro-Actions

  18. Why this Domain Active Research Theses and Papers are from 2003 to 2009.

  19. Why this Domain Wars Simulation Research in this field contributes to the modern warfare Research. Half of The USA’s Army will be robots in the coming years.

  20. Objectives Adaptive A.I. Making the Computer Opponent adapt to changes like human do.

  21. Objectives Mobile Experience Making Sharing Experience Possible Among Machines

  22. Survey • Adaptive Reinforcement Learning Agents in RTS Games Recent Papers • Case-based planning and execution for real-time strategy games. • Transfer Learning in Real-Time Strategy Games Using Hybrid CBR/RL We Collected more than 30 papers concerning this field, different in their way of approaching the problem and the techniques used to solve the problem. Examples of them are above ^

  23. Survey Asking Experts Alex Champandard Eric Kok Alex Champandard, Eric Kok and more.

  24. Survey Reference Book The Book “AI Game Engine Programming” talks about the drawbacks in learning and planning in RTS Games.

  25. Approaches - Techniques Reinforcement Learning A Sub-Science of Machine Learning.

  26. Approaches - Techniques Case-Based Planning Planning using Case-based reasoning.

  27. Approaches - Techniques BDI Agents Tech. Beliefs-Desires-Intentions Agents.

  28. Techniques - Summary • Reinforcement Learning • Case-Based Planning • BDI-Agent Tech.

  29. Approaches - Languages C++ The Main Language our Open Source Game is coded with.

  30. Approaches - Languages 2APL An Agent-Oriented Language.

  31. Approaches - Languages LUA A Scripting Language widely used in Video-Games.

  32. Platform – Not Chosen ORTS An Open-Source RTS Game

  33. Platform – Not Chosen Wargus An Open-Source RTS Game based in Stratagus Game Engine

  34. Platform – The Chosen One BosWars An Open-Source RTS Game based in Stratagus Game Engine

  35. Project Time Plan

  36. Game Engine AI Engine That’s our guy

  37. AI Engine Architecture

  38. Expected Deliverables Enhanced AI Engine An AI Engine which makes the computer behavior in the game as human as possible.

  39. Expected Deliverables Experimental Results Comparison of the results of the enhanced AI Engine with ordinary static AI.

  40. Development Tools • Visual Studio 2008 Professional Edition • 2APL Environment • C++ Libraries : Boost, Guichan ..etc.

  41. Web Resources • Project Blog : http://rtsairesearch.wordpress.com/ • SVN Repository : https://mzrtaiengine.googlecode.com/svn/trunk/

  42. References • Book : AI Game Engine Programming • Book : Artificial Intelligence for Games • The Most Important Papers/Theses : Thanks  • Eric Kok - Adaptive Reinforcement Learning Agents in RTS Games –– Master Thesis – University of Utrecht - 2008 • SantiOnta˜n´on, KinshukMishra, NehaSugandh, and Ashwin Ram. Case-based • planning and execution for real-time strategy games. In Proceedings of ICCBR - 2007 - 2007 • Manu Sharma, Michael Holmes, Juan Carlos Santamaria, AryaIrani, Charles Lee Isbell Jr., Ashwin Ram: Transfer Learning in Real-Time Strategy Games Using Hybrid CBR/RL. IJCAI 2007: 1041-1046

  43. Web References • http://gadgets.softpedia.com/news/US-Soldiers-Will-be-Half-Robots-Half-Human-by-2015-1334-01.html • http://www.france24.com/en/20090205-sciences-usa-robot-future-american-army-videogame-soldiers-machine

More Related