AI techniques in Games

Unity ML-Agents
o Blaga, B.-C.-Z., Gorgan, D. Performance Analysis in Implementation of
a Dodgeball Agent for Video Games. International Journal of User-
System Interaction 12(4), 225-240, 2019,
http://rochi.utcluj.ro/ijusi/articles/IJUSI-12-4-Blaga.pdf

o Unity Machine Learning Agents, https://unity3d.com/how-to/unity-

machine-learning-agents

o How to use Machine Learning AI in Unity! (ML-Agents),

https://www.youtube.com/watch?v=zPFU30tbyKs

Interactive Systems - UTCN 2

Unity Machine Learning Agents SDK
o Open-source Unity plugin
o Games are environments for training intelligent agents
o Agents can be trained by: reinforcement learning, imitation
learning, neuroevolution, or other machine learning methods
o Simple-to-use Python API

Interactive Systems - UTCN 3

ML-Agents Concepts

Interactive Systems - UTCN 4

Reinforcement Learning cycle
o Agent
o Policy - what it uses to decide next actions
o State of the agent
o Value – cumulative rewards till the current state
o Reward - convergence toward the target
o Actions
o Environment

Interactive Systems - UTCN 5

Environment

Interactive Systems - UTCN 6

References
o TensorBoard, https://github.com/Unity-Technologies/ml-
agents/blob/main/docs/Using-Tensorboard.md
o Monitoring with TensorBoard,
https://subscription.packtpub.com/book/game_development/9
781788994071/6/ch06lvl1sec48/monitoring-training-with-
tensorboard
o TensorBoard,
https://www.youtube.com/watch?v=NP5q72XYdTs
o ML-Agents 1.0+ | Create your own A.I. | Full Walkthrough |
Unity3D – YouTube,
https://www.youtube.com/watch?v=2Js4KiDwiyU
o Hyperparameters,
https://www.youtube.com/watch?v=ZKzXAVp8bC8

Interactive Systems - UTCN 7