Skip to main content

Trinity College Dublin, The University of Dublin

Menu Search



Module Descriptor School of Computer Science and Statistics

Module CodeCS7032
Module NameAI for Interactive Entertainment
Module Short TitleAI-IET
ECTS5 ECTS
Semester TaughtMichaelmas (weeks 5 to 16)
Contact HoursLecture hours:22
Lab hours:11
Tutorial hours:

Total hours:33
Module PersonnelMr Andrei Marinescu
Learning Outcomes

Students who complete this module should:

  • Have a thorough understanding of the development of autonomous agents that are aware of their environment, can react to external stimuli, can behave according to sets of rules defined by a game designer, and learn automatically from interaction with the game environment
  • Be able to represent knowledge for the purposes of real-time simulations
  • Be able to define a machine learning problems and design algorithms that implement solutions for such problems
  • Be able to represent agent-environment interaction as Markov decision processes and design algorithms for learning optimal action policies for such processes.
  • Have practical experience in Implementing and evaluating agent-based systems that learn through interaction with the environment.
Learning Aims

This module will present students with the state of the art in representing autonomous agents, decision making and learning. The students will develop a thorough understanding of the development of computer controlled characters that are aware of their environment, can react to external stimuli, behave according to sets of rules defined by a game designer and learn by interacting with the environment. The core of the module is reinforcement learning, presented within the autonomous agents framework described above. Other advanced topics of interest to IET, such as natural language generation and supervised learning will also be presented.

Module Content
  • Agents, definition and formal architectures
  • Deductive agents & Utility functions
  • Agents, Reasoning & Uncertainty
  • Reactive Agents & Simulation
  • Advanced path finding and optimisation problems
  • Learning in Agent Architectures: Supervised and reinforcement learning
  • Evaluative Feedback
  • Markov decision processes
  • Strategies for solving the Bellman Optimality Equation
  • Temporal difference methods
  • Case studies in Reinforcement learning
  • Embodied Conversational Agents (ECA)
  • (Human language) dialogue management
Recommended Reading List

Reinforcement Learning: An Introduction, by Sutton and Barto. MIT Press 1998.
Neuro-Dynamic Programming, by Bertsekas and Tsitsikis, 1996.
Artificial Intelligence: A Modern Approach, by Russell and Norvig, 3rd ed. 2010.
An Introduction to MultiAgent Systems, by Wooldridge, 2009
Research papers TBA

Module PrerequisitesN/A
Assessment Details

% Exam:0
% Coursework: 100
Description of assessment & assessment regulations.
The course will be assessed solely on the basis of coursework: 30% will be allocated to weekly lab assignments and 70% to a larger-scale project to be handed in in January. If required to repeat a student will be assigned a coursework project which they will be required to pass.  The passing grade in all cases is 50%.

Module Website
Academic Year of DataN/a