Skip to content

A two-player dynamic game where deep Q-learning agents collaborate to find optimal solutions to a stochastic version of the graph coloring problem, featuring α-Rank for joint policy ranking and evaluation.

License

Notifications You must be signed in to change notification settings

nataliakoliou/Collaborative-Graph-Coloring-Game

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Collaborative-Graph-Coloring-Game

This project applies the $\alpha$-Rank evolutionary methodology to evaluate and rank joint strategies in a stochastic version of the Graph Coloring Game. Unlike traditional game-theoretic concepts like Nash equilibrium, which often fail to capture the complexity of agent dynamics, evolutionary approaches focus on how strategies persist over time. By transforming dynamic games into empirical forms and evaluating strategies based on their stability across repeated interactions, this approach identifies joint strategies that remain resistant to change in the long term.

This repository contains the code for the paper Ranking Joint Policies in Dynamic Games using Evolutionary Dynamics, accepted at AAMAS 2025.

Prerequisites

This project uses Poetry for dependency management. To set up the environment:

  1. Install Poetry (if not already installed):

    pip install poetry
  2. Clone the repository and navigate into it:

     git clone https://github.com/nataliakoliou/Collaborative-Graph-Coloring-Game.git
     cd cgcg
  3. Install dependencies:

     poetry install

How to Run the Code

The repository provides three main entry points for running the code:

# Train policies as Deep Q-Networks
poetry run learner

# Generate the empirical payoff matrix through multiple game simulations
poetry run simulator

# Apply α-Rank to rank joint policies
poetry run evaluator

Acknowledgments

I would like to express my sincere gratitude to the creators of $\alpha$-Rank for their foundational work in the paper α-Rank: Multi-Agent Evaluation by Evolutionary Dynamics. Their novel evolutionary methodology provided the theoretical framework for my own research on ranking joint policies in dynamic games. I would also like to thank DeepMind for including $\alpha$-Rank in their OpenSpiel library. Their implementation was straightforward and easy to apply to my own custom game.

Author

Natalia Koliou: find me on LinkedIn.

About

A two-player dynamic game where deep Q-learning agents collaborate to find optimal solutions to a stochastic version of the graph coloring problem, featuring α-Rank for joint policy ranking and evaluation.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages