Team Members: Logan Jorgensen, Sam McGrath, David Szczepanik, Eli Brady
Our team decided to pursue this project to attempt to make a Dungeons & Dragons style experience that does not require an experienced individual to act as the Dungeon Master.
dungeon_ai is a full-stack web application meant to increase accessibility to Dungeons & Dungeons style games by removing the need for an experienced Dungeon Master. The user can create a character and allocate their skill points to a pool of skills, and embark on an adventure to find treasure, encounter monsters, and explore.
Games consist of campaigns with three characters. The ‘virtual Dungeon Master” is generated by AI. Both the storyline, as well as images for environments and player characters are generated using various AI technologies. The player photos are generated based on a user’s description. Story generation allows for wide variety of scenarios that the characters will experience in their playthrough, ensuring that no two playthroughs are the same.
The story generation is handled by making requests to the external OpenAI API, whereas AI-based image generation is done on the FastAPI application aspect of the project using Stable Diffusion.
The project is split into three main directories:
- /frontend - Directory for the React frontend
- /backend - Directory for the SpringBoot backend
- /diffusion - Directory for the FastAPI StableDiffusion Application
Individual "Game" view rendered with React
The frontend of dungeon_ai consists of several different views. React Router was used to assign the different views to routes:
- "Games" view
- View all of the current games that are saved or have been created previously, with an option to create a new game
- "Game" view
- View information about a selected game based on its id, including past events, character information on the sidebar, and ability to roll the die to generate a new encounter
- "Create" view
- Create a new game, along with a set of new characters
- "Character" view
- View more details about the current status of a specific character in a game (stats, health, description, etc.)
All logic and data for the game is handled throught the backend via a SpringBoot application.
- Handles storage via Hibernate & MySQL to store game information, history of game events, player data, etc.
- Henerates new events for a game via some internal game logic combined with a prepared prompt which is sent to the OpenAI API
- Generates a prepared prompt to send to the StableDiffusion FastAPI application in order to generate images for players and events that occur during the game
- Feeds data to frontend via RESTful API requests
Image of a Warrior Character | Image of Paladin Character | Image of Another Paladin Character | Image of a Ghoul Character |
---|---|---|---|
![]() |
![]() |
![]() |
![]() |
To run the frontend application locally with Vite / npm:
1. "npm i"
2. "npm run dev"
To run the FastAPI StableDiffusion Model locally with an Nvidia GPU (CUDA):
"diffuzers api"