Marko Tot

Runners

2D - RPG - pathfinding - Mutliagent - Java

Runners is a top down, single player game, with the objective of collecting all the hearts on the map. You control the single agent, run away from multiple enemies, and obtain power-ups. The game has multiple levels with a custom level editor available for the game designer. This project was done from scratch in Java, implementing separate rendering and gameplayer engine loops.

In order to make the enemies cooperate in chasing the players, multi agent A* algorithm is implemented. Allowing the enemies to surround the player by looking at all the possible routes to the player and communicating between them to organize the most effective way. Similarly, an AI algorithm was implemented for the player that allows the AI to take control of the agent and try to escape the enemies. To enable the use of A* algorithms, the map was divided into a grid, with automatically generated detection for dead-ends and crossroads.

PACO

2D - Platformer - Puzzle - Android & IOS - Unity

Paco is a 2D arcade and puzzle platformer. You control Paco, by slinging around the screen, traversing through the level, climbing onto trees, buildings and slippery walls while avoiding obstacles. The game was a project done in Unity with around 50 different levels, and a star scoring system after each level. The game is made for Android and IOS.

This project encompases all of the elements of a video game, including animations, music and sound effects, level editor, progression system, and puzzle mechanics. It was a year-long project developed by my team in Panza studio.

Dwars

2D - Multiplayer - Cross Platform - Prototype - Unity

Dwars is a cooperative multiplayer game. You and your friend control Handsome and Smarty, two brave souls appointed as crystal defenders against incoming evil blobs. This is a cross platform, real-time multiplayer game made for PC and Android done in Unity with Gamesparks as the server.

The game contains lovely scenery, different levels, music and sound effects, animations, enemy AI, multiple characters, destructible objects and power-ups. It was done as a project developed as a cross-platform multiplayer prototype, created by 1 programmer + 1 designer team in a 14-day event.

Battle of the Arena Masters

2D - Twitch Integration - Team Based - Multiplayer - Netcode - Unity

Battle of the Area Masters was a master dissertation project. It is a team based, competitive, multiplayer arcade game. The game was built in Unity, with GameSparks as the server, and with the integration with the Twitch platform. During the game your viewers on Twitch can bolster your strength in the battle by giving you power ups, but be aware that your opponent has his viewers on his side as well.

Select your character, combine skills and abilities, and coordinate with your teammates and organize your viewers on Twitch, to defeat the opposing team in a 1v1, 2v2, or 4v4 arena brawler style game. The main goal of the project was to incorporate competitive and cooperative aspects, with custom made netcode and the support for an infinite number of players through twitch.

DinosHur

3D - Twitch Integration - Shooting - Racing - AI - Unity

DinosHur is a space based, 3D racing game with shooting elements. After defeating his adversaries in the roman empire Ben Hur decided to travel into space to search for a different challenge. Races with dinosaur chariots, crazy map obstacles, and opponents prepared to crash into you just because they like chaos, and impress the audience (twitch viewers) with your driving skills in order to earn their help in rushing through the track.

This game was developed in Unity, as a 7 day project during the game development coursework. Dinosaurs, space and guns, audience interaction, custom 3D models, and a crazy atmosphere all around.

The Pit

3D - Party game - Procedural Generation - Hide and Seek - Unity

The Pit is an online party game where you compete with everyone else to find, and hold the treasure! In this 3D arcade game you can customize your character, dig through the procedurally generated pit to get the shiny, and then try to run away with it while bombs keep exploding everywhere. This game was created for Ludum Dare 48. Unity was the choice for the game engine, and Normcore was selected for the netcoding. All of the assets, music, and sound effects were custom created.

Jump & Squat

Motion Tracking - Computer Vision - Python - VR

Jump and Squat is a 3-day project done during a Game Jam. It is based on combining a popular dinosaur jumping game (The one you can play in chrome when you don't have internet connection) with motion tracking. We implemented commands to play the game through motion detection. When you jump or squat, the motion is detected and the movements are linked to associated action is the game, jumping and squating to avoid the obstacles. The motion tracking was done with computer vision framework MediaPipe, and the game was made by incorporating the framework with the game environment in python.

Evo Nano

Horizon 2020 - Bio-Medical Research - Evolutionary Simulation - C++

Esport is a large and still growing industry with vast audiences. Multiplayer Online Battle Arenas (MOBAs), a sub-genre of esports, possess a very complex environment, which often leads to experts missing important coverage while broadcasting live competitions. One common game event that holds significant importance for broadcasting is referred to as a team fight engagement.

My role in this project consisted of creating a fully functional framework for large scale tumor growth simulation. I used PhysiCell , an agent based simulator, as the basis of the framework, and updated it to allow for easy addition of multiple cell variations. The procedurally generated vascular system was also implemented in order to replicate the conditions of the cell cycle and the effects proximity of the cells to the oxygen supply.

As the result my work on the project, I published a paper on the effects of evolutionary properties of autonomous agents in competitive environments.
Tot M, Kupusinac A, Balaz, I (2019) Influence of Embodiment on Emergence of Subjective Data Models in Evolutionary Agents. Proceedings of the SED 2019, May 24-25.

Predicting teamfights through player camera

Player Analytics - Dota 2 - Team Fight - Neural Networks - Python

Esport is a large and still growing industry with vast audiences. Multiplayer Online Battle Arenas (MOBAs), a sub-genre of esports, possess a very complex environment, which often leads to experts missing important coverage while broadcasting live competitions. One common game event that holds significant importance for broadcasting is referred to as a team fight engagement. Professional player's own knowledge and understanding of the game may provide a solution to this problem. This paper suggests a model that predicts and detects ongoing team fights in a live scenario. This approach outlines a novel technique of deriving representations of a complex game environment by relying on player knowledge. This is done by analysing the positions of the in-game characters and their associated cameras, utilising this data to train a neural network. The proposed model is able to both assist in the production of live esport coverage as well as provide a live, expert-derived, analysis of the game without the need of relying on outside sources.

You can read the full publication here:
Marko Tot, Michelangelo Conserva, Alan Pedrassoli Chitayat, et al. What Are You Looking At? Team Fight Prediction Through Player Camera, in Proceedings of the IEEE Conference on Games (CoG) (2021)

Hey ref! The AI is cheating!

Game AI - Esports - Dota 2 - Starcraft 2

This talk was presented in the IGGI 2021 Conference. The talk provides insight into the most popular gaming competitions between the AI agents and the best human players, focusing on the AlphaStar and OpenAI Five. These two agents have been showcased during major gaming events and have beaten many professional players. Following the competition, many concerns have been raised throughout the gaming community about the validity of the AI agents. During the talk multiple concerns about the AI are presented and discussed, as well as the restrictions imposed on the game in order to make the playing field as fair as possible.

Monte Carlo Graph Search

Game AI - GridWorld - Planning - Graphs

Monte Carlo Tree Search (MCTS) has proven to be a staple method in Game Artificial Intelligence for creating agents that can perform well in complex environments without requiring domain-specific knowledge. The main downside of this planning based algorithm is the high computational budget needed to recommend an action. The fundamental cause of this is a vast search space caused by a high branching factor, and the difficulty to create a good heuristic function to guide the search without leveraging domain-specific knowledge. Recent advances in the field proposed a new planning based method called Monte Carlo Graph Search (MCGS), which uses a graph instead of a tree to plan its next action, reducing the branching factor and consequently increasing the performance of the search.

In this research we proposed several modifications that optimize the performance by increasing the sample efficiency of MCGS. The use of frontier for node selection, improving the rollout phase by doing stored rollouts, and a generalized approach to guide the search by incorporating a domain-independent online novelty detection method. Together these enhancements enable MCGS to solve sparse reward environments while using a significantly lower computational budget than MCTS.

This is a continuous research that resulted in following publications:
Marko Tot, Michelangelo Conserva, Sam Devlin and Diego Perez-Liebana, Making Something Out of Nothing: Monte Carlo Graph Search in Sparse Reward Environments, in AAAI-22 Workshop on Reinforcement Learning in Games (2022).

Marko Tot, Michelangelo Conserva, Sam Devlin and Diego Perez-Liebana, Turning Zeroes into Non-Zeroes: Sample Efficient Exploration with Monte Carlo Graph Search, in Proceedings of the IEEE Conference on Games (CoG) (2022).