01

Soccer arena

Soccer Arena is a third person 2v2 multiplayer sports game with advanced platforming mechanics. You can play offline against bots or online via server!

02

Socialdisdance

Dance with your friends during quarantine! You only need a webcam and a browser to play - don’t let Covid ruin your mental health by dancing the bad vibes away!

03

other works

I started programming when I was 12, and I’ve made 10+ 2d games in GameMaker. More recently, I’ve started learning Unity and Unreal! More of my games can be found here at github.com/mizhkeao

Motivation

While I was stuck at home during the Shanghai 2022 quarantine, I had the idea to give people a fun and easy way to exercise and keep in touch by participating against one another in dance offs.

technical challenges

I needed to extract human pose data from both a music video (.mp4 file), and a livestream video from a webcam. I had to validate whether this was technically feasible, or else the game couldn’t be made.

To make the game accessible to everyone, I wanted to make the game available to play in the browser. I had to learn about frontend and backend development (ReactJS, Firebase, etc).

pose extraction

After some research and head scratching, I built a proof of concept which could perform pose extraction using Google’s MLPose library. The video on the left draws the extracted pose from the video and prints out pose metadata to the browser console.

POSE Comparison

I experimented with many different comparison algorithms but found the ones that worked best first normalized pose coordinates and then computed the mean square error of the position and rotation of certain key points such as the hands and face. This result was obtained through several iterations of playtesting with friends and family.

CORE LOOP

The game loop of the game sees players competing 1v1 to earn points by replicating dance moves from a music video.

To finish up, I added pose hints, scoring, and multiplayer using WebRTC and Firebase as the backend.

Then, I deployed the game to github pages. A total of four songs are available to play!