Improving viewing experiences of first-person shooter gameplays with automatically-generated motion effects

Abstract

In recent times, millions of people enjoy watching video gameplays at an eSports stadium or home. We seek a method that improves gameplay spectator or viewer experiences by presenting multisensory stimuli. Using a motion chair, we provide the motion efects automatically generated from the audiovisual stream to the viewers watching a frst-person shooter (FPS) gameplay. The motion efects express the game character's movement and gunfre action. We describe algorithms for the computation of such motion efects developed using computer vision techniques and deep learning. By a user study, we demonstrate that our method of providing motion efects signifcantly improves the viewing experiences of FPS game-play. The contributions of this paper are with the motion synthesis algorithms integrated for FPS games and the empirical evidence for the benefts of experiencing multisensory gameplays.