Generative Music in Video Games

This entry was created by a student in Stanford’s Rhetoric of Gaming class. For more about the class and the assignment, click here.

We are all familiar with the rapid development in gaming technology in both areas of interactivity and performance. Modern games on the Xbox 360 or PS3 have such realistic graphics thati it’s getting a bit scary, and the Nintendo Wii has introduced a new level of immersive interactivity with their acceleration-sensitive controllers. My intention is to look at how the implementation of music in video games is also changing and developing as technology allows more and more freedom.

Scoring for a game is a much different process than scoring for, say, a movie. In a move, the sequence of events is fixed, and thus each second of music is tailored to fit the visuals. Since a game’s motion is determined by the player, writing one fixed score would not meld seamlessly with the gameplay. Most games in the past two decades have done a decent job of working around this by having different pieces, or musical elements that trigger during different scenes: the intro will be some epic orchestration, while the boss fight will have heart-stopping drum breaks with adrenaline-fueled synth lines. While this doesn’t disrupt the flow of the game so much, it does draw attention to repetitive play, as each similar scene is accompanied by a very recognizable theme.

For my initial source, I looked at an interview by Create Digital Music (CDM), an online periodical, with professor, and game composer Troels Brun Folmann. Among other things, Folmann (referred to from here on as TBF, as in the interview) wrote the music for Tomb Raider Legend, which was highly praised for its innovation in game music. He is interested in advancing the concept of adaptive music in games. The idea, similar to the original strategy of having scene-triggered music sequences, is to break the music down even further so that every player action results in aural feedback. He briefly explains the historical obstacles facing developments in this field,

“I would not say that adaptive music is a new concept, but the problem is that it’s never really been working. One of the main limitations is the fact that current generation of consoles like the PS2 and Xbox have very little RAM allocated for audio. Typically, sound designers have a mighty 2MB to play around with. True adaptive music needs be generated in real-time, and even the next-generation consoles like Xbox 360 and PS3 will not have resources enough to do this on a larger scale.
However, there are ways to work around the limitations. This usually involves the creation of custom technologies. I invented a methodology known as “micro-scoring”. It’s basically the idea of chopping your score down to very small components and triggering them in a way that compliments the game experience.”

Micro-scoring is really an extension on the original gameplay-triggered paradigm, but taken further so that in a way, the player is also a composer. By creating musical themes and ostenatos that can synergize no matter how they are combined (by composing them in similar keys and rhythmic schemes), each player action can add another layer of musical complexity, even if only for a second.

In theory, such tangible feedback to player actions should deepen the immersion and emotional impact of a game on its player. It also allows for more intricate musical systems to be implanted. Though these are like black box machines in that most people don’t care how music is made so long as it sounds good, new technology combined with paradigm shifts has a way of producing ground-breaking new sounds that will eventually seep into the mainstream perception of “good music”. For the most part, the interview deals more with overcoming the difficulties of adaptive composition, but I would like to extend these ideas with other research to look at the notion of the player as a composer.

Kevin Dade, Stanford

This entry was posted in CCR exchange: Student Research, Stanford Rhetoric of Gaming class. Bookmark the permalink.

6 Responses to Generative Music in Video Games

  1. Shayon Saleh says:

    This is an awesome, but often overlooked, topic. Video game music has evolved just as much as graphics, controllers, or even gameplay. Your blog post seems to indicate you have already started to look into the game-composing process.

    I would suggest you look into the music of Final Fantasy and its composer, Nobuo Uematsu. Uematsu is probably the best-known video game composer in the world, and his music is astonishing. As an extension, you can also talk about his adaptation of his own music into a rock-form for his own band, the Black Mages.

    Another thought that enters my mind is the soundtrack behind Halo. Halo’s theme is really popular and has been covered by a multitude of groups. It has also been a key part of Video Games Live!, another thing to look into. VGL is a concert tour performing only video game music, and it shows that game music has become an industry itself.

    Looking forward to what you do with this topic.

  2. Kevin Cardey says:

    Have you heard or seen of the Nike shoe product that teamed up with Apple? Basically, you insert a sensor into the soul of your shoes, which is connected to your ipod, and syncs the rhythm of the music with your footsteps. I think that this type of technology might be introduced into video games. For instance, in a boxing game, the faster you throw punches the faster the music will beat, and so on.
    Maybe in your research paper, you could talk about the future of music in games and what it might be like in 5 or 10 years as technology becomes more advanced. Also, you could talk about how music in games has already evolved.
    Great topic, and I agree that it is very overlooked in the gaming world.

  3. Christine Alfano says:

    You’ve received some great comments so far — Shayon’s are wonderful for how they direct you to actual video game scores, while Kevin’s are great in that they think innovatively about a direction that music could take.

    My concern with your topic is your finding sources that productively advance your research. The interview that you cited seems to be phenomenal source, and if you develop some strong research questions, you might find that interviews with key figures serve you very well in this paper.

    Here are some links — popular not academic sources — that might be of interest as you continue to shape this project.

    1. Nintendo Jazz Odyssey
    2. Top Ten JRPG Composers
    3. Video Game Music archive

  4. Mike says:

    I recommend examining Left 4 Dead because it has a dynamic in game music system. Every player has individually different music depending on the circumstances.

  5. Rob says:

    Definitely an extremely interesting article and as other people have mentioned it’s often forgotten how big a part music has to play within games and if it was able to change with each action/each player doing different things it would definitely improve the interactiveness of games and help better immerse gamers!

  6. Pingback: Random gaming post… music in games « The Rhetoric of Gaming

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s