19 January, 2013

Expanded Response to Jay Little's "Nerd Numbers: Terminal Outcomes"


This post is an expansion of my comment on Jay Little's article "Nerd Numbers: Terminal Outcomes" on the Gaming Security Agency's website.  Jay is the designer of great games like the Warhammer Fantasy Roleplaying Game.  You should seriously keep up with his "Painted Thumb" blog.  In this article, Jay describes how the dice pools in the new Edge of the Empire RPG (which he also designed) produce results on multiple axes, in contrast to dice mechanics of most classic rpgs that typically just produce results along a single axis.  You should read the article for the details, but the point is that results from a system that uses multiple axes provides exponentially more 'terminal outcomes' than uniaxial dice systems, which has implications on design outlook.  In the comments, we've started to discuss the implications of the design choice.

I'm not sure that more terminal outcomes are uniformly better.  Edge's dice system does handily produce a large variety of distinct/terminal outcomes, and this is an important feature of the game.  I still think there are some issues, though.  In his response, he refers to an "oversight", in that he didn't state that he wasn't referring to a single dice pool composition, but a generalization of the pool effect.  Further, he's somewhat dismissive of the need to understand the probability associated with the terminal outcomes, stating:

"This merely speaks to the potential for various Terminal Outcomes, not the probabilities of any single result."

I'm worried about these statements, because they do relate to design outlook, but, in my interpretation, not necessarily in the way I think Jay believes they do.  To explain my position, I need to take a little detour through decision making in games.  So keep reading, and please be patient, I'll get to the good stuff soon.

When making design choices, you are creating the way players interact with your game system, and players interact with a game system by making choices, such as "play a healer or a tank", or "Shoot the storm trooper or apply a medpack to my wounded friend",  or "Throw a frag grenade or thermal detonator", etc.  Now, how do players decide between these options? The same way we make any decisions as humans: We identify a goal, evaluate our options, and choose the option most likely to achieve the goal with the fewest negative consequences.  Simple right?

It helps to break it down into some discrete parts.  On a very micro scale, a player follows the following path when deciding what actions to take:

Action Evaluation & Selection (AES) -> Dice Roll (DR) -> Outcome Resolution (OR)

In the AES step, a player reviews the all (or a reasonable subset) of his available actions, and decides on one action or set of actions that are available.  It is in this step that the player has the most control.

In the DR step, he throws the appropriate dice that correspond to his selected options, and includes any modifiers.   This is where the terminal outcome is produced/determined.  The player has no control in this phase, since there is no way to roll the dice to manipulate the outcome.

In the OR step, any further decisions that are called for (possibly none) are made by the appropriate parties, and then the outcome of the roll, the terminal outcome, is applied to the game.  This is where EotE players decide how to spend triumph and advantage, damage is applied to targets, etc.  

So, back to the original point, "how do we make decisions?"  Exactly as I stated above, we choose the option that's going to get us closest to our goal with the least negative consequences.  But how do we know which option that is?  We rely on our previous experience (observed outcomes of previous decisions, rolls, etc) and intuition (unobserved results that can be reasonably expected based on our understanding of the rules) to compare these.  Using this information, players evaluate the relative probabilities of the possible terminal outcomes for each of their options, and choose the option that best suits their goals.

How does this related to the AES -> DR-> OR path?  Because our knowledge about the relative probabilities of each of the terminal outcomes is determined by the DR step, and our knowledge about the impact of each of the terminal outcomes is determined by the OR step, and it should be clear that our experience and intuition derived from DR & OR steps is absolutely critical for use in the AES step.  

Now, when evaluating options that lead to only a few terminal outcomes (say, four, like in Jay's first example), it is easy to evaluate the value of each on the terminal outcome on the game.  However, if there are over two hundred terminal outcomes, this because vastly more difficult.  Further, you need more rules to interpret all of these additional outcomes.  The latter is less of a problem if you can apply general rules, but there's no getting around the first: As you increase terminal outcomes, a players ability to compare the value of options increases.

Also, when we are presented with an option that has four terminal outcomes, and the generating method is relatively simple (e.g. roll a d20, apply a modifier), our minds have little trouble comprehending the relative likelihoods of the various outcomes by either intuition or experience.  However, in an exponentially more complex system like EotE's dice pools, our brains are NOT able to easily intuit the likelihoods of different outcomes, which leaves us to depend on previous experience.  But this method ALSO collapses because there are so many possible outcomes, we would need to have rolled an individual dice pool thousands of times to have a feel for how JUST THAT DICE POOL behaves.  Finally, Jay comments:

"And finally. I’m not a mathematician. That much should be clear. An understanding of math, probabilities and percentages is certainly helpful, but ultimately instincts, gut feelings, and intuition play as large a part as any other factor."

I think there are 2 possible interpretations of this: Jay is talking about either how he makes decisions while playing a game, or how he makes decisions while designing a game.  If it's the former, okay, that's cool if the game system behaves in the way that it intuitive based on its presentation.  Unfortunately, the EotE dice mechanic fails on this account.  This has been documented previously in the long thread on the FFG forums: The upgrade mechanism, which is portrayed as one of 'king' of the dice pool modification mechanics, provides little benefit.  This has been shown to be true using not only theoretical calculations comparing the two mechanics AND large numbers of simulated results, but also empirically at my game table and others.

If Jay is referring to the latter situation, that he relies on gut feelings and intuition as much or more than math when he's designing games, then... 

I'm speechless.  

No, seriously, when I typed that, I just sat here with my jaw hanging open for a few seconds making vowel sounds.

I don't understand how you can tweak and balance and appropriately design an intricate system like a role-playing game, even with huge amounts of controlled play-testing, without a very solid understanding of underlying dice mechanic.  I have HUGE amounts of respect for Jay because he's produced some of the best games I've played, and maybe he can write these rules off the cuff with an intuitive understanding, but I think we see examples of unforeseen, uh, hiccups in the system.  It also seems to me an odd sentiment to end a comment on after a math-heavy and self described "nerdy" article about multidimensional outcome spaces.

I think outcomes on multiple axes are fucking fantastic!  I have no problem with this mechanical concept in games!  They add depth to the game and remove the admittedly boring action resolutions we've seen in previous games.  I love the dice mechanics of WFRPG, especially they way the rolled results could be spent on:

  • A few, clear options presented on the action card that varied between actions,
  • A few, clear options presented in the book that were relatively constant between actions, or
  • Narratively appropriate actions/effects

However, like any mechanic, it needs to be appropriately implemented in a game to live up to its full potential.  It's here where I worry a "go-with-your-gut" design method may have been a poor choice and created a situation where the mechanism may not be able to really shine.  The dice just don't seem to want to behave in the game, and frequently lead to some weird and game-slowing results.

Jay, if you're reading this, I hope this hasn't been too antagonistic.  I'm just being honest about how I see the dice mechanic.

Anyway, I think that's everything I needed to say to fully support my position.  This was way too long for the comment section on GSA, and actually gave me a chance to touch on a few upcoming subjects of future blogs, so it all worked out.  Hope to have the definition blog finished soon.

/endofline

EDIT: I mis-credited Jay as the designer of the second ed. of Descent: Journeys into the Darkness, which was designed by Clark, Konieckza, Sadler & Wilson.  It has been fixed above.

13 January, 2013

My History with Games


In my last post, I spoke of my passion for games.  I’d like to spend a short post to explain my background with games to provide a view on why I am so fond of them.  Obviously, everything we write, do, think, believe is colored by our experiences, so I see no reason not to be forthcoming about mine which have led to these posts.  There’s also little reason to say I play games for reasons other than fun.  Fun really should be the reason anyone, anywhere games.  However, not all players find the same games fun, and those that do find the same games fun may not find them fun for the same reasons.  So when I say “I think this game is fun”, I find it to be a very superficial statement that bears some support. 

Games as a Mathematic Exercise

The math in most games is pretty simple, and should be simple so that the games are accessible and quick to play.  However, the probability structures in many of these games are substantially more complex than many players realize, but full understanding of these systems aren’t really necessary to play the games.  I find digging into the what the dice are doing numerically, and how we interpret their results is a great way to practice basic probability, and some methods I’ve applied to my simulation research projects originally came from thinking about dice results from WEG Star Wars, Axis & Allies, or Dungeons & Dragons.  I love this kind of analysis, and really, it’s a major reason I’ve started this blog.


Games as a Social Gateway

Prior to high school, both electronic and tabletop games provided me a measure of common experience and common language that allowed me to relate to my peers.  Growing up, I was socially withdrawn, and often felt to fit poorly into my environment.  This made the common ground created by my interest in games all the more valuable.  In grade school, I spent plenty of nights playing HeroQuest with friends and talking about Dragon Warrior.  In high school, discussing various flavors of X-Com occupied a lot of high school.  I also had a few fitful starts at trying to run a WEG Star Wars game during high school.  The plot never really went anywhere, but it had me spending time time with my friends socially outside of school, which was a major step forward for me. 

Gaming as a social activity expanded after I started college, and during my early university semesters, there was little difference between my social circle and gaming circle.  When I started veterinary school I was lucky to find a local gaming group that I meshed with very well.  And again when I returned to graduate school, I found friends in gaming that formed the basis of my social circle.  

While some people in this world can move to a new area and find friends with little effort, I am not one of them.  On all of these occasions, these games provided me with a critical foundation which I could build a social network and find friends.  I don’t believe I could have done this without these games.

Games as Empowerment & Escapism

Escapism and empowerment are two reasons I play games, but I think it’s difficult to separate them since they feel like two sides of the same coin.  It well established that games can be empowering, they allow to take on a role we don’t usually occupy in ‘real life’, and, in this role, make decisions that have far-reaching consequences, albeit in an imaginary world.  By taking on a new role in this other world, we allow ourselves to escape our realities, for a brief time.  But beyond this first level of empowerment and escapism, I find a second level where these two are entwined.  Not only am I escaping the real world by engaging my mind in the rules of a fictional one, I’m personally immune from the consequences of the fictional decisions here in the real world.  Games can be incredibly liberating.  This has been a valuable outlet for me to have, and provided a place I could feel welcome, regardless of what was occurring in other parts of my life.

Games and my ADD

While a player’s objectives in a game are relatively constant, the environment in which the player pursues these goals is dynamic.  The available options to each player and the relative value of each option changes with each players move.  For example:
  • The values of Monopoly properties change as the game progresses
  • Moves in chess may become open or blocked following on opponents move 
  • Party member’s health pools in Final Fantasy games dwindle during combat
  • Buffs and procs occur during boss fights in WoW

This dynamic environment requires substantial attention to track, and the various sources of input are extremely stimulating.  This type of dynamic environment is extremely appealing to people with attention deficit disorder (ADD), like myself.  While we have substantial difficulty focusing on individual tasks, we tend to find great enjoyment when we can divide our attention between several sources of information simultaneously.  

I don’t think I recognized this appeal of games when I was younger, but certainly do now.  When I’m slaying a group of Draugr while avoiding traps in Skyrim or watching outbreaks and seeking cures in Pandemic, I enjoy a relaxed feeling.  It’s difficult to explain how stimulating activities can lead to relaxation, but in my case they do, and it’s a very comfortable way for me to enjoy myself.

Games as a Creative Outlet

Games, both electronic and tabletop, are interactive.  Truly, interactivity is one of the very few qualities all games must share to be considered games.  By their interactive nature, the player is able to influence the outcome.  By giving the player influence on the direction of events in a prefabricated setting, it becomes very easy for players to overlay their own narrative into the events, which may further guide later player choices.  This is essentially what role-playing is, application of a narrative to otherwise purely objective dice rolls in a relatively arbitrary system of rules.  While this method of creation storytelling very easy, it is also very shallow.  The magnitude of decisions and consequences is dictated by the narrator and the game system, and the results are decided by the interpretation of the dice by the narrator and players.  But nevertheless, I’ve found it to be an easy stepping off point for writing, a valuable creative outlet for me.

And such are the major highlights of why I find games so appealing.  Hopefully this history and set of opinions will provide some context for the arguments yet to come.  I'll be starting the actual discourse on the game shortly by examining what is necessary to make a game.

/endofline  

06 January, 2013

What Makes Games Great?


I love gaming.  It's great.  For so many reasons.  It's engaging.  It's stimulating.  It's social.  Playing a game is a chance to  escape reality and step into another life.  There are puzzles to solve, obstacles to overcome, decisions to make, foes to best and adventure to be had!

As you may have guessed, gaming (specifically tabletop gaming) is one my favorite pastimes.  I've played a lot of games during my [almost] 33 years on this planet and they continue to occupy a substantial amount of my free time.  There are a number of reasons I've developed such a passionate for gaming.  These reasons will be the topic of a future post, because I think they will help provide important context for these posts, but they are beyond the scope of this post.  When you spend a lot of time engaged in an activity, you naturally develop an appreciation for the activity and it's facets.  Eventually, I started to wonder WHY I enjoy games so much.  This wondering led to curiosity, which in turn led to examination.

I don't think there's any media that hasn't been improved by objective examination.  Movies, music, literature, theater; all of these media have dedicated fields of study that led to substantial improvements in our understanding of the media that has subsequently led to an increase in quality of the authored material.  I find it reasonable to view tabletop games as another form of entertainment or educational media, depending on the game's purpose or context.  Following the fusion of these two ideas (tabletop games as media & objective evaluation leads to improved content), I believe that our tabletop games can benefit from similar objective scrutiny.  It's for this reason I want to start putting my thoughts and observations on the matter to text.

I really can't be sure how novel this work is going to be.  While I have found several previous studies and essays on gaming, they have all concerned themselves primarily with the individuals and groups of individuals, instead of the games themselves.  Since this being treated as unknown territory, I expect the tone of the initial posts will be exploratory, and their primary purpose will be descriptive.  Overall, the purpose of these "What makes games great?" (WMGG) posts will be to first discuss the variety of current table top games and establish a functional vocabulary to succinctly describe their characteristics.  After we have an idea of the variety present in the games and we can easily communicate what we are looking at, we can start getting into more advanced ideas and concepts.

Because these posts will start as an exploratory exercise, I expect that some important points will be missed, mistakes will be made, and missteps taken, and for this reason I encourage my readers to provide constructive feedback on the material I post.   I am looking forward to seeing how the community receives these ideas.  Truly, what will be posted here is not intended to be a final product. There's still a lot for me to read, a lot to learn, a lot to find, a lot to integrate.  These concepts will undoubtedly will need to be refined and reworked, improving the quality of the idea with each iteration. 

I would like to be clear that these posts are NOT "What makes great games".  I feel this would be placing the cart before the horse.  The goal of this exercise is to create or define a framework in which we can work to describe and understand games (i.e. "what makes games great").  With this information, we will hopefully have better tools with which to design new games (i.e. "what makes great games").  I believe it is entirely possible to make a good game or a great game [or,  for that matter, a horrible game] with any concept or any rules.  The rules or concepts simply need to appropriately fit the context of the game.  As an analogy, the former exercise is similar to the examination of styles, techniques, materials, tools, et cetera used to create paintings to understand how they influence the final product, whereas the latter is an exercise in application of the styles, techniques, materials, tools, et cetera to create a painting.  Without the former, the latter is much more difficult.
Further, the purpose of these posts is not an absolutely exhaustive exercise in categorization, or a dissection of games into some atomic form.  These goals would be futile, since the useful information would be lost to us in such an exercise; The scale of our examination will be tailored to suit our goals, instead of forced to conform some arbitrary degree of consistency.

As a brief preview, some concepts I expect to address in this series are:
  • Cooperation vs competition
  • Symmetry
  • Stochasticity
  • Automation
  • Persistence
  • Degree of interaction

So, with all that, I'm undertaking this substantial project, but they say the longest journey starts with a single step.  It looks like I've just taken that step, now let's see where it goes.  I appreciate everyone and anyone who comes along for the ride.  I hope this is a productive exercise, and who knows, maybe we'll even make some progress.

/endofline

03 January, 2013

New year, new plan

I'm going to try to tack these posts from a different angle this year.  Instead of massive posts that are a bitch to read and worse to write, I'm going to try breaking them into smaller chunks.  Hopefully I can get more out if I'm not exhausting myself with extended posts.

In this spirit, I'll end this post here.  See its working already!  =D

/endofline