QuizUp- Motivation, Learning, and Dashboard Design, and 6 ways it can work in education

QuizUp is one of these flash in the pan games that takes the mobile world in a storm. In less than two months it amassed over 5 million users. If you haven't tried it you should, but not just because it is addictive, but also because it points to some aspects that QuizUp does well, and that we can do better in education. In short I believe that some of the things QuizUp does right we can use in education.


The key is motivation, and QuizUp uses every game mechanic and social aspect to drive you to use the system out of your own volition. First QuizUp allows the user to select the areas they want to be a part of. While we can't always let students choose what they want (vs. need) we know there is great motivation in choice. Second comes the sense of developing an area of expertise. I am for example the "Best in Ancient Rome in Nebraska" a dubious title but it works! We can imagine a best in multiplication in Mrs. Hendriks class or best in Ancient Greece in Washington Elementary.

QuizUp adds to it achievements (win 500 games, get a perfect score). We could structure those in more meaningful categories, imagine an achievement for knowing all the characters in Othello or all the multiples of 9, or the features of the table of elements. Points also work to motivate users, you get points even if you lose (although less) making sure that your effort is always rewarded. In short QuizUp activates all the short reward cycles that make us persist at game based tasks.


Feedback in QuizUp is exceptional. Beside the obvious leader boards, levels and points there are a slew of ways to get feedback. After each game you can study the questions and your responses, you can also see a graph comparing your score and you opponent's. The dash board is the most brilliant piece of design in the game. As you can see on the right one of the main dashboards shows you the areas you have been participating in and the level in each. It allows in one glance to see where the user had put the most effort and how well the user have been doing overall.

QuizUp has some challenges as a learning idea as well. The format of multiple choice works well for this kind of work but it does limit the sophistication of questions as they relate to different levels of learning (think Bloom's taxonomy). In my own participation I figured out I actually think through my responses through the first 15-20 levels. After that my responses are increasingly automatic as I have seen most of the available questions and must activate my mnemonic devices and memorization based on repetition.

So how does it fit into 21st century learning? Well:
1. It is a great way to develop basic knowledge
2. It is a great way to develop fluency (word recognition, basic math facts, historical facts). This will allow the teacher to focus on more meaningful material in class
3. Taking away the time element can help in some cases.
4. Have enough questions in any bank to remove straight forward memorization except when it i the goal (say multiplication facts).
5. The complexity of the question is up to the author, even in a multiple choice format you can get sophisticated thinking
6. If students can actually create questions it becomes a much more sophisticated task (the feature is available)

Games and learning- evidence

I am attaching empirical results about the impact of games on learning. This is where empirical evidence trumps "common sense" it is not motivation. Instead it is combining traditional and game based instruction, group work and multiple sessions. A good preview to Jim Gee's visit to UNL on Aug 20th and his talk on Gaming in Education.

A meta-analysis of the cognitive and motivational effects of serious games.

By Wouters, Pieter; van Nimwegen, Christof; van Oostendorp, Herre; van der Spek, Erik D.

Journal of Educational Psychology, Vol 105(2), May 2013, 249-265.

Abstract

It is assumed that serious games influences learning in 2 ways, by changing cognitive processes and by affecting motivation. However, until now research has shown little evidence for these assumptions. We used meta-analytic techniques to investigate whether serious games are more effective in terms of learning and more motivating than conventional instruction methods (learning: k = 77, N 5,547; motivation: k = 31, N 2,216). Consistent with our hypotheses, serious games were found to be more effective in terms of learning (d= 0.29, p < .01) and retention (d = 0.36, p < .01), but they were not more motivating (d = 0.26, p > .05) than conventional instruction methods. Additional moderator analyses on the learning effects revealed that learners in serious games learned more, relative to those taught with conventional instruction methods, when the game was supplemented with other instruction methods, when multiple training sessions were involved, and when players worked in groups. (PsycINFO Database Record (c) 2013 APA, all rights reserved)

Gaming and being Social

A lot has been made about the role of gaming in creating lonely and isolated teens and possibly even adults. I think that it is a complex problem and that gaming can have multiple impacts on any individual- I would actually like to suggest that we stop treating the problem as a pro-con problem and instead admit that any impacts of gaming are complex (cognitive, social, emotional) and depend on both the gamer and the game.

I am a casual gamer, I usually like games that can be played with short bursts with minimal set-up times that can be learned quickly. I simply do not have the time or attention span for more. A few months ago I decided to try a social game on Facebook. I have played social word games before but not games that involved long term engagement. As I like strategy games I tried a strategy game that required me to manage resources and raise an army that can battle computer simulated foes as well as other players. When I started playing I immediately turned off the chat feature. I was not interested in the interaction just in the gaming experience. As the game is geared toward short bursts of activity I slowly built my forces over a few weeks until I decided that I was ready to challenge other players. I attacked a few small outposts. The next time I logged in I found that my forces have been attacked by multiple players and repeatedly laid to waste. This seemed to be more than just an attack. I turned the chat on and asked. The response came immediately: "This is not how we behave in this sector". At this point it dawned on me that by not understanding the social aspect of the game I was missing a window into how gamers are creating social norms and mores within games.

I do not know how this links with life outside gaming if at all. What is certain is that it does not necessarily true that gamers would be less capable socially- the need to communicate with peers whom you cannot see and develop norms and values may have great value in a digitally connected global society. There may be a great potential in developing such games to teach ideas in history and civics.
There might be some strength in helping students see the connection between their online social experiences including gaming and their behavior in the real world.

Happy New Year!

On Being Puzzled

A few weeks ago I found "The Room" from Fireproof Games for my iPad. It is a beautifully executed puzzle game but that is not the main point. I enjoyed playing and marveling at the quality and challenge of the game play. What I didn't expect was the excitement and joy that my two younger sons had helping me advance. Oren (8) and Itai (6) were full members of the team and we all had great ideas moving us forward at different points. Their joy in discovering another clue or opening another section was hard to contain- and they literally broke into a dance when we figured out a particularly hard puzzle.

The series of small joys at each step solved reminded me very much of Johnson's "Everything Bad is Good for You". The way video games can reward our brains in small bursts is almost unparalleled. To me this is what a learning game should be like. I try to avoid the term educational as it invokes unpleasant memories of unimaginative drill games. Well it is a learning game...
It teaches to think creatively, look closely, experiment and persist. These are skills that transfer well to any open ended problem that artists and scientists attend to. My play with my boys added another dimension, namely learning to work as a team: we take turns, practice patience, share victories and most importantly never play without the others.

We have since moved to new puzzle games not all of them as visually pleasing but the effects are still the same. They now insist on daily common gameplay and I happily concur. We are creating habits of mind and family bonding. I can only wish that we will find ways to combine this superb game play with content that reaches educational standards.

Dragons and the Curse of the 99₵ App

As I sift through hundreds of apps for our iPad in the classroom podcast I am occasionally surprised by quality apps. In our TechEDGE conference yesterday Rob McEntarffer from Lincoln Public Schools showed me DragonBox. In this brilliant app (see geek Dad review) students learn algebra in a way that "sneaks up" on them. It teaches them algebra principles through a true game environment (bringing Gee's vision to life) . Such brilliant apps are rare because they are brilliant. But in effect most of the educational apps have limited learning value. Most have limited content and focus on drill in ways that leave the educator in me cringing and hoping for more.

The problem though may be that the app store set the income margin too low. Right now an app for 5.99 is expensive and gives purchasers pause. The dominant modes are free and 99 cent apps. I just wonder if developers can create and maintain quality educational apps at these prices. I have gone through more than a thousand educational apps in the last year and I can answer with a "not yet". There are some great apps but most fail even my basic criteria to be useful.

I believe that mobile devices with an emphasis on tablets are going to be dominant in education in the next decade maybe even longer. Apps are an important part of this ecosystem but to be useful we need a bigger pool of great apps that serve students need to learn.

The lesson from the print news industry is that new pricing models connected with technology seem to create changes that are irreversible. Some companies are trying to buck this trend by creating educational subscriptions e.g. Footsteps 2 Brilliance and BrainPop.
This is an interesting direction that I hope can be successful but here I want to identify here other possible solutions.

As we discuss flipping classroom I would like to suggest flipping the curriculum and professional development equation. That is, providing the materials for free (or for a nominal sum say 99¢) and charging for backend services such as professional development and data services. This is a concept I have written about before and I think can potentially be viable. The Dynamic Indicators of Basics Early Literacy Skills (DIBELS) seem to have successfully followed this model providing the assessment for free but charging for training, data services and optional assessment materials. While it is a not-for-profit organization it still proves the concept.

An effort like this may benefit from a partnership with a university combining the entrepreneurship of start-ups and the educational know-how of university faculty. This combination can make excellent products for the educational market that mesh gaming concepts and excellent content that lead kids to learn.

Finally, states and districts can choose to partner with universities and invest in creating digital materials to replace the commercial curricula altogether. Such efforts would require upfront costs but may actually reduce the dependence on commercial products and save districts significant amounts of money that can then be invested in professional development and emerging learning technologies.

Video Game like Thinking

Years ago I remember Sarah and I observed our boys playing when suddenly one of them called 'pause' then proceeded a discussion about the nature of pressing the 'X button'. This was not a video game but rather a game they were playing outside borrowing the rules of video games they were playing at the time.

Fast forward a decade or so. Two weeks ago we were in Breckenridge for a family vacation. We sat for lunch in a small pizza/italian place. It's one of these places with paper and crayons so everyone was busy creating in one form or another. Oren who is 8 was busy creating mazes. Now Oren has been a maze fanatic since he was 5 or so. Usually he creates very elaborate designs that can be challenging. He often uses what appears to be mishaps in drawing (e.g. what appears to be accidentally incomplete lines are actually openings) to make the mazes harder.

This time he hands me a this puzzle with a smug look on his face.

Patiently he explains: S is for start F is for finish. I stare at him blankly, he smiles and encourages: "Just do it Abba". I draw a straight line from S to F and he responds smiling: "yes that's it". Then he proceeds to draw this one:

My first instinct is to see if any of the corners just appear to be connected or have tiny gates in them. No the boxes are all closed. "Can I go around?" I ask suspecting a trick. "No" he answers smiling. I know something is going on but I honestly cannot figure out where he is going with this. "I give up" I finally say. Oren then explains patiently. The thicker lines are doors and when you step on the lower case 'f'

they open. "How am I supposed to know that?" I ask incredulously. He looks at me not sure what I mean: "you try it out. You move until you step on the 'f' and see what happens."

It is common to hear "grown ups" criticize video games and the way they seem to engross kids. Here in a different way you can both see what video game thinking is and its impact on learning and thinking.
Oren created a basic level that demonstrated some of the basic rules. Then he proceeded to the real challenge. He also assumed a level of interactivity that is a part of all such games. The static paper and pencil game rules are too simple interactive/ experimental rules are so much more interesting and challenging- mostly because you have to experiment before you know the solution for sure.

I could go on for a while analyzing what appears to be his thought process but I would like to suggest that this video game thinking is analogous in many ways to learning in new domains, especially science and the arts. Instead of repeating known solution to familiar questions, what scientists and artists seek are new ways to respond to problems. They have to interact with ideas, materials and symbols to solve the problems. Video games fostered the right way opens our children to a new creative and thoughtful world of discovery and creation.