Friday, 9 October 2015

Interactive Prototype II: Testing Data

Here is the raw data from the testing sessions that were run for the Interactive Prototype 2 of Meow Meow Cat.  The data forms two parts, the observations recorded during the session and the questionnaire users filled out.

Testing session: 6 & 7 October (week 10 workshop B & outside-class session)

Users:
  • 4 total
  • 2 male, 2 female
  • 2 not from class

Observations

User #1 (not from class)
  • played 4 games (2 square, 2 row)
  • startled by 'wrong button' noice
  • puffed, said "this is hard work"
  • used one leg more and pivoted to make it easier
  • "like a dancing game but not dancing"
  • square: "looks better"
  • times (seconds): 
    • 33, 25(final) - row
    • 25, 21 - square
User #2 (not from class)
  • played 7 games (4 square, 3 row)
  • changed feet a lot 
  • seemed to enjoy it
  • wanted to keep playing to get a better score
  • stopped playing when he reached a point where he didn't think he could get a better score
  • times (seconds): 
    • 27, 18, 11(final) - row
    • 19, 18, 15, 13 - square
User #3
  • played 4 games (2 square, 2 row)
  • initally sat down which made it hard to press foot pads
  • used one leg more
  • one go was really buggy (40 seconds), sometimes the buttons wouldn't fire
  • "my calves burned"
  • "best time yet" on final run (22 seconds)
  • competed with himself
  • times (seconds): 
    • 37, 22 - row
    • 40, 22(final) - square
User #4
  • played 4 games (2 square, 2 row)
  • found it enjoyable but wasn't super competitive
  • times (seconds): 
    • 22, 23 - row
    • 23, 23 - square

Observation overview

  • Purple dot foot pad was very buggy during class testing session but had worked fine 2 days earlier in aanother session.  I could get it to work for one uesr in class but 2 other users (not recorded above) were unable to finish a game because of this.  I don't know if it was the angle in which it was pressed or the force but it was unsuccessful.  I had my final user successfully play 4 games in the session after this happend.
  • Game played 19 times
  • Times:
    • Lowest time: 11 seconds
    • Longest time: 40 seconds
    • Average time: 23 seconds
  • Start/Stop/Reset button a little buggy - had to press in correct order to work
  • All users who played multiple games improved on their previous time

Questionnaire results

Total responses: 4
All questions except the last open 'Any comments?' question was compulsory.

Q1. Which layout did you prefer playing, formation A (straight line) or formation B (square)? Rate your preference on the following 4-point scale. 
Scale '1: Formation A' (row) to '4: Formation B' (square)

2 user: 3/4 on scale (mostly Formation B)
2 users: 4/4 on scale (definitely Formation B)

Q2. Why did you prefer one layout over the other?

  • The dots were closer together and made it easier to reach each one faster.
  • formation B felt like I was more in the game. It was also a bit easier to hit the different colours when they were separated.
  • The layout felt more natural in sense that it surrounded me.
  • I'm not entirely sure.

Q3. Would you suggest a different dot layout to those presented in this session? If so, please describe. 
  • No layout B is efficient enough
  • maybe a diamond like in DDR.
  • Perhaps use walls so that a player has to use multiple limbs to interact - my legs get tired.
  • No, the second layout was fine.

Q4. How would you describe the instructions for this testing session? 
Scale '1: Clear - it was easy to understand what to do' to '5: Confusing - I did not understand what to do'

3 user: 1/5 on scale
1 users: 2/5 on scale


Q5. If you could change any element of this game, what would it be?


  • Nothing
  • the dots are hard to see when looking at the screen. But, as I became more familiar with the game it was easier to remember where each colour was.
  • Maybe a count down timer to cue the player when to start.
  • I'm not sure. I really like that the cat is on the dot this time. It is an improvement from the last prototype. You could maybe deduct from score (which could be based on how long it takes you) if people first tap the incorrect button (before correct themselves).

Q6. Any other comments?
  • Nice cat.
  • Great game! I really liked it!

Questionnaire overview

  • Users definetley preferred the square formation over the row formation
  • cat on the dot improved understanding of game play
  • well liked
  • clear instructions

No comments:

Post a Comment