User tests Wireframe

User test 18/03/22

Info about user: 18-year-old student who has been competitively playing chess for 10 years.

Menu

I see there is a place to enter results, but is there a place to view them? If not, I would add that as an option. When viewing, I would want to see the results for all rounds combined, maybe as a list with player name and then the number of points. I don’t see a use in viewing results only for one specific round.

Add results

Still don’t see a place where I can add how many tables I have, but I like this way of adding the results better than the last one I was shown with the list.

Tournament set-up

Oh okay, there is the table feature! Would maybe have liked for the tables to be an option from the menu.

Edit a player

Yeah, seems nice.

Player list

Maybe instead of showing the results for each round one could only show the accumulative score, potentially combined with an overview showing the number of wins, number of draws and number of losses.

Add a player

Like how you can access add a player both from the menu and from the player list.

Potential changes based on the user study

• Show number of wins, losses and draws in the player list

Changes based on the user study

• Show accumulated score of players in the player list

• Add an option in menu to add number of tables available at the tournament menu

• Add an option in menu to view results

User test 04/03

Info about user: 18 year old student who has been competitively playing chess for 10 years.

Menu

Clean. Easy to see my options.

Edit a player

Like that there are two ways to find players, but you may consider changing it so that you can only search by name or club ID as I don’t see how being able to search by rating or club is helping me narrow it down.

Also, what happens if more than one player is found? Am I then allowed to chose which one to change?

Add results

Good, kind of inconvenient how the list goes from person A to person X as you usually enter results after each match, meaning that if player A and K played you would have to remember all the results, or write them down on paper, before being able to enter the results. Maybe change so you can enter table number, then enter results of the players?

Tournament set-up

Seems good, but where do you enter the number of tables you have?

Add a player

Nice, contains all the information you need.

Player list

Good. Like how you can access all the player related tasks in the player list as well.

Changes based on the user test

- How to enter results (enter per table and not in a drop-down list)
- Only search for player by either name or player ID
- Add place to enter the amount of tables

User Test 25.03.2022

User is a 20-year-old male student with little knowledge of chess or chess tournaments.

Wireframe

Player List

User thinks the list will be too long for the screen in a long tournament due to how it displays the results of each round in ongoing columns. Suggests having the player list show less info but adding the option of viewing a specific player (without editing them) where info like the results, player color and table of each round can be displayed. Likes that you can add or edit players from the list. Requests an option to delete players.

Add Player

Name should be split into first name and last name, so it looks cleaner in the lists (for instance only displaying last name in compressed versions). After adding a player, the user thinks it should prompt whether to return to menu or add another player so one does not have to go through the menu for every player if one is adding many players at the same time. Should also have option of going to view player list.

Add Results

Instead of prompting which table it should go through each table and ask you the results of each table in a loop.

Generate Tournament

User thinks the program should know which round it is and not be able to generate the next round unless all tables have result from previous round. There should also be an error message if the number of players does not match the number of tables.

Edit Player

Similarly to “Add Player” and “Add Results”, edit player should have a prompt to let you edit another player or return to menu instead of just returning to menu.

Other

Misses a results screen where you see the rankings with options for seeing results by table in each round. Also requests an option to reset the tournament and all players in the program or have an option for multiple tournaments with a selection of players participating.

User tests MVP

User test 25/03/22

Info about users: 18-year-old student who has been competitively playing chess for 10 years.

The user was given a series of tasks to preform running the MVP as an .exe file on their own computer while sharing the screen so a member from the team could see what they were doing.

Add a player

Successful: Y

Contains all the necessary info, easy to add players and intuitive. Like how you get to see the range for the number inputs.

Edit a player

Look through list

Successful: Y

Nice to look through the list, especially for smaller games or if you’ve misspelled the name and can’t find the player through the search function.

Enter info

Successful: Y

Was told that I needed to change the info of the player named Per by searching for his name but didn’t initially understand what “Enter info” was supposed to mean. Maybe change to “search by name”

Match set-up

Successful: Y?

It let me set up a match, but it also let me set up a match between the same person, which shouldn’t be possible. This set-up would only work for smaller tournaments as it is quite time-consuming (because you’re basically setting up the matches yourself, the program just saves it.

Add results

Successful: Y

A bit confusing that add results is a part of the match set-up. Was expecting them to be two different menu options. Writing both people’s names work, but it’s not ideal. Liked the enter table thing we discussed before better.

View results

Successful: Y

It’s nice to see the score for each player, but to improve it would have been nice to see the number of wins and draws (like you can in view player). Would also like the list to be in descending order.

Other comments

Would like for the menu to show up every time I go back to it as it’s hard to remember my options.

Potential changes based on the user study:

• Separate Match set-up and Add results into two menu options

• Descending order results list

Changes based on the user study

• Make it so that a player can’t play against themselves

• Change phrasing in certain parts of the program

• Improve Match set-up

• See number of wins and draws in view results

User test 25/03/22

Info about users: a 50-year-old male working in software development.

The user was given a series of tasks to preform running the MVP as an .exe file on their own computer while sharing the screen so a member from the team could see what they were doing.

(This user was also allowed to look through the code due to his background in software development)

Add a player

Successful: Y

It adds all the info needed. Nothing to complain about here.

Edit a player

Successful: Y

Look through list

Successful: Y

The list would only be useful for smaller tournaments, but it’s a nice little feature. Don’t like how you have to scroll up and down, but hard to change that if you are not including any visual features.

Enter info

Successful: Y

Didn’t really understand what enter info meant? Especially when you are only allowed to search by name. Would also like to choose what info I want to change, and get the player printed out again at the end with the new changes.

Match set-up

Successful: Y

It’s not really much of a set-up, is it? I get the player list printed out and then I also have to choose who plays together. Again, works for smaller tournaments, but would like for the program to do at least a bit of my work for me and not just work as a storing device (and it’s not storing anything either as there is no filereading)

Add results

Successful: Y

This was better at getting some of the workload off me. Works okay, but also assumes that you know every player's name (or you have to ask them). Would maybe have printed out the players playing together (when match set-up actually sets up something) including maybe a number for each match to make it easier.

View results

Successful: Y

Good. Would have liked to see it in descending order so you know who is actually leading the tournament.

Other comments

I think you would improve from a multi-file program as I imagine the .cpp-file will become very unorganized and compact as you add more features to the program.

Changes based on the user study:

• Multi-file program

• Improve Match set-up

• Change phrasing

• Print out all matches to make it easier to enter results

• Descending order viewResults()

User test 25/03/22

Info about users: 50 year old amateur chess player, played for about 2-years.

The user was given a series of tasks to preform running the MVP as an .exe file on their own computer while sharing the screen so a member from the team could see what they were doing.

Add a player

Success: y

It was easy, self-explanatory. Not much else to say.

Edit a player

Succes: partial success

Initially confused about what the first prompt wanted him to do. Not intuitive. Didn't think it was natural to go straight to the “enter info” function without getting a prompt informing him so. Changing some of the output so that it is more easily understood what it is that you want from the user. for example, change “Write Name” into “Change player name:”. Could make two Players with the same ID.

Match set-up

Success: y

was able to create a match and add players nice to be able to write player and if it was player 1 or 2. Maybe missing a way for adding who is black and who is white.

Add results

Success: y

intuitive to use no real comment

View results

success: y

intuitive to use no real comment

Other comments

Get the menu commands underway

Wants the ability to add black or white

Could be able to print out match statistics (black/white percantages)

not only get scores but also matches played

Other than that it worked ok from what he could tell.

Potential changes based on the user study

• maybe have player ID first, maybe more intuitive

Changes based on the user study

• Adding menu underway.

• Ability to add black or white while setting up a match

• not only get scores but also matches played

User test on final product User 1 Info about user: a 21-year-old art student. No knowledge about chess, not very proficient with data technology. The user in a place without Wi-Fi but were sent screenshots of the program and texted back their input. Menu User is initially confused by the program; does not understand how they are supposed to add input. First attempts to write complete sentences, which works for the first prompts due to the program only checking the first letter typed.

Create Tournament Is confused by what “tables” and “rounds” mean due to lack of knowledge about chess, was frustrated that the program did not explain the terms or the fact that every table needs two players.

Changes made based on user study Added a prompt when the program first opens that specifies all commands are single character.

Potential changes based on user study While this user requested information about how chess works and an explanation of terminology used in the program, the team believes most people who organize chess tournaments already possess this knowledge and would not benefit from this, and therefore that adding it to the program would not be an effective use of time.

User 2 Info about user: a 19-year-old programming student. Basic knowledge of chess, proficient with computers.

Add player User finds it overly complicated having to give the “add player” prompt in the menu for every player, especially considering you need a set number of players based on the number of tables specified at tournament creation. User suggests having it loop add player after specifying number of tables instead of going through the menu first.

General Program is clean and easy to use, user finds the program to be intuitive outside of the issue raised in the previous point.

Potential changes based on user study The change to the add player function would probably benefit the program, though it would complicate the “delete player” function and require a significant amount of work. The program works fine as is, so the team believes the team needed to add this feature outweighs the benefit.

User 3 User is a 21-year-old programming student. Fairly knowledgeable about chess but does not play actively, proficient with computers.

Add players Finds it intuitive to use but thinks it should automatically stop you from adding more players if there are enough.

General It is possible to have more rounds than the number of tables allow, which causes the program to crash upon attempting to matchmake for the next round only to discover all players have met each other.

Changes based on user study Both features the user brings up are quite simple to add and gives a significant increase to the quality of the user’s experience, making the program seem finished by diminishing the room for error’s caused by people, and as such the team added this features.

User 4 User is a 20-year-old programming student with limited chess knowledge but proficient with computers.

General “The program is simple to use and very smooth. There is no problems or bugs, like having to enter the input twice to make it work. Yes. Overall, if I ever had a chess tournament I would use this program.”