Lab Usability Study Ambi Team Members Legend John

Lab Usability Study: Ambi

Team Members Legend John 2 Keith

Changes Project: Prototype: Jukebox ● Location detection from specifying to automatic ambi 3

Presentation Outline method results 4 discussion

Participants Adam Shilpa Gabby 22, Santa Clara Student Engineer Product Manager 5

1 Method Apparatus, Tasks, Procedure, Test Measures 6

Apparatus ● Android Studio’s virtual android ● AZ Screen Recorder to record screen ● i. Phone to record the user ● Another i. Phone to record audio ● Cafes/work environments in Palo Alto and Stanford 7

Tasks Main Tasks: 1. Set your preferences 2. Find directions to a place 3. Report the current environment/Suggest a change Subtasks: ● Find more details about a place ● Sort the list of places in a different way ● Update your preferences 8

Tasks Main Tasks: 1. Set your preferences 2. Find directions to a place 3. Report the current environment/Suggest a change Subtasks: ● Find more details about a place ● Sort the list of places in a different way ● Update your preferences 9

Tasks Main Tasks: 1. Set your preferences 2. Find directions to a place 3. Report the current environment/Suggest a change Subtasks: ● Find more details about a place ● Sort the list of places in a different way ● Update your preferences 10

Tasks Main Tasks: 1. Set your preferences 2. Find directions to a place 3. Report the current environment/Suggest a change Subtasks: ● Find more details about a place ● Sort the list of places in a different way ● Update your preferences 11

Tasks Main Tasks: 1. Set your preferences 2. Find directions to a place 3. Report the current environment/Suggest a change Subtasks: ● Find more details about a place ● Sort the list of places in a different way ● Update your preferences 12

Tasks Main Tasks: 1. Set your preferences 2. Find directions to a place 3. Report the current environment/Suggest a change Subtasks: ● Find more details about a place ● Sort the list of places in a different way ● Update your preferences 13

Tasks Main Tasks: 1. Set your preferences 2. Find directions to a place 3. Report the current environment/Suggest a change Subtasks: ● Find more details about a place ● Sort the list of places in a different way ● Update your preferences 14

Procedure 1. Intro + Consent Form 1. Short answer questions to get demographics 1. Overview of the app 1. Tasks and Subtasks 1. Follow-up interview 15

Test Measurements ● Number of errors ● Time taken to complete task ● Number of clicks ● How easy the task was to accomplish (out of 4) 16

2 Results Data, Critical Incidents 17

Results 18

Task 1 Set your preferences Number of Errors: 1 Time Taken: 78 s Ease: 1/4 Number of Clicks: 7 User 2: Didn’t really understand the task 19

Task 2 Find directions to a place Number of Errors: 0 Time Taken: 4 s Ease: 1/4 Number of Clicks: 2 All users didn’t know how to go back after Google Maps 20

Task 3 Report environment/Suggest a change Number of Errors: 0 Time Taken: 40 s Ease: 2/4 Number of Clicks: 7 21

Subtask Update Preferences Number of Errors: 3 Time Taken: 56 s Ease: 3/4 Number of Clicks: 10 User 1: prefers to see preferences at all times User 3: Couldn’t accomplish this task 22

Subtask Sort list by a preference Number of Errors: 3 Time Taken: 25 s Ease: 2/4 Number of Clicks: 5 User 1 and 2: Hit the horizontal lines first 23

Subtask Find more details about a place Number of Errors: 1 Time Taken: 34 s Ease: 1/4 Number of Clicks: 3 All users: Details page isn’t evident User 2: Kept clicking on the picture 24

3 Discussion Learned from Pilot Run, Possible Future Improvements 25

Learnings from Testing ● Better to have an actual Android phone ● Screen recordings can be corrupt ● i. Phone video recording would be more helpful in a quieter environment 26

Future Improvements ● Information should be geared towards preferences, see more of the current environment ● Being able to always see your preferences ● Know what the environment looked like ● More preferences ● UI Changes 27

Summary ● Tasks were straightforward but some subtasks were confusing to do ● Need to address this in our future iterations ● Can improve a lot on our experimentation methods 28

THANKS! Any feedback? 29