UAT UAT p Participantinternal Masami UAT p Goals

  • Slides: 33
Download presentation
UAT

UAT

UAT p. Participant(internal) Masami

UAT p. Participant(internal) Masami

UAT p. Goals: • Both Drupal and Android side can work well according to

UAT p. Goals: • Both Drupal and Android side can work well according to Client’s requirement. • Get feedbacks from client to improve and finalize drupal website and Android application

UAT Result & Analysis S/N Area Specific Function Pass/Fail 1 Login Application Login Pass

UAT Result & Analysis S/N Area Specific Function Pass/Fail 1 Login Application Login Pass Reset Password Pass Specific Function Pass/Fail Text Update Pass Tag a defined location Pass Tag a searched location Pass 2 S/N 3 4 5 Area Manage Livefeed S/N Area Specific Function Pass/Fail 6 Manage Livefeed View Livefeed list Pass View Livefeed details Pass 7

UAT Result & Analysis S/N Specific Function Pass/Fail 8 Take a photo Pass 9

UAT Result & Analysis S/N Specific Function Pass/Fail 8 Take a photo Pass 9 Select a photo Pass Reset Pass Cancel adding a photo Pass 12 Add a photo title Pass 13 Crop a photo Pass 14 Photo filtering Pass 10 11 Area Manage Photo

UAT Result & Analysis S/N Area Specific Function Pass/Fail 1 Manage WC Team Members

UAT Result & Analysis S/N Area Specific Function Pass/Fail 1 Manage WC Team Members Create Team Member account Pass Retrieve all the accounts details Pass Delete team member account Pass Edit team member account Pass 2 3 4 S/N Area Specific Function Pass/Fail 5 Manage Diary Entry Livefeed Display Pass View Livefeed details Pass 6

Improvement Based on UAT 1. User login validation

Improvement Based on UAT 1. User login validation

Improvement Based on UAT 2. Add Noting progress dialog Transition between activities

Improvement Based on UAT 2. Add Noting progress dialog Transition between activities

Improvement Based on UAT 3. Remove checkbox on livefeed list and view project list.

Improvement Based on UAT 3. Remove checkbox on livefeed list and view project list.

Improvement Based on UAT 4. Replace photo title instead of diary entry discription update

Improvement Based on UAT 4. Replace photo title instead of diary entry discription update

Improvement Based on UAT 5. Rearrange the text position in livefeed details

Improvement Based on UAT 5. Rearrange the text position in livefeed details

Improvement Based on UAT 6. Change the notification text in like function

Improvement Based on UAT 6. Change the notification text in like function

UT

UT

UT Goals ØThe application can reach the goal of the application -Easy to use

UT Goals ØThe application can reach the goal of the application -Easy to use -High quality Ø Get Users’ feedback to improve the application

UT Overview Improvement • Comparison • Finalized Product • Path Analysis • Functional analysis

UT Overview Improvement • Comparison • Finalized Product • Path Analysis • Functional analysis UT Data Analysis UT Conduction • Execution Flow UT Preparation • Roles • Participants • Docs • Consideration based on mid-term feedback

UT Preparation ØRoles Table Roles Responsibility Instructor Introduce the goal and UT flow to

UT Preparation ØRoles Table Roles Responsibility Instructor Introduce the goal and UT flow to participants Guidance Guide participants when User critical problem in UT Survey supervisor Answer queries when User met problem in survey ØRoles Table Item Responsibility Instructor Introduce the goal and UT flow to participants Guidance Guide participants when User critical problem in UT Survey supervisor Answer queries when User met problem in survey

UT Preparation • Docs Name Effect Introduction Paper Introduce the purpose and participant’s role

UT Preparation • Docs Name Effect Introduction Paper Introduce the purpose and participant’s role in UT Consent Form Introduce the goal and UT flow to participants Survey Question and Free feedback paper

UT Execution Introduction Use App Feedback

UT Execution Introduction Use App Feedback

UT Execution HTC ONE X Small Size Introduction HTC ONE S Medium Size Use

UT Execution HTC ONE X Small Size Introduction HTC ONE S Medium Size Use App Samsung Note Large Size Feedback

UT Execution Q Qualtrics Survey Introduction Use App Feedback

UT Execution Q Qualtrics Survey Introduction Use App Feedback

UT Data Analysis • • • Raw data (on Wiki, link: …) Path analysis

UT Data Analysis • • • Raw data (on Wiki, link: …) Path analysis Function utilization frequency Analysis about each function Overall analysis

Path Analysis - Scenarios To Consider Scen arios Text update Tag location Add photo

Path Analysis - Scenarios To Consider Scen arios Text update Tag location Add photo 1 Y 2 Y 3 Y 4 Y 5 Y 6 Y 7 Y Y 8 Y Y 9 Y Y 10 Y Y 11 Y Y 12 Y Y Assign projects View Project View Livefeed Persons No. - Y Y Y - Y -

Path Analysis - Scenarios To Consider Scen arios Text update Tag location Add photo

Path Analysis - Scenarios To Consider Scen arios Text update Tag location Add photo Assign projects 13 Y 14 Y Y 15 Y Y 16 Y 17 Y Y Y 18 Y Y Y 19 Y Y Y 20 Y Y Y 21 Y Y Y 22 Y Y 23 Y Y Y 24 Y Y Y View Project Y View Livefeed Persons No. Y - Y Y Y - Y - Y Y 1

Path Analysis - Scenarios To Consider Scen arios Text update Tag location Add photo

Path Analysis - Scenarios To Consider Scen arios Text update Tag location Add photo 25 Y 26 Y 27 Y Y Y 28 Y Y Y 29 Y Y Y 30 Y Y 31 Y 32 Y Assign projects View Project View Livefeed Person No. Y Y 2 Y Y Y - Y Y Y 1 Y 2 Y Y Y - Y Y 3 Y Y 21 Comment: • Scenario 32 accounts for 67. 74% • Path with five functions accounts for 22. 58% Conclusion: User tends to go through the scenario with all functions or with at least 4 functions, which shows that the flow we have made is reasonable.

Function Utilization Frequency Analysis Function Times Utilize Percentage Utilize Frequency Text Update 31 100%

Function Utilization Frequency Analysis Function Times Utilize Percentage Utilize Frequency Text Update 31 100% Very Frequent Tag Location 25 80. 64% Frequent Add Photo 31 100% Very Frequent Assign Project 28 90. 32% Very Frequent View Livefeed 30 96. 77% Very Frequent Comment: • 5 of 6 function (83. 33%) are used very frequently • Tag location function is used not very frequently >=90% Very Frequent 80%-90% Frequent 70%-80% A little frequent 60%-70% Normal 50%-60% Seldom <50% Conclusion: Functions of our application have a efficient usage. Very Seldom

Function 1. Text Update Area Functional Non-functional Overall Branch work-response Utilization Evaluation Text Input

Function 1. Text Update Area Functional Non-functional Overall Branch work-response Utilization Evaluation Text Input 100% Excellent Prompt Notice 5. 48 100% Excellent Flow 5. 30 Forced Excellent Speed 5. 35 Forced Excellent Share Button 100% Forced Excellent Title 5. 25 Forced Excellent Organization 5. 42 Forced Excellent Visibility 5. 43 Forced Excellent How easy it this function? 5. 44 Comment: 1. Every sub-function of this function can work well. 2. This function has excellent design. 3. This function is very easy to use.

Function 2. Tag Location Area Functional Non-functional Overall Branch work-response Utilization Evaluation Search Engine

Function 2. Tag Location Area Functional Non-functional Overall Branch work-response Utilization Evaluation Search Engine 6. 63 60% Good Location List 88% Forced Good Prompt Notice 6. 51 36% Normal Flow 5. 23 Forced Excellent Speed 5. 34 Forced Excellent Done Button 100% Forced Excellent Title 5. 36 Forced Excellent Organization 5. 05 Forced Excellent Visibility 5. 43 Forced Excellent How easy it this function? 5. 48 Comment: 1. Every sub-function of this function can work well. 2. This function has excellent design. 3. This function is very easy to use. 4. However, the prompt notice is not so necessary for users, because they think that almost all people will only choose one location.

Function 3. Add Photo Area Functional Non-functional Overall Branch work-response Utilization Evaluation Camera 100%

Function 3. Add Photo Area Functional Non-functional Overall Branch work-response Utilization Evaluation Camera 100% Excellent Effect 100% 71% Excellent Photo Title 100% 84% Excellent Prompt Notice 5. 07 Forced Excellent Flow 5. 85 Forced Excellent Speed 5. 52 Forced Excellent Done Button 100% Forced Excellent Title 6. 17 Forced Excellent Organization 5. 86 Forced Excellent Visibility 5. 28 Forced Excellent How easy it this function? 5. 58 Comment: 1. Every sub-function of this function can work well. 2. This function has excellent design. 3. This function is very easy to use. 4. However, user tend not to use the photo title because of too low position and not use effect due to limited number of filters. (getting from Intial_Report. ppt)

Function 4. Assign Project Area Functional Non-functional Overall Branch work-response Utilization Evaluation Selection 100%

Function 4. Assign Project Area Functional Non-functional Overall Branch work-response Utilization Evaluation Selection 100% Excellent Multi-selection 100% 82% Good Prompt Notice 5. 2 43% Normal Flow 5. 41 Forced Excellent Speed 5. 28 Forced Excellent Done Button 100% Forced Excellent Title 5. 37 Forced Excellent Organization 5. 50 Forced Excellent Visibility 5. 03 Forced Excellent How easy it this function? 5. 37 Comment: 1. Every sub-function of this function can work well. 2. This function has excellent design. 3. This function is very easy to use. 4. However, small portion of people will not select multiple projects. And users don’t think prompt is very useful because in this application, user will always select at least on project, getting data from 100% utilization in “selection”

Function 5. View Project Area Functional Non-functional Overall Branch work-response Utilization Evaluation Selection 100%

Function 5. View Project Area Functional Non-functional Overall Branch work-response Utilization Evaluation Selection 100% Excellent Project details 100% Excellent Back Button 100% Forced Excellent Flow 5. 36 Forced Excellent Speed 5. 53 Forced Excellent Done Button 100% Forced Excellent Title 5. 45 Forced Excellent Organization 5. 29 Forced Excellent Visibility 5. 61 Forced Excellent How easy it this function? 5. 23 Comment: 1. Every sub-function of this function can work well. 2. This function has excellent design. 3. This function is very easy to use.

Function 6. View Livefeed Area Functional Non-functional Overall Branch work-response Utilization Evaluation Selection 100%

Function 6. View Livefeed Area Functional Non-functional Overall Branch work-response Utilization Evaluation Selection 100% Excellent Livefeed details 100% Excellent Understanding 83% Forced Good Flow 5. 31 Forced Excellent Speed 5. 32 Forced Excellent Back Button 100% Forced Excellent Title 5. 36 Forced Excellent Organization 5. 28 Forced Excellent Visibility 5. 46 Forced Excellent How easy it this function? 5. 23 Comment: 1. Every sub-function of this function can work well. 2. This function has excellent design. 3. This function is very easy to use. 4. However, the live feed details cannot make user fully understand the livefeed due to description position. (Getting from user feedback about improvement about this function in “Initial_Report. ppt”)

Overall Analysis Goals Reach or not? All functions can work without bugs? Yes The

Overall Analysis Goals Reach or not? All functions can work without bugs? Yes The application is easy to user? Yes Users are content with the design of the app? Yes Users give their suggestions? Yes Conclusion 1. This User Test has reached all the goals settled. 2. The application overall has a good quality and reached to users’ standard. 3. However, there are still some minor points needed to be revised.

Improvements according to UT

Improvements according to UT