NonFunctional Testing Non Functional Testing Primary Objective Measure

Non-Functional Testing

Non Functional Testing Primary Objective: • Measure response time / throughput for Mobile Web Application • Measure response time for admin application Secondary Objective: • Business recommendations

Non Functional Testing SGHost (Sponsors Hosting Provider) • SOHO 2 Plan • Cpanel • PHP/My. SQL LAMP • Unlimited Bandwidth • Supports SMTP Email

Non Functional Testing Test Environment Load Generator: • Visual Studio 2013

Non Functional Testing Test Environment Internet Connection: • Starhub 300 Mbps home connection • Cat 6 LAN Cable to GPON • SMU Network • SMU Wi-Fi

Non Functional Testing Quality Attributes We Hope To Achieve: • Administrator can access any page under 1 second as a single user • When called, all RESTful web services should execute successfully and respond within 0. 5 seconds when there are less than 100 concurrent requests

Non Functional Testing Test Methodology (Admin Web): • Visual Studio Web Test run 5 times on Starhub connection from home • 5 more times on SMU Network • Average Of 10 times taken

Non Functional Testing Results (Admin Web) Response Time: Site Run 1 Run 2 Run 3 Run 4 Run 5 Run 6 Run 7 Run 8 Run 9 Run 10 Average admin_login. php 1. 301 0. 313 0. 847 0. 505 0. 769 0. 572 1. 093 1. 007 0. 42 1. 251 0. 8078 admin_auth. php 0. 249 0. 649 0. 815 0. 856 0. 373 0. 559 0. 746 0. 086 0. 337 0. 258 0. 4928 view_route. php 0. 249 0. 139 0. 526 0. 77 0. 244 0. 065 0. 07 0. 491 0. 843 0. 035 0. 3432 view_stop. php 0. 738 0. 944 0. 793 0. 891 0. 587 0. 805 0. 615 0. 36 0. 138 0. 309 0. 618 view_booking. php 0. 131 0. 463 0. 536 0. 573 0. 053 0. 256 0. 57 0. 788 0. 713 0. 12 0. 4203 view_payment. php 0. 79 0. 77 0. 066 0. 056 0. 479 0. 931 0. 328 0. 521 0. 393 0. 138 0. 4472 view_customer. php 0. 357 0. 898 0. 949 0. 212 0. 809 0. 626 0. 926 0. 606 0. 874 0. 106 0. 6363 view_announcement. php 0. 16 0. 481 0. 363 0. 807 0. 826 0. 42 0. 326 0. 865 0. 622 0. 005 0. 4875 view_settings. php 0. 6766 0. 8 0. 767 0. 988 0. 857 0. 862 0. 349 0. 425 0. 226 0. 821 0. 671

Non Functional Testing Results (Admin Web) Response Time:

Non Functional Testing Test Methodology (Web Services): • Visual Studio Load Test run 5 times, 5 minutes each time, on Starhub connection from home • 5 more times on SMU Network • • Average of 10 times taken Repeated for 25, 50, 75, 100 virtual users

Non Functional Testing Results (Web Services) Response Time: Virtual Users Run 1 Run 2 Run 3 Run 4 Run 5 Run 6 Run 7 Run 8 Run 9 Run 10 Average 25 0. 047 0. 143 0. 109 0. 151 0. 197 0. 028 0. 062 0. 087 0. 0977 50 0. 34 0. 142 0. 103 0. 393 0. 261 0. 107 0. 236 0. 203 0. 37 0. 199 0. 2354 75 0. 496 0. 457 0. 329 0. 502 0. 515 0. 436 0. 315 0. 583 0. 572 0. 535 0. 474 100 0. 613 0. 861 0. 844 0. 825 0. 674 0. 755 0. 862 0. 613 0. 647 0. 775 0. 7469

Non Functional Testing Results (Web Services) Response Time:

Non Functional Testing Results (Web Services) Throughput: Virtual Users Run 1 Run 2 Run 3 Run 4 Run 5 Run 6 Run 7 Run 8 Run 9 Run 10 Average 25 705 671 702 705 690 714 694 677 664 687 690. 9 50 667 673 672 685 715 667 709 656 709 666 681. 9 75 770 686 926 727 692 981 966 952 885 536 812. 1 100 896 1046 898 1064 979 912 830 975 1081 1054 973. 5

Non Functional Testing Results (Web Services) Throughput:

Non Functional Testing Overall: • Administrator can access any page under 1 second as a single user • When called, all RESTful web services should execute successfully and respond within 0. 8 seconds when there are less than 100 concurrent requests

Non Functional Testing Limitations & Concerns: • Testing might look like a Denial Of Service attack • Mitigation: Conducted test at midnight / early morning • Testing was capped at 100 users

Non Functional Testing Limitations & Concerns: • Test is not conducted in a real-world scenario (Using load generator, with 1 internet connection, on PC…) • Real-world response time can be severely affected by 2 G/3 G/4 G mobile reception

Non Functional Testing Conclusion: • Response time seems fine for now • Can consider migrating to hosting plans which caters for higher bandwidth & availability • In future, can consider dedicated instances to serve if need be