Asha KR Shwetha D J Intel & McAfee Confidential PNSQC 2015 1 - PowerPoint PPT Presentation

API Testing – Picking The Right Strategy Asha KR Shwetha D J Intel & McAfee Confidential PNSQC 2015 1

Bio Asha KR ,Senior Software QA Engineer at Intel Security, currently working in the Intel Security India Center in Bangalore. Working for the past 5+ years in different QA roles in SaaS products. Asha hold Bachelor of Engineering in E&C from VTU, Karnataka, India. Shwetha DJ ,Software Development Engineer for Test, currently working in the Intel Security India Center in Bangalore. She has been working for the past 1+ years on SaaS products. Shwetha holds Bachelor of Engineering in E&C from VTU, Karnataka, India. PNSQC 2015 2

 Introduction  The Problem  The Solution  The Approach  Results  Conclusion.. PNSQC 2015 3

 About Web services  About Application Programming Interface (API’s)  What is API testing  API testing in project architecture  Steps involved in API testing PNSQC 2015 4

PNSQC 2015 5

PNSQC 2015 6

Crucial integration Time constraint in Testing releases Manual effort UI failure maintaining product PNSQC 2015 7

The Solution  API Testing - Manual  WCF Test Client  Soap UI  API Testing - Automation  Soap UI  Microsoft Web Test  Using Programming Language PNSQC 2015 8

WCF Client  Windows Communication Foundation  Microsoft .NET framework and user friendly  Give input, invoke method and analyze results  Advantages  Interoperability  Security and Reliability  Disadvantages  Pending requests aborted when closed  Automatically generated values and cumbersome to use PNSQC 2015 9

WCF Client PNSQC 2015 10

The Solution – Soap UI  Simple Object Access Protocol  Communicates over HTTP  Suite execution using user interface  Suite triggers from automation build / command prompt  Advantages  Extend HTTP for XML messaging  Platform- and language-independent  Disadvantages  No mention of security facilities.  Do not hold any state references to remote objects PNSQC 2015 11

The Solution – Soap UI PNSQC 2015 12

The Solution – Microsoft Web Test  User performs a set of operations  Good for simpler web services and straightforward functionality  Suitable for performance testing  Advantages  Easy test scripts creation using test recorder  Edit recorded tests to tailor to specific needs  Disadvantages  Not much validation logic can be put into the tests  High Volume tests were not at all executed in the test suite  Maintenance is difficult PNSQC 2015 13

The Solution – Microsoft Web Test PNSQC 2015 14

Current Approach – Testing Framework  Stable automation framework using C#  Simple, object- oriented language  Test Framework PNSQC 2015 15

Current Approach – Testing Framework  Advantages  C# framework is tool independent  Ease-of-development, rich class library, functions  End to End solution with DB validations  Anyone can contribute to the framework  Interoperability  Disadvantages  Depends on .NET framework. Library not found in .NET difficult to implement C # doesn’t come up with open source technologies and operating systems  PNSQC 2015 16

Challenges in API Testing  Parameter Combination, Call Sequencing  No GUI - difficult to provide inputs  Not easy to validate output  Exception handling function PNSQC 2015 17

Stable framework delivered, Every QA had opportunity Quality product to Customer to become a Programmer Deeper insight into the Percentage of early defect product through API Testing detection: 20% PNSQC 2015 18

Automation Test Results 100% automation of smoke test cases 60% automation of functional test cases Automated Test Coverage 120% 100% 80% 60% Test Coverage 40% 20% 0% BVT FVT End to End Test Cases PNSQC 2015 19

API Testing -- Advantages  Much better quality product, ensuring the data access  Simple security compliance testing  Complete functionality allows for easy future expansion of the application  Structured way of testing, makes automation more feasible API Testing -- Disadvantages  No Encryption  Increasing Tooling needs  Straightforward reason for failing API is not known like GUI PNSQC 2015 20

End to End Testing :  Extension of all BVT scenarios to test end to end functionality  Service call for different APIs in a single method  Needs a good coding style and capturing of exact results Integration Testing  Testing of different systems as one  Covering BVT and FVT functionality by considering all system behavior 21 PNSQC 2015

PNSQC 2015 22

PNSQC 2015 23

Intel & McAfee Confidential