Asha KR Shwetha D J Intel & McAfee Confidential PNSQC 2015 1 - - PowerPoint PPT Presentation

asha kr shwetha d j intel mcafee confidential pnsqc 2015
SMART_READER_LITE
LIVE PREVIEW

Asha KR Shwetha D J Intel & McAfee Confidential PNSQC 2015 1 - - PowerPoint PPT Presentation

API Testing Picking The Right Strategy Asha KR Shwetha D J Intel & McAfee Confidential PNSQC 2015 1 Bio Asha KR ,Senior Software QA Engineer at Intel Security, currently working in the Intel Security India Center in Bangalore.


slide-1
SLIDE 1

Intel & McAfee Confidential

API Testing – Picking The Right Strategy

Asha KR Shwetha D J

PNSQC 2015 1

slide-2
SLIDE 2

Bio

Asha KR ,Senior Software QA Engineer at Intel Security, currently working in the Intel Security India Center in Bangalore. Working for the past 5+ years in different QA roles in SaaS products. Asha hold Bachelor of Engineering in E&C from VTU, Karnataka, India.

2 PNSQC 2015

Shwetha DJ ,Software Development Engineer for Test, currently working in the Intel Security India Center in Bangalore. She has been working for the past 1+ years on SaaS products. Shwetha holds Bachelor

  • f

Engineering in E&C from VTU, Karnataka, India.

slide-3
SLIDE 3

3 PNSQC 2015

  • Introduction
  • The Problem
  • The Solution
  • The Approach
  • Results
  • Conclusion..
slide-4
SLIDE 4

4 PNSQC 2015

  • About Web services
  • About Application Programming Interface (API’s)
  • What is API testing
  • API testing in project architecture
  • Steps involved in API testing
slide-5
SLIDE 5

5 PNSQC 2015

slide-6
SLIDE 6

6 PNSQC 2015

slide-7
SLIDE 7

7 PNSQC 2015

Crucial integration Testing Time constraint in releases UI failure Manual effort maintaining product

slide-8
SLIDE 8

The Solution

  • API Testing - Manual
  • WCF Test Client
  • Soap UI
  • API Testing - Automation
  • Soap UI
  • Microsoft Web Test
  • Using Programming Language

8 PNSQC 2015

slide-9
SLIDE 9

WCF Client

  • Windows Communication Foundation
  • Microsoft .NET framework and user friendly
  • Give input, invoke method and analyze results
  • Advantages
  • Interoperability
  • Security and Reliability
  • Disadvantages
  • Pending requests aborted when closed
  • Automatically generated values and cumbersome to use

9 PNSQC 2015

slide-10
SLIDE 10

WCF Client

10 PNSQC 2015

slide-11
SLIDE 11

The Solution – Soap UI

  • Simple Object Access Protocol
  • Communicates over HTTP
  • Suite execution using user interface
  • Suite triggers from automation build / command prompt
  • Advantages
  • Extend HTTP for XML messaging
  • Platform- and language-independent
  • Disadvantages
  • No mention of security facilities.
  • Do not hold any state references to remote objects

11 PNSQC 2015

slide-12
SLIDE 12

The Solution – Soap UI

12 PNSQC 2015

slide-13
SLIDE 13

The Solution – Microsoft Web Test

  • User performs a set of operations
  • Good for simpler web services and straightforward functionality
  • Suitable for performance testing
  • Advantages
  • Easy test scripts creation using test recorder
  • Edit recorded tests to tailor to specific needs
  • Disadvantages
  • Not much validation logic can be put into the tests
  • High Volume tests were not at all executed in the test suite
  • Maintenance is difficult

13 PNSQC 2015

slide-14
SLIDE 14

The Solution – Microsoft Web Test

14 PNSQC 2015

slide-15
SLIDE 15

Current Approach – Testing Framework

  • Stable automation

framework using C#

  • Simple, object-
  • riented language
  • Test Framework

15 PNSQC 2015

slide-16
SLIDE 16

Current Approach – Testing Framework

  • Advantages
  • C# framework is tool independent
  • Ease-of-development, rich class library, functions
  • End to End solution with DB validations
  • Anyone can contribute to the framework
  • Interoperability
  • Disadvantages
  • Depends on .NET framework. Library not found in .NET difficult to implement
  • C# doesn’t come up with open source technologies and operating systems

16 PNSQC 2015

slide-17
SLIDE 17

Challenges in API Testing

  • Parameter Combination, Call Sequencing
  • No GUI - difficult to provide inputs
  • Not easy to validate output
  • Exception handling function

17 PNSQC 2015

slide-18
SLIDE 18

18 PNSQC 2015

Every QA had opportunity to become a Programmer Stable framework delivered, Quality product to Customer Deeper insight into the product through API Testing Percentage of early defect detection: 20%

slide-19
SLIDE 19

Automation Test Results

19 PNSQC 2015

60% automation of functional test cases 100% automation of smoke test cases

0% 20% 40% 60% 80% 100% 120% BVT FVT End to End Test Cases

Automated Test Coverage

Test Coverage

slide-20
SLIDE 20

20 PNSQC 2015

API Testing -- Advantages

  • Much better quality product, ensuring the data access
  • Simple security compliance testing
  • Complete functionality allows for easy future expansion of the application
  • Structured way of testing, makes automation more feasible

API Testing -- Disadvantages

  • No Encryption
  • Increasing Tooling needs
  • Straightforward reason for failing API is not known like GUI
slide-21
SLIDE 21

End to End Testing:

  • Extension of all BVT scenarios to test end to end functionality
  • Service call for different APIs in a single method
  • Needs a good coding style and capturing of exact results

Integration Testing

  • Testing of different systems as one
  • Covering BVT and FVT functionality by considering all system

behavior

21 PNSQC 2015

slide-22
SLIDE 22

22 PNSQC 2015

slide-23
SLIDE 23

23 PNSQC 2015

slide-24
SLIDE 24

Intel & McAfee Confidential