SOFTWARE VERIFICATION AND VALIDATION BY: MITCHELL LANE TOPICS T - - PowerPoint PPT Presentation

SOFTWARE VERIFICATION AND VALIDATION

BY: MITCHELL LANE

TOPICS

• T

erms and Methods

• Historic Failures
• Licenses and certifjcation
• Warranties
• Ethical Evaluations

• Software Validation- Does the model accurately represent the

system

• Ensures design specifjcations are meet
• Ensures user’s needs are meet
• Predict to validate
• Experts
• Software Verifjcation- Does the program Implement the

model

• Does the product fulfjll its plans
• Done by quality assurance team

INDEPENDENT SOFTWARE VERIFICATION AND VALIDATION (ISVV)

• Goal is to increase software quality of safety-critical systems
• Consists of fjve phases
• Planning- selection of tools and methods
• Requirements Verifjcation- verifjes completeness, correctness, and

testability along with feasibility and maintenance

• Design Verifjcation- does is meet standards of software requirements
• Code Verifjcation- verifjes completeness, correctness, and testability
• Validation- Identifjes weak components. Black and white box testing.

Black Box White Box Functional Unit System Integration Stress Performance Usability Acceptance Regression Beta

Types of Testing

IEC 62304

MIL-STD-498

• Establishes uniform requirements for software development and

documentation

• Consists of plans, requirements, design, quality, manuals, support

manuals, software

• 22 Data Item descriptions
• Quality
• Software test plan- plan for qualifjcation testing
• Software test description- T

est cases/procedures for qualifjcation tests

• Software test report- T

est results of qualifjcation testing

WHY WE NEED TO VALIDATE OR VERIFY SOFTWARE

• Lives are at stake
• Money
• Security
• Meeting owner/user requirements
• Many difgerent User inputs
• Fully tested software is impossible
• T

esting only reveals bugs, doesn’t prove none exist

Problems

NECESSITY OF HIGH AVAILABILITY

• Medical
• Air traffjc control
• Emergency services

THERAC-25

• Designed to administer x-ray and electron beams from a difgerent room to

the Patient

• Re-used software from Therac-6 and Therac-20 to save money
• Had variety of software and hardware issues (two software issues were race

conditions)

• Changing mistakes quickly caused change to go unnoticed
• 0-255 counter used to determine if gun was ready to fjre. If administer hit

set at right time it could administer the radiation because counter is 0.

MINNESOTA LICENSING AND REGISTRATION SYSTEM (MNLARS)

• Replace 30 year old legacy system
• Pre-launch testing was not meet
• During testing said low number of bugs
• Inaccuracies and delays in processing of license and title

transactions

OTHER HISTORIC FAILURES

• Software billing errors from Qwest
• London’s ambulance dispatch system
• iPAQ computers on Amazon ofgered below retail price
• Patriot Missile
• Mars Climate Orbiter
• T
• kyo Stock Exchange

LICENSE AND CERTIFICATION

• No Licensing or Certifjcation required
• College Degree not Required
• No continuing of education
• Membership in society is optional

WARRANTIES

• T
• day many company’s guarantee money back if the program fails.
• Many company’s guarantee difgerent outcomes of there product.
• Microsoft Offjce 2010- says if instructions are followed, the software

will perform substantially as described

• Railroad T

ycoon- promised only the ability of being able to install the software

• Civilization Revolution game- “licensor does not warrant… that the

software will meet your requirements; that operation of the software will be uninterrupted or error-free, or that the software will be compatible with third party software or hardware or that any errors in the software will be corrected.”

RELEASING PREMATURE OR UNTESTED SOFTWARE TO BE THE FIRST

• Kantianism - uses people as a means to end to be the fjrst

competitor

• Act Utilitarianism - wrong because the negative of efgects that

come from buggy software out weigh the good.

• Good- Receive program faster, potential for company to fjx errors
• Bad- Slow productivity, Inaccuracies, could be unusable
• Rule Utilitarianism - everyone releasing software prematurely

would lead to unhappiness

CITATIONS

• https://en.wikipedia.org/wiki/Software_verifjcation_and_validation
• http://toolsqa.com/software-testing/difgerence-between-verifjcation-

and-validation/

• https://en.wikipedia.org/wiki/IEC_62304#Software_development_pr
• cess
• https://en.wikipedia.org/wiki/MIL-STD-498
• https://dps.mn.gov/divisions/dvs/programs/mnlars/Pages/default.as

px

• https://en.wikipedia.org/wiki/High_availability
• Ethics for the information age Michael J. Quinn

QUESTIONS