Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Additional checks for a Bug

...

Complete an Fault Slip-through Analysis (FSA) and add as a comment in Jira

Agree with Customer the FSA especially if there are any follow-up actions needed BEFORE closing the bug

Expand
titleFSA Comment Template

Fault Slip Through Analysis

  • Bug Category: <choose option>
  • Reason for Slippage: <choose option>
  • Action needed to prevent slippage: <free text>
  • Phase it should have been found in: <choose option>
  • Category of test it should have been found in: <choose option>
  • Description of test it should have been found in: <free text>
  • Link(s) To JIRA improvement record:  <free text>

...

titleFSA Fields and Options

...

  1. 3PP

  2. Critical Vulnerability

  3. Documentation

  4. Functional

  5. High Availability

  6. Install

  7. Logging

  8. Performance

  9. Robustness

  10. Rollback

  11. Scalability

  12. Security

  13. Testware/CI

  14. Upgrade

...

  1. Insufficient test coverage
  2. Intermittent Fault/Timing Issue
  3. Missed impact
  4. Missed in code review
  5. Missed in design analysis
  6. Missed in document review
  7. Missing requirement
  8. Unrealistic Development timeframe
  9. Late requirement: insufficient analysis
  10. Environment

...

  1. Design
  2. Review
  3. Automated (unit) Test
  4. Microservice CI (CIST)
  5. Release

...

  1. Unit
  2. Integration Test
  3. Performance

...

FSA Introduction

Fault Slip Through Analysis is a tool designed to improve team processes and test scopes, specifically targeting the detection and prevention of faults that might otherwise be overlooked or discovered too late in the development cycle.

This approach acknowledges the inevitability of bugs in software development but focuses on learning from these occurrences. By analyzing why bugs happen, teams can identify and rectify gaps in areas like experience, domain knowledge, planning, understanding requirements, documentation, and testing. This reflective process, is not merely procedural but a critical learning opportunity aimed at enhancing overall quality. When embraced fully, it leads to continuous improvement, evidenced by fewer bugs, earlier detection, and better alignment with the appropriate testing phases.

This approach is most effective when integrated with comprehensive retrospectives, shifting the perspective from a routine task to a vital component of quality assurance and team development


FSA Expectations on Developers/Teams

Accurate completion of fields in Jira Bugs/TRs is crucial for identifying trends and formulating improvement actions. Recent Fault Slip Through Analysis (FSA) indicates a need for clarity in team responsibilities and the distinction between Corrective and Preventive actions. Below are further details on Preventive action:

  • The developer who answers the JIRA should be filling in the Fault Slipthrough Analysis
  • Fill in the relevant fields. See descriptions of the fields below.
  • Discuss (if needed) with other team members what the preventive action should be if unsure. Don't just put the first thing that occurs to you. Take time to ensure you understand the main reason for the fault and the reason for slipthrough and ensure we have good preventive action as this is the key learning from the activity.
  • Examine the fault from both CPS test perspective. Why did the fault slip through our design process and why did the verification activities not catch the faults. Both areas are important to consider. (CPS & EIC)
  • The preventive action should ideally be included in the team improvement plan if appropriate. if an action in that plan already covers the improvement, just refer to that improvement.
  • Review the FSA fields with relevant team members and PO. The review should cover all the relevant fault slip through fields in the Jira. 
  • If an improvement is identified, Create the improvement JIRA and label them as per guidelines so it will appear on Dashboards/Confluence tracking FSA improvements here. Reference this improvement Jira in the bug preventive action field.
  • The developer/Team should indicate Team review of FSA has been completed and request/inform PO/Tech Lead the FSA is ready for review by labelling the Jira as per guidelines



It is recommended to hold a proper meeting and the team can take ownership to approve any improvement/suggestion proposed in preventive action.