Skip to content
This repository has been archived by the owner on Jul 22, 2024. It is now read-only.

Test Plan & Results

Jump to bottom
Bartu Aslan edited this page Jun 4, 2024 · 12 revisions

1. INTRODUCTION

  1. Version Control
Version No Description of Changes Date
1.0 First Version May 28, 2024

1.2 Overview

The Sign Language to Speech project aims to develop a system that translates sign language gestures into spoken words using machine learning and computer vision techniques. This test plan outlines the testing strategy for verifying the functionalities of the system.

1.3 Scope

This document covers the test plan for the Sign Language to Speech system, including test design specifications and detailed test cases to ensure the system meets the specified requirements.

1.4 Terminology

Acronym Definition
GUI Graphical User Interface
ML Machine Learning
CV Computer Vision
ASL American Sign Language

2. FEATURES TO BE TESTED

  1. Graphical User Interface (GUI)

Graphical User Interface (The GUI components to be tested include:

  • Main Menu
  • Settings Panel
  • Training Mode Interface
  • Real-time Translation Interface
  1. Sign Language Detection

Testing the accuracy and responsiveness of the system in detecting and recognizing sign language gestures.

  1. Speech Synthesis

Testing the conversion of recognized sign language gestures into spoken words using text-to-speech (TTS) technology.

  1. Machine Learning Model

Testing the performance and accuracy of the machine learning model in recognizing different signs.

3. FEATURES NOT TO BE TESTED

  1. Third-Party Integrations:

If the system relies on third-party APIs or services, testing their functionality is often not within the scope of the project. This is because the third-party providers are responsible for ensuring the reliability and functionality of their services.

  1. Non-Essential or Secondary Features:

Features that are considered non-essential or secondary to the core functionality of the system may not be tested thoroughly. For example, if a sign language translation system has a feature for changing the color scheme of the user interface, testing this feature might not be a priority compared to testing the accuracy of gesture recognition.

  1. Performance under Extreme Conditions:

While it's important to test the system's performance under normal operating conditions, testing extreme scenarios that are unlikely to occur in real-world usage may not be necessary. For instance, testing the system's response time when thousands of users simultaneously access it might not be practical unless it's a critical requirement.

  1. Compatibility with Outdated Software/Hardware:

Ensuring compatibility with outdated software or hardware versions may not be feasible or necessary, especially if they are no longer supported by the manufacturer or used by a small portion of the target audience.

  1. Security Features:

Security features, such as encryption protocols or firewall configurations, may be tested separately by security experts to ensure the system's resilience against cyber threats. However, detailed testing of these features may not be included in the standard testing plan.

  1. User Training and Documentation:

While user training and documentation are essential for the system's successful deployment, testing the effectiveness of training materials or user guides may fall outside the scope of the testing plan.

  1. Legal Compliance:

Ensuring legal compliance with regulations such as GDPR or HIPAA may require specialized audits or assessments that go beyond the scope of traditional software testing.

4. ITEM PASS/FAIL CRITERIA

4.1 Exit Criteria

  • 100% of the test cases are executed
  • 99% of the test cases passed
  • All High and Medium Priority test cases passed

6. TEST DESIGN SPECIFICATIONS

  1. Graphical User Interface (GUI)

6.1.1 Subfeatures to be tested

1. Main Menu (GUI.MAIN_MENU)

Verify that the main menu displays correctly and allows navigation to other parts of the application.

2. Settings Panel (GUI.SETTINGS)

Verify that the settings panel allows the user to adjust preferences such as volume and display settings.

  1. Real-time Translation Interface (GUI.REALTIME)

Verify that the real-time translation interface displays detected signs and converts them to speech correctly.

2. Sign Language Detection

6.2.1 Subfeatures to be tested

1. Hand Gesture Recognition (SLD.HGR)

Verify that the system accurately recognizes various hand gestures used in ASL.

2. Real-time Detection (SLD.RTD)

Verify that the system detects hand gestures in real-time without significant lag.

3. Speech Synthesis (SS)

6.3.1 Subfeatures to be tested

6.3.1.1 Text-to-Speech Conversion (SS.TTS)

Verify that the system correctly converts recognized gestures to spoken words using TTS.

  1. Machine Learning Model
  2. Subfeatures to be tested
  3. Model Accuracy (MLM.ACC)

Verify that the machine learning model achieves the target accuracy for gesture recognition.

2. Model Performance (MLM.PERF)

Verify that the model performs efficiently without causing significant delays in recognition.

2. Test Cases

TC ID Requirements Priority Scenario Description
GUI.MAIN _MENU.01 3.1 H Verify that the main menu displays correctly and allows navigation to other parts of the application.
GUI.SETTI NGS.01 3.2 H Verify that the settings panel allows the user to adjust preferences such as volume and display settings.
SLD.HGR. 01 4.1 H Verify that the system accurately recognizes various hand gestures used in ASL.
SLD.RTD. 01 4.2 H Verify that the system detects hand gestures in real-time without significant lag.
SS.TTS.01 5.1 H Verify that the system correctly converts recognized gestures to spoken words using TTS.
MLM.ACC .01 6.1 H Verify that the machine learning model achieves the target accuracy for gesture recognition.
MLM.PER F.01 6.2 H Verify that the model performs efficiently without causing significant delays in recognition.

7. Detailed Test Cases

7.1 Graphical User Interface (GUI)

7.1.1 Main Menu (GUI.MAIN_MENU)

TC_ID: GUI.MAIN_MENU.01

Purpose: Verify that the main menu displays correctly and allows navigation to other parts of the application. Requirements: 3.1

Priority: High

Estimated Time Needed: 10 minutes

Dependency: N/A

Setup: Application should be installed and running.

Procedure:

  1. [A01] Launch the application.
  2. [A02] Verify that the main menu is displayed.
  3. [A03] Click on each menu item (e.g., Settings, Training Mode, Real-time Translation) and verify that the corresponding interface loads correctly.
  4. [V01] Ensure the navigation to each interface works without errors.

Cleanup: Close the application.

7.1.2 Settings Panel (GUI.SETTINGS)

TC_ID: GUI.SETTINGS.01

Purpose: Verify that the settings panel allows the user to adjust preferences such as volume and display settings. Requirements: 3.2

Priority: High

Estimated Time Needed: 5 minutes

Dependency: GUI.MAIN_MENU.01 must pass

Setup: Navigate to the settings panel from the main menu.

Procedure:

  1. [A01] Open the settings panel from the main menu.
  2. [A02] Adjust the volume settings.
  3. [A03] Change the display settings (e.g., theme, font size).
  4. [V01] Ensure the changes are applied and saved correctly.

Cleanup: Reset settings to default if necessary.

7.2 Sign Language Detection (SLD)

7.2.1 Hand Gesture Recognition (SLD.HGR)

TC_ID: SLD.HGR.01

Purpose: Verify that the system accurately recognizes various hand gestures used in ASL. Requirements: 4.1

Priority: High

Estimated Time Needed: 15 minutes

Dependency: N/A

Setup: Application should be installed and running, with the camera enabled.

Procedure:

  1. [A01] Launch the application and navigate to the real-time translation interface.
  2. [A02] Perform a series of predefined ASL gestures in front of the camera.
  3. [V01] Verify that each gesture is correctly recognized and displayed on the screen.

Cleanup: Turn off the camera and close the application.

7.2.2 Real-time Detection (SLD.RTD)

TC_ID: SLD.RTD.01

Purpose: Verify that the system detects hand gestures in real-time without significant lag. Requirements: 4.2

Priority: High

Estimated Time Needed: 10 minutes

Dependency: SLD.HGR.01 must pass

Setup: Application should be installed and running, with the camera enabled. Procedure:

  1. [A01] Launch the application and navigate to the real-time translation interface.
  2. [A02] Perform a continuous sequence of ASL gestures.
  3. [V01] Verify that each gesture is detected and translated to text/speech in real-time with minimal lag.

Cleanup: Turn off the camera and close the application.

7.3 Speech Synthesis (SS)

7.3.1 Text-to-Speech Conversion (SS.TTS)

TC_ID: SS.TTS.01

Purpose: Verify that the system correctly converts recognized gestures to spoken words using TTS. Requirements: 5.1

Priority: High

Estimated Time Needed: 10 minutes

Dependency: SLD.HGR.01 and SLD.RTD.01 must pass

Setup: Application should be installed and running, with the camera enabled.

Procedure:

  1. [A01] Launch the application and navigate to the real-time translation interface.
  2. [A02] Perform a predefined ASL gesture in front of the camera.
  3. [V01] Verify that the gesture is correctly recognized and converted to spoken words using TTS.

Cleanup: Close the application.

7.4 Machine Learning Model (MLM)

7.4.1 Model Accuracy (MLM.ACC)

TC_ID: MLM.ACC.01

Purpose: Verify that the machine learning model achieves the target accuracy for gesture recognition. Requirements: 6.1

Priority: High

Estimated Time Needed: 20 minutes

Dependency: N/A

Setup: Application should be installed and running, with the camera enabled.

Procedure:

  1. [A01] Launch the application and navigate to the real-time translation interface.
  2. [A02] Perform a series of predefined ASL gestures.
  3. [V01] Compare the recognition results against a predefined accuracy benchmark.

Cleanup: Close the application.

7.4.2 Model Performance (MLM.PERF)

TC_ID: MLM.PERF.01

Purpose: Verify that the model performs efficiently without causing significant delays in recognition. Requirements: 6.2

Priority: High

Estimated Time Needed: 15 minutes

Dependency: MLM.ACC.01 must pass

Setup: Application should be installed and running, with the camera enabled.

Procedure:

  1. [A01] Launch the application and navigate to the real-time translation interface.
  2. [A02] Perform a series of rapid ASL gestures.
  3. [V01] Verify that the recognition is performed efficiently and in a timely manner without causing significant delays.

Cleanup: Close the application.

8. Test Results

TC_ID Result Priority Explanation
GUI.MAIN_MENU.01 Pass High Main menu displayed correctly; navigation functional.
GUI.SETTINGS.01 Pass High Settings panel allowed adjustment of preferences.
SLD.HGR.01 Pass High Accurately recognized various hand gestures.
SLD.RTD.01 Pass High Real-time detection without significant lag.
SS.TTS.01 Pass High Converted recognized gestures to spoken words.
MLM.ACC.01 Pass High Machine learning model achieved target accuracy.
MLM.PERF.01 Pass High Model performed efficiently without delays.

9. REFERENCES

  1. CENG_408_Group20_SRS, December 26, 2023. Available: https://github.com/CankayaUniversity/ceng-407-408-2023-2024- SignLang2Utterance/wiki/Software-Requirement-Specification
  2. CENG_408_Group20_SDD, January 7, 2024. Available: https://github.com/CankayaUniversity/ceng-407-408-2023-2024-SignLang2Utterance/wiki/SDD
Clone this wiki locally