This is the repository of hbLab-B01 Contact Assistant, a cutting-edge web application designed to streamline your communications with any company's customer service. Leveraging voice recognition and speedy data fetching, B01 breaks the traditional barriers of customer interaction, delivering near-instantaneous connections.
hbLab-B01 is your go-to VoAI Customer Service Assistant, designed to make interactions with customer service smooth and efficient. It's powered with fast-processing voice recognition to handle requests. Whether speaking up or typing down, hbLab-B01 quickly retrieves the necessary information from the database and, with user's nod, can even make phone calls. All this happens in a blink.
The Enhanced VoAI in our application allows users to initiate searches and make calls simultaneously using just their voice. This feature reduces the need for typing, enhances accessibility, and supports efficient multitasking.
- **Advanced AI-driven Voice Recognition Integration The B01 model has been engineered with cutting-edge neural network training, enabling it to detect and process synonyms with high precision and execute seamless, real-time connections. This innovation allows users to simultaneously activate contextual searches and initiate call actions via voice commands. By leveraging advanced Natural Language Understanding (NLU) and intent prediction, this dual-functionality minimizes manual input while optimizing multitasking efficiency. The system's AI-first architecture ensures adaptive learning for continuously improving user interactions.
We use a speech-to-text API to convert spoken words into text. This can be integrated using services like IBM Watson Speech to Text, which provide robust speech recognition capabilities.
After converting speech to text, the system employs Natural Language Processing (NLP) techniques to parse the text and determine the user's intent, categorizing it as either a search query or a call request.
- Search Functionality: For search queries, the parsed command is used to retrieve information from the database or perform web searches, depending on the context specified by the user.
- Call Functionality: For call commands, the assistant identifies the contact name or number from the user's voice input and initiates a call using the device's calling capabilities or through an integrated VoIP service.
To use the Voice AI Assistant, simply activate it using a predefined hotword followed by your command:
- Say e.g. "Amazon" to initiate the call to the customer service department.
- Say e.g. "Apple" to initiate the call or text box to the customer service department.
This hands-free operation allows users to perform tasks on the go, making our application more user-friendly and efficient.
-
Python: Utilized for backend machine learning operations, enhancing the intelligent processing capabilities of our application.
-
JavaScript: Powers the core functionalities, including voice recognition and data fetching.
-
JAX: For high-performance numerical and scientific computation. Used primarily in the backend for accelerating machine learning models and simulations.
-
Netlify Identity Widget: For user authentication and secure access.
-
Fuse.js: Implements fuzzy search capabilities to enhance the search functionality.
-
Express.js: A fast, unopinionated, minimalist web framework for Node.js, used to build the backend API.
-
PostgreSQL: A powerful, open source object-relational database system used to manage our application's data.
-
Bleu.js: A versatile framework for decision trees, NLP, advanced debugging, code generation, multi-language support, and real-time optimization, streamlining development with unified dependency management and collaboration tools.
-
CORS (Cross-Origin Resource Sharing): Configured to allow our web applications hosted at different origins to interact securely.
-
Winston: A versatile logging library for Node.js, used for managing logs with support for multiple storage options.
-
Dotenv: Loads environment variables from a
.envfile intoprocess.env, supporting external configuration of the application's settings. -
Axios: Promise-based HTTP client for making requests to external APIs.
-
CSV-Parser: A library for parsing CSV files, utilized to manage and test data imports from company records.
> helloblue-ai@1.0.4 test
Advanced Voice Recognition Tests
Utility Functions
✓ should correctly process voice input and update the UI (4 ms)
✓ should handle recognition errors gracefully (1 ms)
✓ should cache results and reuse them (1 ms)
✓ should not fetch data for low-confidence input (1 ms)
Advanced Scenarios
✓ Simultaneous chaining with different instances (1 ms)
Performance and Memory Tests
✓ should handle extremely large numbers without crashing
✓ should maintain memory integrity during high usage (5 ms)
Property-Based Testing
✓ result should match a derived formula
✓ result should be zero after adding and subtracting the same value
✓ result should handle a series of random operations
Edge Cases
✓ should handle adding zero
✓ should handle subtracting zero (1 ms)
✓ should handle recognition errors gracefully (1 ms)
✓ should handle adding and subtracting large numbers
✓ should handle adding and subtracting negative numbers
----------|---------|----------|---------|---------|-------------------
File | % Stmts | % Branch | % Funcs | % Lines | Uncovered Line #s
----------|---------|----------|---------|---------|-------------------
All files | 100 | 100 | 100 | 100 |
index.js | 100 | 100 | 100 | 100 |
----------|---------|----------|---------|---------|-------------------
Test Suites: 1 passed, 1 total
Tests: 28 passed, 28 total
Snapshots: 0 total
Time: 0.22 s, estimated 1 s
Ran all test suites.- Express Server: This repository contains the Express server setup essential for the operation of the hbLab-B01 Contact Assistant. Check it out here
We welcome pull requests, bug reports, and other contributions. Please read the CONTRIBUTING
Please read the SECURITY
hbLab-B01 is licensed under the Apache License Version 2.0. See the LICENSE file for more details.
