Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update ml-kit integration #37

Merged

Conversation

GaborAbonyi
Copy link
Contributor

Update ml-kit integration

Description

Use ML Embedded Evaluation kit as a collection of libraries, instead of building it as an external project.
Update ML-kit version to 23.11

Test Steps

Compiled and run the available examples with GCC and Armclang for Corstone-300 and 310.

Checklist:

  • I have tested my changes. No regression in existing tests.
  • [] I have modified and/or added unit-tests to cover the code changes in this Pull Request.

Related Issue

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@GaborAbonyi GaborAbonyi requested a review from a team as a code owner January 30, 2024 11:08
@paulbartell
Copy link

Hello @GaborAbonyi. Thanks for this update. Could you update the spelling dictionary at .github/.cSpellWords.txt to include "IRQN"? This should satisfy the spell checker.

@GaborAbonyi
Copy link
Contributor Author

I found some additional typos. Just rerunning some local tests to be sure. I'll push the update soon.

@GaborAbonyi GaborAbonyi force-pushed the dev/gabor.abonyi/new_mlkit_integration branch from 3e995cf to d056711 Compare January 31, 2024 10:21
@GaborAbonyi GaborAbonyi changed the title Update ml-kit integration Draft: Update ml-kit integration Jan 31, 2024
@GaborAbonyi GaborAbonyi force-pushed the dev/gabor.abonyi/new_mlkit_integration branch from d056711 to 9c4b378 Compare February 6, 2024 12:29
@GaborAbonyi GaborAbonyi changed the title Draft: Update ml-kit integration Update ml-kit integration Feb 6, 2024
This prevents the module from always being included
even when building applications that do not require it.

Signed-off-by: Gabor Abonyi <[email protected]>
Use the -additional-ethos-u-config-name option to generate
required NPU optimization instead of patching default list.

Signed-off-by: Gabor Abonyi <[email protected]>
Instead of building the whole project as an external project,
only build the necessary libraries.

Rename BuildMLEmbeddedEvaluationKit.cmake to
SetupMlEmbeddedEvaluationKitLibraries.cmake

This change also uses the NPU driver component from
ML Evaluation Kit which results in the following changes:
* Modify initialization of NPU in AI applications to use
  API provided by the component
* Add ICache and DCache enablement options as caches are used
  in the NPU component
* Include various patches for the NPU component.
* Remove ML Evaluation Kit device drivers header files
  inclusions as they are no longer used as we are now using
  the NPU component for initializing the NPU.

Signed-off-by: Gabor Abonyi <[email protected]>
* Improved tensorflow.cmake
* Model URLs file location has changed
* Some patches have been merged upstream

Signed-off-by: Gabor Abonyi <[email protected]>
@GaborAbonyi GaborAbonyi force-pushed the dev/gabor.abonyi/new_mlkit_integration branch from 9c4b378 to 80e220f Compare February 6, 2024 14:52
@GaborAbonyi
Copy link
Contributor Author

Rebased to latest origin/main as another PR was merged. Now PR is finalized and ready.

@urutva urutva merged commit 90f467e into FreeRTOS:main Feb 6, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants