refactor(autoware_tensorrt_common): multi-TensorRT compatibility & tensorrt_common as unified lib for all perception components

[amadeuszsz]

Description

Incoming TensorRT upgrade requires refactor within perception components. The new version of autoware_tensorrt_common library will stand as high-level TensorRT API. PR considers compatibility with current environment (TensorRT 8.6) and future upgrade (TensorRT 10.7+).

This PR should be merged before TensorRT upgrade.

Related links

Parent Issue:

• CUDA, TensorRT, CUDNN upgrade autoware#5607

How was this PR tested?

A. Current environment (without dependencies upgrade).
B. New environment (with dependencies upgrade).

• If rosdistro PR not merged (see parent issue for more information), clone tensorrt_cmake_module into e.g. src/universe/external.

git clone https://github.com/tier4/tensorrt_cmake_module.git src/universe/external/tensorrt_cmake_module

• Checkout for Autoware environment upgrade branch.

git fetch origin pull/5608/head:feat/cuda-trt-upgrade
git switch feat/cuda-trt-upgrade

• Remove these lines to make sure build script will not change PR branch.
• Build docker locally.

./docker/build.sh --devel-only

• Test this PR in docker.

C. Perception evaluator TIER IV internal link

Notes for reviewers

• Implicit quantization Is deprecated and will be no longer supported in future. Here, this feature was delegated to another class definition which inherits base class of TrtCommon. Documentation says, They may not give the optimal performance and accuracy. As a workaround, use INT8 explicit quantization instead, therefore we might need to consider explicit quantization (during model deployment).
• You can test this PR in current environment. However, I encourage to test it also with upgraded libraries.
• Due to API changes, we can't split this PR.

Interface changes

None.

Effects on system behavior

None.

[github-actions]

Thank you for contributing to the Autoware project!

🚧 If your pull request is in progress, switch it to draft mode.

Please ensure:

• You've checked our contribution guidelines.
• Your PR follows our pull request guidelines.
• All required CI checks pass before marking the PR ready for review.

[codecov]

Codecov Report

Attention: Patch coverage is 0% with 692 lines in your changes missing coverage. Please review.

Project coverage is 29.32%. Comparing base (4dc7201) to head (949119e).
Report is 5 commits behind head on main.

Files with missing lines	Patch %	Lines
...n/autoware_tensorrt_common/src/tensorrt_common.cpp	0.00%	244 Missing ⚠️
...ion/autoware_tensorrt_yolox/src/tensorrt_yolox.cpp	0.00%	72 Missing ⚠️
...e/autoware/tensorrt_common/tensorrt_conv_calib.hpp	0.00%	67 Missing ⚠️
..._common/include/autoware/tensorrt_common/utils.hpp	0.00%	66 Missing ⚠️
...rception/autoware_tensorrt_common/src/profiler.cpp	0.00%	46 Missing ⚠️
...autoware_lidar_centerpoint/lib/centerpoint_trt.cpp	0.00%	41 Missing ⚠️
...autoware_lidar_transfusion/lib/transfusion_trt.cpp	0.00%	39 Missing ⚠️
...re_tensorrt_classifier/src/tensorrt_classifier.cpp	0.00%	37 Missing ⚠️
..._shape_estimation/lib/tensorrt_shape_estimator.cpp	0.00%	19 Missing ⚠️
...common/include/autoware/tensorrt_common/logger.hpp	0.00%	15 Missing ⚠️
... and 13 more

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #9762      +/-   ##
==========================================
- Coverage   29.41%   29.32%   -0.09%     
==========================================
  Files        1446     1453       +7     
  Lines      108365   108551     +186     
  Branches    42232    42262      +30     
==========================================
- Hits        31872    31832      -40     
- Misses      73408    73635     +227     
+ Partials     3085     3084       -1     

Flag	Coverage Δ		*Carryforward flag
differential	7.25% <ø> (?)
differential-cuda	6.24% <0.00%> (?)
total	29.51% <ø> (+0.10%)	⬆️	Carriedforward from 0b73c13

*This pull request uses carry forward flags. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[knzo25]

LGTM !
(confirmed via logging simulator centerpoint / transfusion)

[ktro2828]

@amadeuszsz Thank you for your PR. I left some minor suggestions in autoware_tensorrt_common.

[ktro2828]

LGTM

[MasatoSaeki]

LGTM