Difficulties with compiling with CUDA: SofaCUDA Dockerfile/Docker Image?

[NMontanaBrown]

Hi team,

I am working with SOFA (thanks for all your efforts thus far!) but my simulations would really benefit from speedup (and thus SOFACUDA). I have tried several times (over a few weeks) to compile from source with the plugin locally, but have not succeeded.

I was wondering if it would be possible to provide a Docker Image or Dockerfile for a build with SOFACUDA? It seems there are a few comments/discussions about difficulties with this particular build - this might be a welcome addition to the community.

If I'm missing something about the current docker images, I would gladly appreciate pointers there!

[alxbilger]

Hi,

I don't think anyone worked with SofaCUDA in a Docker environment (@hugtalbot ?).
But you could give us some details on the problems you encountered with SofaCUDA.

I know that for example CUDA 12 is not yet supported, but CUDA 11 works.

I also would like to mention this page since you are interested in performances.

Alex

[hugtalbot]

Correct @alxbilger

[NMontanaBrown]

Thanks for your prompt reply. At the minute, I am trying to compile locally a version of 22.06 (pulled from the repo), with CUDA 11.7 (deprecated from 12 which as you had mentioned was not possible), but compilation fails at the last step with the following error:

[100%] Linking CXX shared library ../../../lib/libSofaCUDA.so /usr/bin/ld: CMakeFiles/SofaCUDA.dir/sofa/gpu/cuda/CudaHexahedronFEMForceField.cpp.o: in function sofa::component::solidmechanics::fem::elastic::HexahedronFEMForceField<sofa::gpu::cuda::CudaVectorTypes<sofa::type::Vec<3u, float>, sofa::type::Vec<3u, float>, float> >::HexahedronFEMForceField()':
CudaHexahedronFEMForceField.cpp:(.text._ZN4sofa9component14solidmechanics3fem7elastic23HexahedronFEMForceFieldINS_3gpu4cuda15CudaVectorTypesINS_4type3VecILj3EfEESA_fEEEC1Ev[_ZN4sofa9component14solidmechanics3fem7elastic23HexahedronFEMForceFieldINS_3gpu4cuda15CudaVectorTypesINS_4type3VecILj3EfEESA_fEEEC1Ev]+0x264): undefined reference to sofa::core::behavior::ForceField<sofa::gpu::cuda::CudaVectorTypes<sofa::type::Vec<3u, float>, sofa::type::Vec<3u, float>, float> >::ForceField(sofa::core::behavior::MechanicalState<sofa::gpu::cuda::CudaVectorTypes<sofa::type::Vec<3u, float>, sofa::type::Vec<3u, float>, float> >*)' /usr/bin/ld: CMakeFiles/SofaCUDA.dir/sofa/gpu/cuda/CudaHexahedronFEMForceField.cpp.o: in function sofa::component::solidmechanics::fem::elastic::HexahedronFEMForceField<sofa::gpu::cuda::CudaVectorTypes<sofa::gpu::cuda::Vec3r1, sofa::gpu::cuda::Vec3r1, float> >::HexahedronFEMForceField()':
CudaHexahedronFEMForceField.cpp:(.text._ZN4sofa9component14solidmechanics3fem7elastic23HexahedronFEMForceFieldINS_3gpu4cuda15CudaVectorTypesINS6_6Vec3r1IfEES9_fEEEC1Ev[_ZN4sofa9component14solidmechanics3fem7elastic23HexahedronFEMForceFieldINS_3gpu4cuda15CudaVectorTypesINS6_6Vec3r1IfEES9_fEEEC1Ev]+0x264): undefined reference to sofa::core::behavior::ForceField<sofa::gpu::cuda::CudaVectorTypes<sofa::gpu::cuda::Vec3r1<float>, sofa::gpu::cuda::Vec3r1<float>, float> >::ForceField(sofa::core::behavior::MechanicalState<sof [results.txt](https://github.com/sofa-framework/sofa/files/11284203/results.txt) a::gpu::cuda::CudaVectorTypes<sofa::gpu::cuda::Vec3r1<float>, sofa::gpu::cuda::Vec3r1<float>, float> >*)' /usr/bin/ld: CMakeFiles/SofaCUDA.dir/sofa/gpu/cuda/CudaTriangularFEMForceFieldOptim.cpp.o: in function sofa::component::solidmechanics::fem::elastic::TriangularFEMForceFieldOptim<sofa::gpu::cuda::CudaVectorTypes<sofa::type::Vec<3u, float>, sofa::type::Vec<3u, float>, float> >::TriangularFEMForceFieldOptim()':
CudaTriangularFEMForceFieldOptim.cpp:(.text._ZN4sofa9component14solidmechanics3fem7elastic28TriangularFEMForceFieldOptimINS_3gpu4cuda15CudaVectorTypesINS_4type3VecILj3EfEESA_fEEEC2Ev[_ZN4sofa9component14solidmechanics3fem7elastic28TriangularFEMForceFieldOptimINS_3gpu4cuda15CudaVectorTypesINS_4type3VecILj3EfEESA_fEEEC2Ev]+0x45): undefined reference to sofa::core::behavior::ForceField<sofa::gpu::cuda::CudaVectorTypes<sofa::type::Vec<3u, float>, sofa::type::Vec<3u, float>, float> >::ForceField(sofa::core::behavior::MechanicalState<sofa::gpu::cuda::CudaVectorTypes<sofa::type::Vec<3u, float>, sofa::type::Vec<3u, float>, float> >*)' /usr/bin/ld: CMakeFiles/SofaCUDA.dir/sofa/gpu/cuda/CudaTriangularFEMForceFieldOptim.cpp.o: in function sofa::component::solidmechanics::fem::elastic::TriangularFEMForceFieldOptim<sofa::gpu::cuda::CudaVectorTypes<sofa::type::Vec<3u, float>, sofa::type::Vec<3u, float>, float> >::TriangularFEMForceFieldOptim()':
CudaTriangularFEMForceFieldOptim.cpp:(.text._ZN4sofa9component14solidmechanics3fem7elastic28TriangularFEMForceFieldOptimINS_3gpu4cuda15CudaVectorTypesINS_4type3VecILj3EfEESA_fEEEC1Ev[_ZN4sofa9component14solidmechanics3fem7elastic28TriangularFEMForceFieldOptimINS_3gpu4cuda15CudaVectorTypesINS_4type3VecILj3EfEESA_fEEEC1Ev]+0x26a): undefined reference to sofa::core::behavior::ForceField<sofa::gpu::cuda::CudaVectorTypes<sofa::type::Vec<3u, float>, sofa::type::Vec<3u, float>, float> >::ForceField(sofa::core::behavior::MechanicalState<sofa::gpu::cuda::CudaVectorTypes<sofa::type::Vec<3u, float>, sofa::type::Vec<3u, float>, float> >*)' collect2: error: ld returned 1 exit status make[2]: *** [applications/plugins/SofaCUDA/CMakeFiles/SofaCUDA.dir/build.make:1255: lib/libSofaCUDA.so.0.1] Error 1 make[1]: *** [CMakeFiles/Makefile2:17590: applications/plugins/SofaCUDA/CMakeFiles/SofaCUDA.dir/all] Error 2 make: *** [Makefile:136: all] Error 2

Find error log attached. Any obvious pointers?

[NMontanaBrown]

For testing purposes, I tried to compile 22.12 with the same CUDA, and compilation also fails at a similar stage (error log also attached).
results_2212.txt

[NMontanaBrown]

Also, to clarify, on Ubuntu 22.04 LTS - saw some earlier comments about using CUDA 11.6 but this is unavailable for this release. Trying with 11.8 now.

[alxbilger]

It will be hard to fix your compilation problem as I don't have it. But I tried in this branch: https://github.com/alxbilger/sofa/tree/cudaforcefield. Could you try to compile this branch and see if it works?

[NMontanaBrown]

Hi, thanks for your reply - let me test this over the weekend and let you know ASAP

[hugtalbot]

any udpate @NMontanaBrown ?

[hugtalbot]

We need a feedback from you @NMontanaBrown to merge or close the associated PR.
Let us know if you need more time to test it. Else, we would close it by next week.

Thanks for reporting your problem anyway.

[NMontanaBrown]

This builds for me and I can run the runSofa demo now!

[hugtalbot]

good news, thanks @NMontanaBrown 👍 @alxbilger