mirrors/gstreamer
mirrors/gstreamer
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gstreamer.git synced 2024-11-27 12:11:13 +00:00
Code Issues 1 Projects Releases Wiki Activity
gstreamer/subprojects/gst-plugins-bad/ext/onnx
History
Olivier Crête b1ac114ca5 onnxinference: Return caps based on model preference when possible 
This should enable zero-copy when the model has the right type

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/5885>
2024-01-13 22:29:41 +00:00
..
decoders onnx: Fix leak in ssdobjectdetector decoder 2024-01-04 19:11:20 +00:00
tensor onnx: Remove unnecessary tensorid class 2023-10-20 00:33:29 +00:00
gstml.h onnx: add gstonnxinference element 2023-10-20 00:33:29 +00:00
gstonnx.c onnx: add gstonnxinference element 2023-10-20 00:33:29 +00:00
gstonnxclient.cpp onnxinference: Return caps based on model preference when possible 2024-01-13 22:29:41 +00:00
gstonnxclient.h onnxinference: Return caps based on model preference when possible 2024-01-13 22:29:41 +00:00
gstonnxinference.cpp onnxinference: Return caps based on model preference when possible 2024-01-13 22:29:41 +00:00
gstonnxinference.h onnx: Remove enums file 2023-10-20 00:33:29 +00:00
meson.build onnx: replace video-region-of-interest with analytics-meta 2023-12-06 18:25:16 +00:00
README.md onnx: Update build instructions to use onnx-runtime 0.16.3 2023-12-22 14:43:23 -05:00

README.md

ONNX Build Instructions

Build

  1. do a recursive checkout of onnxruntime tag 1.16.3
  2. $SRC_DIR and $BUILD_DIR are local source and build directories
  3. To run with CUDA, both CUDA and cuDNN libraries must be installed.
$ cd $SRC_DIR
$ git clone --recursive https://github.com/microsoft/onnxruntime.git && cd onnxruntime && git checkout -b v1.16.3 refs/tags/v1.16.3
$ mkdir $BUILD_DIR/onnxruntime && cd $BUILD_DIR/onnxruntime
  1. CPU
$ cmake -Donnxruntime_BUILD_SHARED_LIB=ON -DBUILD_TESTING=OFF -Donnxruntime_BUILD_UNIT_TESTS=OFF $SRC_DIR/onnxruntime/cmake && make -j$(nproc) && sudo make install
  1. CUDA
cmake -Donnxruntime_BUILD_SHARED_LIB=ON -DBUILD_TESTING=OFF -Donnxruntime_BUILD_UNIT_TESTS=OFF -Donnxruntime_USE_CUDA=ON -Donnxruntime_CUDA_HOME=/usr/local/cuda -Donnxruntime_CUDNN_HOME=/usr/local/cuda -DCMAKE_CUDA_ARCHITECTURES=native -DCMAKE_CUDA_COMPILER=/usr/local/cuda/bin/nvcc $SRC_DIR/onnxruntime/cmake && make -j$(nproc) && sudo make install
  1. Intel oneDNN

3.0 install intel oneDNN

3.1 clone, build and install Khronos OpenCL SDK. Build dependencies for Fedora are

sudo dnf install libudev-devel libXrandr-devel mesa-libGLU-devel mesa-libGL-devel libX11-devel intel-opencl

3.2 build and install onnxruntime :

cmake -Donnxruntime_BUILD_SHARED_LIB=ON -DBUILD_TESTING=OFF -Donnxruntime_BUILD_UNIT_TESTS=OFF -Donnxruntime_USE_DNNL=ON -Donnxruntime_DNNL_GPU_RUNTIME=ocl -Donnxruntime_DNNL_OPENCL_ROOT=$SRC_DIR/OpenCL-SDK/install  $SRC_DIR/onnxruntime/cmake && make -j$(nproc) && sudo make install