Discussions

• 1 You must be logged in to vote

  ❓

  Optimal inference

  catsandsoup32 asked Nov 8, 2024 in Web Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  Minimizing memory usage with ORT models using Ort::SessionOptions, RunOptions, Allocator, etc.

  sevagh asked Nov 7, 2024 in Performance Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  How to do Inference profiling of the model in C++ (Android)?

  martinkorelic asked Nov 6, 2024 in API Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  GroupQueryAttention strange behaviour depending on seq_len/total_seq_len

  ManelSemidynamics asked Nov 5, 2024 in API Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  ❓

  Runtime EP Error narrowing_error when using CPUExecutionProvider

  seebrain asked Nov 5, 2024 in EP Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  Onnxruntime Initialization Issue with silero-vad on Jetson

  wskurniawan asked Sep 6, 2024 in API Q&A · Closed · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  #️⃣

  Model decryption prior to loading

  vadimkantorov asked Oct 28, 2024 in General · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  Fine tuning embeddings with onnxruntime training: error creating artifacts

  riccardopinosio asked Oct 14, 2024 in Training Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ❓

  onnxruntime-gpu cannot use cuda libs that installed via pip?

  braindevices asked Oct 23, 2024 in Performance Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ❓

  try ctypes load onnxruntime.dll, CreateEnv get null return

  ssuurrffaaccee asked Oct 16, 2024 in API Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ❓

  Will anyone use YOLO11 on the web?

  platform:web issues related to ONNX Runtime web; typically submitted using template

  bbhxwl asked Oct 15, 2024 in API Q&A · Unanswered

  

  

  2
• 18 You must be logged in to vote

  #️⃣

  Flash attention

  pfeatherstone asked Nov 3, 2023 in General · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ❓

  how can I install 1.18 with cuda12?

  braindevices asked Oct 15, 2024 in Release Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  Accessing Hidden State Using C API

  vectorphresh asked Oct 12, 2024 in API Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  How can I bind torch tensor in GPU as input and output?

  braindevices asked Oct 15, 2024 in API Q&A · Closed · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ❓

  FileLoadException when using ONNX Runtime in C# project - Version mismatch issue

  DrDoof14 asked Oct 14, 2024 in API Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Onnxruntime crashes on some machines because ort::global<void>::api_ was nullptr

  LearnedLately asked Oct 11, 2024 in General · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  how to obtain python wheel package from the pre-build files?

  joey9503 asked Oct 11, 2024 in General · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Failed to allocate memory for requested buffer of size 234881024

  andyzheng-snps asked Sep 20, 2024 in General · Unanswered

  

  

  2
• 1 You must be logged in to vote

  #️⃣

  ONNX Runtime performance question

  vadimax asked Oct 7, 2024 in General · Unanswered

  

  

  0
• 2 You must be logged in to vote

  #️⃣

  Does ONNXRuntime support YOLOv11 .onnx files?

  vadimax asked Oct 3, 2024 in General · Answered

  

  

  6
• 1 You must be logged in to vote

  ❓

  onnxruntime is slower than torch for long sequence length

  wangml999 asked Oct 30, 2023 in Other Q&A · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  ❓

  Why my installed onnxruntime-gpu 19.2 requires libcudnn.so.9?

  JohnHerry asked Sep 18, 2024 in EP Q&A · Closed · Unanswered

  

  

  2
• 1 You must be logged in to vote

  ❓

  How to run onnx model with batch/sequence

  EmileVinsonneau asked Sep 24, 2024 in API Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  ❓

  Example code of run_async use for submitting outstanding inference requests

  hylandk-movidius asked Sep 18, 2024 in Performance Q&A · Unanswered

  

  

  0