Issues

• Tensorrt fp32 to int8 convertion error on model that has 2 inputs

  rmccorm4/tensorrt-utils#41 · Filter by author FatihcanUslu opened on Aug 10, 2023

• Cifar100 calibrator

  rmccorm4/tensorrt-utils#40 · Filter by author woonwoon opened on Apr 20, 2023

• onnx to trt,choose int8 mode

  rmccorm4/tensorrt-utils#39 · Filter by author shibangfan opened on Nov 22, 2022

• Output of inference with an engine converted using "onnx_to_tensorrt.py"

  rmccorm4/tensorrt-utils#38 · Filter by author teltim opened on Oct 28, 2022

• Attribute error _enter_ when running int8 compilation

  rmccorm4/tensorrt-utils#37 · Filter by author harishprabhala opened on May 31, 2022
  2

• Is the inference for int8 the same as for fp16?

  rmccorm4/tensorrt-utils#36 · Filter by author WEIZHIHONG720 opened on Mar 30, 2022

• Vague error.

  rmccorm4/tensorrt-utils#35 · Filter by author Abdelrahman350 opened on Mar 21, 2022

• The indentation maybe excessive

  rmccorm4/tensorrt-utils#34 · Filter by author leejihong01 opened on Nov 26, 2021

• How to save the calibration.bin files?

  rmccorm4/tensorrt-utils#33 · Filter by author xingyueye opened on Nov 20, 2021

• how build engine with dynamic shape to exectue INT8 calibration

  rmccorm4/tensorrt-utils#32 · Filter by author cqray1990 opened on Oct 19, 2021

• converting scaled yolov4-scp from onnx to tensorrt

  rmccorm4/tensorrt-utils#31 · Filter by author VladBlat opened on Aug 3, 2021

• How to do inference with the saved int8 trt engine file?

  rmccorm4/tensorrt-utils#30 · Filter by author xiongjun19 opened on Jul 14, 2021

• int8 calibration for batch > 1

  rmccorm4/tensorrt-utils#29 · Filter by author maidmentdaniel opened on Apr 12, 2021
  3

• Some questions about int8 quat

  rmccorm4/tensorrt-utils#27 · Filter by author leiwen83 opened on Dec 17, 2020
  1

• int8 engine for **DETECTOR models(onnx)

  rmccorm4/tensorrt-utils#25 · Filter by author Abrahamma97 opened on Sep 10, 2020

• WARNING: Missing dynamic range for tensor 1316, expect fall back to non-int8 implementation for any layer consuming or producing given tensor

  rmccorm4/tensorrt-utils#24 · Filter by author duohaoxue opened on Aug 10, 2020
  1

• infer_tensorrt_imagenet.py: Not Predicting The Correct Classes

  rmccorm4/tensorrt-utils#22 · Filter by author Hassan313 opened on Jul 12, 2020
  1

• Generating int8 Calibration File for ResNet-18 Caffe Model

  rmccorm4/tensorrt-utils#18 · Filter by author Hassan313 opened on Jun 27, 2020
  16

• Add ONNX checker by default, and maybe onnx-simplifier as option?

  enhancementgood first issue
  rmccorm4/tensorrt-utils#15 · Filter by author rmccorm4 opened on Apr 3, 2020

• Add TRTIS dynamic shape engine example/doc

  enhancementgood first issue
  rmccorm4/tensorrt-utils#14 · Filter by author rmccorm4 opened on Apr 3, 2020

• Add tool to iterate through TRT versions with/without OSS to parse models

  enhancement
  rmccorm4/tensorrt-utils#13 · Filter by author rmccorm4 opened on Apr 3, 2020

• Add an ONNX model with dynamic shape for the example

  enhancementgood first issue
  rmccorm4/tensorrt-utils#12 · Filter by author rmccorm4 opened on Apr 3, 2020
  1

• Change default opt profile behavior to be more like implicit batch

  enhancementgood first issue
  rmccorm4/tensorrt-utils#11 · Filter by author rmccorm4 opened on Apr 3, 2020

• End-to-end simple plugin example

  enhancement
  rmccorm4/tensorrt-utils#8 · Filter by author rmccorm4 opened on Mar 11, 2020

• Script to validate converting Fixed -> Dynamic shape ONNX model

  enhancement
  rmccorm4/tensorrt-utils#7 · Filter by author rmccorm4 opened on Mar 11, 2020