I know that this question has been asked a lot, but none of the suggestions seem to work, probably since my setup is somewhat different: Ubuntu 22.04 python 3.10.8 tensorflow 2.11.0 cudatoolkit 11....

I have an inference code in TensorRT(with python). I want to run this code in ROS but I get the below error when trying to allocate buffer: LogicError: explicit_context_dependent failed: invalid d...

I was trying to install tensorRT 7.0 in ubuntu 18.4 (nv-tensorrt-repo-ubuntu1804-cuda10.2-trt7.0.0.11-ga-20191216_1-1_amd64.deb) debian. Followed the documentation https://docs.nvidia.com/deeplear...

I am trying to install tensorrt in conda env and I have the cudatoolkit and cudnn installed in my env through conda navigator. I have also updated my pip and setuptool but the get the below error w...

What I have: A trained recurrent neural network in Tensorflow. What I want: A mobile application that can run this network as fast as possible (inference mode only, no training). I believe ther...

Our current flow: Conversation of tf2->onnx->TensorRT (all16 and 32 and 8 bits options) Is there an existing tool like https://github.com/lutzroeder/netron (or any other way) to see the outpu...

I installed TensorRT on my VM using the Debian Installation. If I run "dpkg -l | grep TensorRT" I get the expected result: ii graphsurgeon-tf 5.0.2-1+cuda10.0 amd64 GraphSurgeon for TensorRT packa...

I used Nvidia's Transfer Learning Toolkit(TLT) to train and then used the tlt-converter to convert the .etlt model into an .engine file. I want to use this .engine file for inference in python. B...

I am trying to feed a very large image into Triton server. I need to divide the input image into patches and feed the patches one by one into a tensorflow model. The image has a variable size, so t...

I am trying to speed up the segmentation model(unet-mobilenet-512x512). I converted my tensorflow model to tensorRT with FP16 precision mode. And the speed is lower than I expected. Before the opti...

I am currently working with Darknet on Yolov4, with 1 class. I need to export those weights to onnx format, for tensorRT inference. I've tried multiple technics, using ultralytics to convert or goi...

I found that we can optimize the Tensorflow model in several ways. If I am mistaken, please tell me. 1- Using TF-TRT, This API developer by tensorflow and integreted TensoRT to Tensorflow an...

I am trying to deploy a trained U-Net with TensorRT. The model was trained using Keras (with Tensorflow as backend). The code is very similar to this one: https://github.com/zhixuhao/unet/blob/mast...

I just wanted to download TensorRT but I saw there are two different versions GA and RC. What is the differences between them and what version should I choose as I use a Windows 10 machine with Gef...

I have two GPUs. My program uses TensorRT and Tensorflow. When I run only TensorRT part, it is fine. When I run together with Tensorflow part, I have error as [TensorRT] ERROR: engine.cpp (370) -...

We have a Caffe model that contains: layer { name: "foo" type: "PriorBox" prior_box_param { # ERROR HERE # whatever } # etc } Now, following the code in sampleMNIST I try to import my mode...

I'm working with the new tf.data.Dataset API and I can't seem to figure out how to perform inference. Ultimately, I want to convert my model to a TensorRT graph and run it on the TX2, and all of th...

I would like to use NVIDIA TensorRT to run my Tensorflow models. Currenly, TensorRT supports Caffe prototxt network descriptor files. I was not able to find source code to convert Tensorflow model...