I recently went through this tutorial. I have the trained model from the tutorial and I want to serve it with docker so I can send an arbitrary string of characters to it and get the prediction bac...

Overview I followed the following guide to write TF Records, where I used tf.Transform to preprocess my features. Now, I would like to deploy my model, for which I need apply this preprocessing fu...

I am trying to deploy a tf.keras image classification model to Google CloudML Engine. Do I have to include code to create serving graph separately from training to get it to serve my models in a we...

tensorflow-gpu 1.10.0 tensorflow-server 1.10.0 I have deployed a tensorflow server which serves several models. The client code is like client.py this and I call the predict function. channel =...

So in TensorFlow's guide for using GPUs there is a part about using multiple GPUs in a "multi-tower fashion": ... for d in ['/device:GPU:2', '/device:GPU:3']: with tf.device(d): # <---- manual...

I have a SavedModel with saved_model.pbtxt and variables\ which was pre-trained on a single GPU from this repo: https://github.com/sthalles/deeplab_v3. I'm trying to serve this SavedModel with tens...

Tensorflow Serving server (run with docker) responds to my GET (and POST) requests with this: { "error": "Malformed request: POST /v1/models/saved_model/" } Precisely the same problem was already...

Need help in implementing the Tensorflow model in real time. While I am training everything is working fine but when I move on for a realtime forecast or prediction, the output what I received flu...

I have spent several hours trying to set up Tensorflow serving of the Tensorflow-hub module, "Universal Sentence Encoder." There is a similar question here: How to make the tensorflow hub embeddin...

I'm new to Tensorflow serving, I just tried Tensorflow serving via docker with this tutorial and succeeded. However, when I tried it with multiple versions, it serves only the latest version. Is...

When running the sample example in tensorflow model server [https://www.tensorflow.org/serving/docker](Serving example part) docker run -p 8501:8501 --mount type=bind, source=serving/tensorflow_ser...

I tried to install it according to the instructions on official website, which results in an ImportError when I import tensorflow: ImportError: libcublas.so.9.0: cannot open shared object file: No...

I'm attempting to serve Tensorflow models out of HDFS using Tensorflow Serving project. I'm running tensorflow serving docker container tag 1.10.1 https://hub.docker.com/r/tensorflow/serving I ca...

I have exported a SavedModel and now I with to load it back in and make a prediction. It was trained with the following features and labels: F1 : FLOAT32 F2 : FLOAT32 F3 : FLOAT32 L1 : FLOAT32 S...

I know about the "Serving a Tensorflow Model" page https://www.tensorflow.org/serving/serving_basic but those functions assume you're using tf.Session() which the DNNClassifier tutorial does not....

I am serving a model trained using object detection API. Here is how I did it: Create a Tensorflow service on port 9000 as described in the basic tutorial Create a python code calling this servic...

I have got a trained Tensorflow model and I want to serve the prediction method with REST API. What I can think of is to use Flask to build a simple REST API that receive JSON as input and then cal...

I have a tensorflow pre-trained model in a checkpoint form, and I intended to deploy the model for serving by converting the model into the savedmodel form. The size of the saved model is kind of t...

I am referring (here) to freeze models into .pb file. My model is CNN for text classification I am using (Github) link to train CNN for text classification and exporting in form of models. I have t...

The complete code for exporting the model: (I've already trained it and now loading from weights file) def cnn_layers(inputs): conv_base= keras.applications.mobilenetv2.MobileNetV2(input_shape=(22...

I am currently trying to serve a model built with Tensorflow's dnn premade estimator with TF serving. I am very happy to see the release of the restful API with Tensorflow Serving 1.8. However, if...

I've found the Dataset.map() functionality pretty nice for setting up pipelines to preprocess image/audio data before feeding into the network for training, but one issue I have is accessing the ra...

Question: Tensorflow Saver ,Exporter, SavedModelBuilder can all be used for save models. According to https://stackoverflow.com/questions/41740101/tensorflow-difference-between-saving-model-via...

I have the following input_fn. def input_fn(filenames, batch_size): # Create a dataset containing the text lines. dataset = tf.data.TextLineDataset(filenames).skip(1) # Parse each line. datas...

The google cloud documentation (see Binary data in prediction input) states: Your encoded string must be formatted as a JSON object with a single key named b64. The following Python example en...