tfrecord Questions

1

Theres not that much information given in the TensorFlow documentation: https://www.tensorflow.org/api_docs/python/tf/train/Example https://www.tensorflow.org/api_docs/python/tf/train/SequenceExamp...
Hypochondria asked 20/10, 2017 at 21:28

3

The labelmaps of Tensorflows object_detection project contain 90 classes, although COCO has only 80 categories. Therefore the parameter num_classes in all sample configs is set to 90. If i now dow...
Untimely asked 3/6, 2018 at 9:50

2

Solved

I am trying to convert the shape property of a Tensor in Tensorflow 2.1 and I get this error: AttributeError: 'Tensor' object has no attribute 'numpy' I already checked that the output of tf.exe...
Educe asked 21/2, 2020 at 23:7

8

Solved

I have a .tfrecord but I don't know how it is structured. How can I inspect the schema to understand what the .tfrecord file contains? All Stackoverflow answers or documentation seem to assume I k...
Bobwhite asked 22/2, 2017 at 14:41

8

Solved

I have training data that is a directory of jpeg images and a corresponding text file containing the file name and the associated category label. I am trying to convert this training data into a tf...
Marroquin asked 21/11, 2015 at 22:57

3

First I want to quickly give some background. What I want to achieve eventually is to train a fully connected neural network for a multi-class classification problem under tensorflow framework. Th...
Educatee asked 11/10, 2017 at 3:36

7

How do you read all examples from a TFRecords at once? I've been using tf.parse_single_example to read out individual examples using code similar to that given in the method read_and_decode in the...
Tyro asked 11/5, 2016 at 2:4

3

I was asked this on another forum but thought I'd post it here for anyone that is having trouble with TFRecords. TensorFlow's Object Detection API can produce strange behavior if the labels in the...
Granulate asked 17/5, 2018 at 12:52

5

Solved

Is it possible for obtain the total number of records from a .tfrecords file ? Related to this, how does one generally keep track of the number of epochs that have elapsed while training models? Wh...
Penland asked 7/11, 2016 at 18:33

4

Solved

How to use tfrecord with pytorch? I have downloaded "Youtube8M" datasets with video-level features, but it is stored in tfrecord. I tried to read some sample from these file to convert it to numpy...
Aphesis asked 29/4, 2019 at 1:48

2

Solved

I have an unbatched tensorflow dataset that looks like this: ds = ... for record in ds.take(3): print('data shape={}'.format(record['data'].shape)) -> data shape=(512, 512, 87) -> data shap...
Lettyletup asked 7/5, 2021 at 17:49

6

Solved

Is there any way to split .tfrecords file into many .tfrecords files directly, without writing back each Dataset example ?
Vidda asked 4/2, 2019 at 15:25

3

System information OS Platform and Distribution: CentOS 7.5.1804 TensorFlow installed from: pip install tensorflow-gpu TensorFlow version: tensorflow-gpu 1.8.0 CUDA/cuDNN version: 9.0/7.1.2 GPU m...
Birdsall asked 19/6, 2018 at 13:6

3

I am trying to create a dataset in tfrecord format from numpy arrays. I am trying to store 2d and 3d coordinates. 2d coordinates are numpy array of shape (2,10) of type float64 3d coordinates are ...
Timeserver asked 18/12, 2017 at 1:31

1

I have a tfrecord file and would like to import it in a pandas dataframe or numpy array. I found tools to read tfrecords but they only work inside a tensorflow session, which is not the use case I...
Dynamo asked 10/5, 2019 at 10:2

2

Solved

Best I would like to read some TF records data. This works, but only for Fixed length data, but now I would like to do the same thing with variable length data VarLenFeature def load_tfrecord_fix...
Gigantean asked 27/10, 2017 at 20:33

2

I have a tfrecord with 23 classes with 35 images in each class (805 in total). My current tfrecord read function is: def read_tfrecord(serialized_example): feature_description = { 'image': tf.io...
No asked 25/11, 2019 at 20:42

1

Solved

I've stored my training and validation data on two separate TFRecord files, in which I store 4 values: signal A (float32 shape (150,)), signal B (float32 shape (150,)), label (scalar int64), id (st...
Koblick asked 9/3, 2020 at 13:18

2

Solved

I've tried to solve classification problem whose input data having 32 features and 16 labels by Deep Neural Network (DNN). They look like, # Input data shape=(32,), dtype=float32, np.array([-0.9...
Hughes asked 21/11, 2019 at 9:55

3

Solved

Please read post before marking Duplicate: I was looking for an efficient way to count the number of examples in a TFRecord file of images. Since a TFRecord file does not save any metadata about t...
Sappy asked 9/4, 2019 at 17:51

2

Solved

This is my code! My tensorflow version is 1.6.0, python version is 3.6.4. If I direct use dataset to read csv file, I can train and no wrong. But I convert csv file to tfrecords file, it's wrong. I...
Frausto asked 10/3, 2018 at 13:50

0

I am trying to perform ZCA whitening on a Tensorflow Dataset. In order to do this, I am trying to extract my data from my Dataset as a Tensor, perform the whitening, then create another Dataset aft...
Starwort asked 13/11, 2019 at 16:26

1

Solved

I want to train a convolutional neural network (using tf.keras from Tensorflow version 1.13) using numpy arrays as input data. The training data (which I currently store in a single >30GB '.npz'...
Fescue asked 29/8, 2019 at 19:57

1

when save to TFRecord, I use: def _int64_feature(value): return tf.train.Feature(int64_list=tf.train.Int64List(value=[value])) def _bytes_feature(value): return tf.train.Feature(bytes_list=tf....
Informal asked 18/8, 2018 at 3:11

2

Solved

I am trying to follow this guide in order to serialize my input data into the TFRecord format but I keep hitting this error when trying to read it: InvalidArgumentError: Key: my_key. Can't parse...
Charlettecharley asked 27/11, 2018 at 12:11

© 2022 - 2025 — McMap. All rights reserved.