I am trying tensorflow course from Udacity which uses google colab to write/run the code. But I want to run the code on my local machine and hence have created a new environment to run the code , ...

I understand Dataset API is a sort of a iterator which does not load the entire dataset into memory, because of which it is unable to find the size of the Dataset. I am talking in the context of la...

There are plenty of examples how to create and use TensorFlow datasets, e.g. dataset = tf.data.Dataset.from_tensor_slices((images, labels)) My question is how to get back the data/labels from the ...

I'm following one of the online courses about time series predictions using Tensorflow. The function used to convert Numpy array (TS) into a Tensorflow dataset used is LSTM-based model is already g...

Does anyone know how to split a dataset created by the dataset API (tf.data.Dataset) in Tensorflow into Test and Train?

I have a tensorflow dataset based on one .tfrecord file. How do I split the dataset into test and train datasets? E.g. 70% Train and 30% test? Edit: My Tensorflow Version: 1.8 I've checked, there...

I am trying to use this Google's example, but with my own dataset: https://github.com/tensorflow/examples/blob/master/tensorflow_examples/lite/model_customization/demo/text_classification.ipynb I...

The labelmaps of Tensorflows object_detection project contain 90 classes, although COCO has only 80 categories. Therefore the parameter num_classes in all sample configs is set to 90. If i now dow...

Let's say I have defined a dataset in this way: filename_dataset = tf.data.Dataset.list_files("{}/*.png".format(dataset)) how can I get the number of elements that are inside the dataset (hence,...

I'm working on this project where all the data comes preprocessed and ready as a TensorFlow dataset which looks like this: <MapDataset shapes: {input_ids: (128,), input_mask: (128,), label_ids:...

I want to use tf.data.Dataset.list_files function to feed my datasets. But because the file is not image, I need to load it manually. The problem is tf.data.Dataset.list_files pass variable as tf.t...

I would like to ask if current API of datasets allows for implementation of oversampling algorithm? I deal with highly imbalanced class problem. I was thinking that it would be nice to oversample s...

The current TensorFlow dataset interleave functionality is basically a interleaved flat-map taking as input a single dataset. Given the current API, what's the best way to interleave multiple datas...

I am new to tensorflow, and I have started to use tensorflow 2.0 I have built a tensorflow dataset for a multi-class classification problem. Let's call this labeled_ds. I have prepared this datase...

I am setting up a TensorFlow pipeline for reading large HDF5 files as input for my deep learning models. Each HDF5 file contains 100 videos of variable size length stored as a collection of compres...

I was reading the TF performance guide for Data Loading section. For prefetch it says, The tf.data API provides a software pipelining mechanism through the tf.data.Dataset.prefetch transformati...

I've been trying to get into ML and I wanted to follow a course on it but it requires Tensorflow and I've been trying to get that working on my system. I have the 2021 14" 16GB Macbook Pro wit...

I want to load the data from the directory where I have around 5000 images (type 'png'). But it returns me an error saying that there are no images when obviusly there are images. This code: width=...

I am trying to write a Custom Model in which I am writing a custom train_step function I am creating a 'tf.data.Dataset` from a Custom Datagenerator like tds = tf.data.Dataset.from_generator(tdg.__...

There are at least two more questions like this on SO but not a single one has been answered. I have a dataset of the form: <TensorSliceDataset shapes: ((512,), (512,), (512,), ()), types: (tf...

I am trying to build a machine learning code with tensorflow 2.0 in jupyter using the mnist dataset . The data set is being taken from tensorflow-datasets but during the initial downloading of the ...

I want to use the tensorflow dataset saving and loading functions but I am not sure to understand the sharding method. The documentation indicates : The saved dataset is saved in multiple file &qu...

I have a dataset like this: a = tf.data.Dataset.range(1, 16) b = tf.data.Dataset.range(16, 32) zipped = tf.data.Dataset.zip((a, b)) list(zipped.as_numpy_iterator()) # output: [(0, 16), (1, 17), ...

Is there an easy way to get the entire set of elements in a tf.data.Dataset? i.e. I want to set batch size of the Dataset to be the size of my dataset without specifically passing it the number of ...

I am new in tensoflow and I want to adapt the MNIST tutorial https://www.tensorflow.org/tutorials/layers with my own data (images of 40x40). This is my model function : def cnn_model_fn(features,...