dropout - McMap

1

Solved

" ValueError: Expecting KerasTensor which is from tf.keras.Input()". Error in prediction with dropout function

I am trying to predict uncertainty in a regression problem using Dropout during testing as per Yarin Gal's article. I created a class using Keras's backend function as provided by this stack overfl...

tensorflow keras lstm keras-layer dropout

Linda asked 19/1, 2022 at 5:51

2

Keras Dropout with noise_shape

I have a question about Keras function Dropout with the argument of noise_shape. Question 1: What's the meaning of if your inputs have shape (batch_size, timesteps, features) and you want the dro...

python deep-learning keras dropout

Ulises asked 5/10, 2017 at 11:59

2

Solved

Which PyTorch modules are affected by model.eval() and model.train()?

The model.eval() method modifies certain modules (layers) which are required to behave differently during training and inference. Some examples are listed in the docs: This has [an] effect only on...

python machine-learning pytorch batch-normalization dropout

Mcatee asked 8/3, 2021 at 17:53

2

Solved

Implementing dropout from scratch

This code attempts to utilize a custom implementation of dropout : %reset -f import torch import torch.nn as nn # import torchvision # import torchvision.transforms as transforms import torch im...

python machine-learning deep-learning pytorch dropout

Porch asked 9/1, 2019 at 11:57

1

Solved

GaussianDropout vs. Dropout vs. GaussianNoise in Keras

Can anyone explain the difference between the different dropout styles? From the documentation, I assumed that instead of dropping some units to zero (dropout), GaussianDropout multiplies those uni...

python tensorflow keras gaussian dropout

Tercet asked 30/12, 2020 at 4:5

1

Solved

Measuring uncertainty using MC Dropout on pytorch

I am trying to implement Bayesian CNN using Mc Dropout on Pytorch, the main idea is that by applying dropout at test time and running over many forward passes , you get predictions from a variety o...

pytorch bayesian conv-neural-network dropout uncertainty

Tern asked 6/8, 2020 at 13:59

2

Solved

How inverting the dropout compensates the effect of dropout and keeps expected values unchanged?

I'm learning regularization in Neural networks from deeplearning.ai course. Here in dropout regularization, the professor says that if dropout is applied, the calculated activation values will be s...

machine-learning neural-network deep-learning regularized dropout

Concinnity asked 25/7, 2019 at 2:49

2

Solved

Keras: the difference between LSTM dropout and LSTM recurrent dropout

From the Keras documentation: dropout: Float between 0 and 1. Fraction of the units to drop for the linear transformation of the inputs. recurrent_dropout: Float between 0 and 1. Fraction of the...

keras lstm dropout

Archibald asked 5/7, 2017 at 11:13

1

Solved

correct order for SpatialDropout2D, BatchNormalization and activation function?

For a CNN architecture I want to use SpatialDropout2D layer instead of Dropout layer. Additionaly I want to use BatchNormalization. So far I had always set the BatchNormalization directly after a C...

keras batch-normalization activation-function dropout

Stamp asked 7/1, 2020 at 19:20

2

Solved

Dropout layer before or after LSTM. What is the difference?

Suppose that we have an LSTM model for time series forecasting. Also, this is a multivariate case, so we're using more than one feature for training the model. ipt = Input(shape = (shape[0], shape...

tensorflow keras lstm dropout

Decolonize asked 7/11, 2019 at 12:24

1

Solved

What is the meaning of in-place in dropout

def dropout(input, p=0.5, training=True, inplace=False) inplace: If set to True, will do this operation in-place. I would like to ask what is the meaning of in-place in dropout. What does it...

machine-learning neural-network pytorch dropout

Gitlow asked 28/10, 2019 at 10:18

3

Solved

PyTorch - How to deactivate dropout in evaluation mode

This is the model I defined it is a simple lstm with 2 fully connect layers. import copy import torch import torch.nn as nn import torch.nn.functional as F import torch.optim as optim class mylst...

python deep-learning lstm pytorch dropout

Plummer asked 21/12, 2018 at 5:41

3

Solved

Pytorch: nn.Dropout vs. F.dropout

There are two ways to perform dropout: torch.nn.Dropout torch.nn.functional.Dropout I ask: Is there a difference between them? When should I use one over the other? I don't see any performance ...

python deep-learning neural-network pytorch dropout

Know asked 21/11, 2018 at 19:44

1

Solved

About correctly using dropout in RNNs (Keras)

I am confused between how to correctly use dropout with RNN in keras, specifically with GRU units. The keras documentation refers to this paper (https://arxiv.org/abs/1512.05287) and I understand t...

machine-learning keras deep-learning recurrent-neural-network dropout

Jaggers asked 22/5, 2018 at 1:8

2

Solved

How to understand SpatialDropout1D and when to use it?

Occasionally I see some models are using SpatialDropout1D instead of Dropout. For example, in the Part of speech tagging neural network, they use: model = Sequential() model.add(Embedding(s_voca...

machine-learning keras deep-learning conv-neural-network dropout

Wye asked 17/5, 2018 at 14:11

1

Implement dropout to fully connected layer in PyTorch

How to apply dropout to the following fully connected network in Pytorch: class NetworkRelu(nn.Module): def __init__(self): super().__init__() self.fc1 = nn.Linear(784,128) self.fc2 = nn.Linea...

python pytorch dropout

Teutonic asked 14/3, 2019 at 7:59

2

Input contains NaN, infinity or a value too large for dtype('float64') in Tensorflow

I am trying to train a LSTM and in my model I have an exponential learning rate decay and a dropout layer. In order to deactivate the dropout layer when testing and validating, I have put a placeho...

python-3.x tensorflow neural-network lstm dropout

Meaty asked 7/1, 2019 at 6:22

1

Solved

Using Dropout with Keras and LSTM/GRU cell

In Keras you can specify a dropout layer like this: model.add(Dropout(0.5)) But with a GRU cell you can specify the dropout as a parameter in the constructor: model.add(GRU(units=512, return...

keras lstm dropout

Karl asked 6/6, 2018 at 12:40

1

Keras LSTM: dropout vs recurrent_dropout

I realize this post is asking a similar question to this. But I just wanted some clarification, preferably a link to some kind of Keras documentation that says the difference. In my mind, dropout...

deep-learning keras lstm recurrent-neural-network dropout

Toluca asked 20/4, 2018 at 11:7

1

Solved

Tensorflow LSTM Dropout Implementation

How specifically does tensorflow apply dropout when calling tf.nn.rnn_cell.DropoutWrapper() ? Everything I read about applying dropout to rnn's references this paper by Zaremba et. al which says...

tensorflow time-series lstm dropout

Tamishatamma asked 27/2, 2017 at 14:40

1

Solved

Where to add dropout in neural network?

I have seen description about the dropout in different parts of the neural network: dropout in the weight matrix, dropout in the hidden layer after the matrix multiplication and before relu, d...

neural-network conv-neural-network recurrent-neural-network dropout

Biomass asked 4/11, 2016 at 15:45

1

Solved

ReLu and Dropout in CNN

I am studying Convolutional Neural Networks. I am confused about some layers in CNN. Regarding ReLu... I just know that it is the sum of an infinite logistic function, but ReLu doesn't connect to ...

neural-network deep-learning dropout

Lydon asked 5/12, 2014 at 16:1

dropout Questions

Recommended topics

Hot tags