neural-network Questions
2
Solved
As I understand it, in a deep neural network, we use an activation function (g) after applying the weights (w) and bias(b) (z := w * X + b | a := g(z)). So there is a composition function of (g o z...
Thesda asked 21/9, 2018 at 15:20
8
I was reading the papers on deep learning. Most of them refer to unsupervised learning.
They also say the neurons are pre-trained using unsupervised RBM network. Later they are fine tuned us...
Renaissance asked 28/10, 2013 at 22:19
1
In a typical Shapley value estimation for a numerical regression task, there is a clear way in which the marginal contribution of an input feature i to the final numerical output variable can be ca...
Laughingstock asked 4/2, 2022 at 14:59
6
I am designing a neural network and am trying to determine if I should write it in such a way that each neuron is its own 'process' in Erlang, or if I should just go with C++ and run a networ...
Energid asked 7/7, 2016 at 16:17
2
Solved
R's package 'forecast' has a function nnetar, which uses feed-forward neural networks with a single hidden layer to predict in time series.
Now I am using Python to do the similar analysis. I wan...
Hornbeam asked 27/5, 2019 at 3:51
3
Solved
Below the code
import numpy as np
np.random.seed(0)
from sklearn import datasets
import matplotlib.pyplot as plt
%matplotlib inline
%config InlineBackend.figure_format ='retina'
from keras.models ...
Tire asked 23/8, 2020 at 2:18
5
I am working on Multiclass Classification (4 classes) for Language Task and I am using the BERT model for classification task. I am following this blog post Transfer Learning for NLP: Fine-Tuning B...
Rapallo asked 9/11, 2020 at 11:53
4
Solved
I tried to implement an early stopping function to avoid my neural network model overfit. I'm pretty sure that the logic is fine, but for some reason, it doesn't work.
I want that when the validati...
Verbal asked 25/4, 2022 at 11:42
2
Solved
I'm trying to calculate MSELoss when mask is used. Suppose that I have tensor with batch_size of 2: [2, 33, 1] as my target, and another input tensor with the same shape. Since sequence length migh...
Captious asked 3/5, 2020 at 18:59
5
I am having hard time understanding position wise feed forward neural network in transformers architecture.
Lets take example as Machine translation task, where inputs are sentences. From the figu...
Votive asked 2/1, 2023 at 5:59
5
Solved
I have built a simple Keras network:
import numpy as np;
from keras.models import Sequential;
from keras.layers import Dense,Activation;
data= np.genfromtxt("./kerastests/mydata.csv", d...
Linkous asked 11/8, 2017 at 10:8
9
Solved
I've read about neural network a little while ago and I understand how an ANN (especially a multilayer perceptron that learns via backpropagation) can learn to classify an event as true or false.
...
Fatimafatimah asked 6/10, 2009 at 3:17
7
Solved
Sometimes I run into a problem:
OOM when allocating tensor with shape
e.g.
OOM when allocating tensor with shape (1024, 100, 160)
Where 1024 is my batch size and I don't know what's the rest. If ...
Bigener asked 9/10, 2017 at 20:25
6
I am implementing a CNN for an highly unbalanced classification problem and I would like to implement custum metrics in tensorflow to use the Select Best Model callback.
Specifically I would like t...
Viki asked 14/12, 2019 at 21:59
2
I recently came across a method in Pytorch when I try to implement AlexNet.
I don't understand how it works. Please explain the idea behind it with some examples. And how it is different from Maxp...
Diphtheria asked 4/11, 2019 at 11:26
3
Solved
I was doing some research on training deep neural networks using tensorflow. I know how to train a model. My problem is i have to train the same model on 2 different computers with different datase...
Effendi asked 20/1, 2018 at 17:9
4
Working in a multi-label classification problem with 13 possibles outputs in my neural network with Keras, sklearn, etc...
Each output can be an array like [0, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 1 ,0]....
Sightread asked 25/2, 2019 at 16:36
5
Solved
To make the results reproducible I've red more than 20 articles and added to my script maximum of the functions ... but failed.
In the official source I red there are 2 kinds of seeds - global an...
Forbear asked 7/4, 2020 at 11:26
2
Solved
I am a beginner in Deep Learning. I came through the concept of 'Gradient Checking'.
I just want to know, what is it and how it could help to improve the training process?
Bilberry asked 27/11, 2017 at 8:24
9
Solved
I'm training a network for image localization with Adam optimizer, and someone suggest me to use exponential decay. I don't want to try that because Adam optimizer itself decays learning rate. But ...
Pharmacy asked 15/9, 2016 at 17:54
4
Solved
I recently got the deep learning docker from https://github.com/floydhub/dl-docker running and while trying out the tutorials, received an error when importing the keras layers module.
from __fut...
Genia asked 23/5, 2017 at 9:46
7
Solved
I am about making backpropagation on a neural network that uses ReLU.
In a previous project of mine, I did it on a network that was using Sigmoid activation function, but now I'm a little bit confu...
Keavy asked 4/2, 2017 at 16:16
13
Solved
Using Anaconda Python 2.7 Windows 10.
I am training a language model using the Keras exmaple:
print('Build model...')
model = Sequential()
model.add(GRU(512, return_sequences=True, input_shape=(m...
Suzerainty asked 30/4, 2016 at 8:45
3
Solved
I am trying to write a code for a simple neural network training. The goal is to define a custom activation function and instead of letting Keras take the derivative of it automatically for the bac...
Repellent asked 3/10, 2019 at 16:49
7
Solved
I've noticed that a frequent occurrence during training is NANs being introduced.
Often times it seems to be introduced by weights in inner-product/fully-connected or convolution layers blowing up...
Fowling asked 27/11, 2015 at 17:23
1 Next >
© 2022 - 2025 — McMap. All rights reserved.