Tag: backpropagation

89 Backprop Through Max-Pooling Layers? 2016-05-12T08:38:12.740

28 Guidelines for selecting an optimizer for training neural networks 2016-03-04T09:32:17.287

21 Deep Neural Network - Backpropogation with ReLU 2017-05-28T09:06:20.633

21 Gradients for bias terms in backpropagation 2017-07-03T17:03:24.397

21 back propagation in CNN 2018-02-06T05:38:31.077

16 What do "compile" , "fit" and "predict" do in Keras sequential models? 2019-02-24T07:27:47.003

15 Sliding window leads to overfitting in LSTM? 2018-02-09T01:10:44.847

14 Back-propagation through max pooling layers 2016-08-21T09:44:54.333

14 Understanding Timestamps and Batchsize of Keras LSTM considering Hiddenstates and TBPTT 2018-08-31T12:26:19.527

12 Question about bias in Convolutional Networks 2016-05-20T17:29:10.243

11 Synthetic Gradients good number of Layers & neurons 2018-05-23T00:50:02.303

11 Differences between gradient calculated by different reduction methods in PyTorch 2019-07-05T18:12:45.913

10 How does backpropagation works through Max Pooling layer when doing a batch? 2017-05-15T08:54:41.607

9 Creating neural net for xor function 2016-05-04T14:55:36.070

9 How to update bias and bias's weight using backpropagation algorithm 2016-05-27T15:01:35.930

8 Deriving backpropagation equations "natively" in tensor form 2017-04-11T21:00:01.723

8 How to apply the gradient of softmax in backprop 2018-03-26T23:54:41.043

8 Synthetic Gradients - what's the practical benefit? 2018-05-23T21:09:36.090

8 How does Gradient Descent and Backpropagation work together? 2019-01-28T13:34:41.617

8 Understanding how convolutional layers work 2020-08-18T11:48:51.507

7 Backpropagation: In second-order methods, would ReLU derivative be 0? and what its effect on training? 2016-07-12T17:16:03.147

7 When are weights updated in CNN? 2018-02-03T14:54:18.867

7 An error with respect to filter weights in CNN during the backpropagation 2018-09-28T05:29:28.157

6 Error on multitask neural nets where all outputs not observed for every example 2015-11-11T15:37:59.103

6 Adjusting weights in an convolutional neural network 2016-12-22T17:31:20.917

6 Need help understanding LSTMs' backpropagation and carousel of error 2017-06-10T15:39:55.707

6 deriving the gradient of batch normalization 2018-04-09T04:00:05.670

6 Convolution backpropagation 2020-09-04T13:34:07.183

5 How to update weights in a neural network using gradient descent with mini-batches? 2015-12-14T17:21:21.047

5 Correct number of biases in CNN 2017-03-17T14:06:04.600

5 How to propagate error back to previous layer in CNN? 2018-03-04T09:43:05.547

5 Policy Gradients - gradient Log probabilities favor less likely actions? 2018-09-11T07:46:42.180

4 how to propagate error from convolutional layer to previous layer´╝č 2016-07-21T11:34:30.967

4 Backpropagation Through Time (BPTT) of LSTM 2016-11-30T10:32:42.087

4 Issue with backpropagation using a 2 layer network and softmax 2017-05-13T11:17:52.367

4 Confusion in backpropagation algorithm 2017-08-12T14:49:18.617

4 Gradient flow through concatenation operation 2017-12-12T18:18:22.963

4 Why does momentum need learning rate? 2018-04-21T00:36:18.360

4 Backpropagation - softmax derivative 2018-06-11T13:22:56.397

4 Backpropagation: Relevance of the error signal of a neuron 2019-08-22T14:55:57.303

3 Implementing Batch normalisation in Neural network 2016-03-16T14:10:07.437

3 In Neural Nets, why Use Gradient Methods as Opposed to Other Metaheuristics? 2016-04-15T07:03:52.583

3 Neural Network outputing the same value / normalization 2016-11-16T23:48:55.903

3 Steps for back propagation of convolutional layer in CNN 2016-11-24T17:29:10.990

3 Back Propagation Using MATLAB 2017-11-27T17:59:31.387

3 What Is Saturating Gradient Problem 2018-02-10T08:15:08.857

3 GradientChecking, can I blame float precision? 2018-04-26T05:32:31.020

3 Hochreiter LSTM (p. 4): Maximal values of logistic sigmoid derivative times weight 2018-05-09T17:28:06.770

3 Python3 Tensorflow: Difference Between truncated_normal and uniform_normal when creating weights 2018-06-20T21:04:55.953

3 Tensorflow Calculate error for a single neuron 2018-07-04T18:29:50.000

3 How is error back-propagated in a multi-layer RNN 2018-07-07T14:49:58.847

3 How does backpropogation behave when there is a dropout in FC layer? 2018-08-08T10:57:29.677

3 CNN backpropagation between layers 2018-11-22T17:19:41.573

3 CNN Back Propagation without Sigmoid Derivative 2019-03-24T00:50:55.913

3 Derivation of backpropagation for Softmax 2019-05-09T13:03:03.370

3 Computing derivatives for backpropagation across a convolution step 2019-07-29T11:41:38.137

3 Interpreting Gradients and Partial Derivatives when training Neural Networks 2020-01-17T17:33:51.643

3 Gradient Checking: MeanSquareError. Why huge epsilon improves discrepancy? 2020-04-18T23:30:23.527

3 How is the input gate in the LSTM learn? 2020-10-10T09:49:30.120

3 Why the sigmoid activation function results in sub-optimal gradient descent? 2020-10-30T17:16:53.030

2 Modified Voting Algorithm to find the best recommendation 2016-02-05T07:31:09.190

2 Trying to figure out how to set weights for convolutional networks 2016-05-20T16:53:38.323

2 Why do we calculate partial derivative of Error w.r.t output of Neural Network during backpropagation? 2016-06-01T16:22:59.640

2 Backpropagation derivation problem 2016-11-07T12:56:04.243

2 Intuition in Backpropagation (gradient descent) 2016-12-12T06:39:25.770

2 Basic backpropagation question 2017-01-23T19:51:34.230

2 Neural networks - adjusting weights 2017-04-19T18:04:11.283

2 neural network for binary classification of xor gate 2017-07-04T15:11:15.910

2 Neural Network: Backpropagation Works on MNIST, but Training/Test Set Accuracy Very Low 2017-08-01T18:45:53.433

2 How do I go from number data to string data (NN)? 2017-08-16T17:14:43.253

2 Gradient descent with vector-valued loss 2017-09-23T15:50:21.417

2 LSTMs: BPTT vs RTRL in training 2017-11-28T06:18:54.857

2 SGD learning gets stuck when using a max pooling layer (but it works fine with just conv + fc) 2017-11-28T19:32:26.367

2 What is the dimensionality of the bias term in neural networks? 2017-12-04T12:02:47.673

2 Rprop is too noisy 2017-12-21T22:24:35.860

2 Backpropagation in other fields 2017-12-23T18:19:15.633

2 Compute backpropagation 2018-01-20T20:51:40.460

2 Backpropagation with step or threshold activation function 2018-02-20T15:08:30.137

2 Back Propagation in time for tf.nn.dynamic_rnn for sequential input (from batch) 2018-03-13T12:00:27.870

2 neural network xor gate classification 2018-05-08T11:23:42.613

2 Alternative method for RNN backpropagation through time 2018-05-26T04:50:08.060

2 (Deep Learning) Backpropagation derivation from notes by Andrew NG 2018-06-09T01:06:28.353

2 Backpropgating error to emedding matrix 2018-06-12T18:01:02.330

2 Conflicting directions of weights gradients in gradient descent? 2018-06-29T06:44:36.440

2 Backpropagation of convolutional neural network - confusion 2018-07-21T12:14:52.100

2 How do you generalize from stochastic to batch learning using gradient descent? 2018-08-22T16:17:37.080

2 Purpose of backpropagation in neural networks 2018-09-04T20:13:19.637

2 Backpropagation 2018-09-11T11:27:18.667

2 Understanding backprop for softmax 2018-12-22T17:18:31.797

2 Pytorch: How to create an update rule the doesn't come from derivatives? 2019-02-17T13:07:47.197

2 Get derivatives from your NN 2019-06-05T22:30:47.463

2 Dueling Network gradient with respect to Advantage stream 2019-06-18T13:35:56.047

2 Layer notation for feed forward neural networks 2019-07-04T22:02:16.720

2 Backpropagation chain rule example 2019-10-20T02:23:21.607

2 Doubt in Derivation of Backpropagation 2019-11-08T17:17:25.630

2 Problem with chain rule in softmax layer when differentiated separately 2019-12-13T07:39:13.063

2 Hello, anyone able to direct me to a "cheat sheet" of Neural Network equations with legends? 2019-12-20T23:14:30.847

2 backpropagation between fully connected layer and convolution layer? 2020-01-12T15:13:39.480

2 Forward pass vs backward pass vs backpropagation 2020-01-13T16:07:07.870