Neural networks class - Université de Sherbrooke

92 videos • 1,102,288 views • by Hugo Larochelle These are the videos I used to teach my Neural networks class at Université de Sherbrooke. The videos, along with the slides and research paper references, are available here: https://larocheh.github.io/neural_net...
1
Neural networks [1.1] : Feedforward neural network - artificial neuron
Hugo Larochelle
Download
2
Neural networks [1.2] : Feedforward neural network - activation function
Hugo Larochelle
Download
3
Neural networks [1.3] : Feedforward neural network - capacity of single neuron
Hugo Larochelle
Download
4
Neural networks [1.4] : Feedforward neural network - multilayer neural network
Hugo Larochelle
Download
5
Neural networks [1.5] : Feedforward neural network - capacity of neural network
Hugo Larochelle
Download
6
Neural networks [1.6] : Feedforward neural network - biological inspiration
Hugo Larochelle
Download
7
Neural networks [2.1] : Training neural networks - empirical risk minimization
Hugo Larochelle
Download
8
Neural networks [2.2] : Training neural networks - loss function
Hugo Larochelle
Download
9
Neural networks [2.3] : Training neural networks - output layer gradient
Hugo Larochelle
Download
10
Neural networks [2.4] : Training neural networks - hidden layer gradient
Hugo Larochelle
Download
11
Neural networks [2.5] : Training neural networks - activation function derivative
Hugo Larochelle
Download
12
Neural networks [2.6] : Training neural networks - parameter gradient
Hugo Larochelle
Download
13
Neural networks [2.7] : Training neural networks - backpropagation
Hugo Larochelle
Download
14
Neural networks [2.8] : Training neural networks - regularization
Hugo Larochelle
Download
15
Neural networks [2.9] : Training neural networks - parameter initialization
Hugo Larochelle
Download
16
Neural networks [2.10] : Training neural networks - model selection
Hugo Larochelle
Download
17
Neural networks [2.11] : Training neural networks - optimization
Hugo Larochelle
Download
18
Neural networks [3.1] : Conditional random fields - motivation
Hugo Larochelle
Download
19
Neural networks [3.2] : Conditional random fields - linear chain CRF
Hugo Larochelle
Download
20
Neural networks [3.3] : Conditional random fields - context window
Hugo Larochelle
Download
21
Neural networks [3.4] : Conditional random fields - computing the partition function
Hugo Larochelle
Download
22
Neural networks [3.5] : Conditional random fields - computing marginals
Hugo Larochelle
Download
23
Neural networks [3.6] : Conditional random fields - performing classification
Hugo Larochelle
Download
24
Neural networks [3.7] : Conditional random fields - factors, sufficient statistics and linear CRF
Hugo Larochelle
Download
25
Neural networks [3.8] : Conditional random fields - Markov network
Hugo Larochelle
Download
26
Neural networks [3.9] : Conditional random fields - factor graph
Hugo Larochelle
Download
27
Neural networks [3.10] : Conditional random fields - belief propagation
Hugo Larochelle
Download
28
Neural networks [4.1] : Training CRFs - loss function
Hugo Larochelle
Download
29
Neural networks [4.2] : Training CRFs - unary log-factor gradient
Hugo Larochelle
Download
30
Neural networks [4.3] : Training CRFs - pairwise log-factor gradient
Hugo Larochelle
Download
31
Neural networks [4.4] : Training CRFs - discriminative vs. generative learning
Hugo Larochelle
Download
32
Neural networks [4.5] : Training CRFs - maximum-entropy Markov model
Hugo Larochelle
Download
33
Neural networks [4.6] : Training CRFs - hidden Markov model
Hugo Larochelle
Download
34
Neural networks [4.7] : Training CRFs - general conditional random field
Hugo Larochelle
Download
35
Neural networks [4.8] : Training CRFs - pseudolikelihood
Hugo Larochelle
Download
36
Neural networks [5.1] : Restricted Boltzmann machine - definition
Hugo Larochelle
Download
37
Neural networks [5.2] : Restricted Boltzmann machine - inference
Hugo Larochelle
Download
38
Neural networks [5.3] : Restricted Boltzmann machine - free energy
Hugo Larochelle
Download
39
Neural networks [5.4] : Restricted Boltzmann machine - contrastive divergence
Hugo Larochelle
Download
40
Neural networks [5.5] : Restricted Boltzmann machine - contrastive divergence (parameter update)
Hugo Larochelle
Download
41
Neural networks [5.6] : Restricted Boltzmann machine - persistent CD
Hugo Larochelle
Download
42
Neural networks [5.7] : Restricted Boltzmann machine - example
Hugo Larochelle
Download
43
Neural networks [5.8] : Restricted Boltzmann machine - extensions
Hugo Larochelle
Download
44
Neural networks [6.1] : Autoencoder - definition
Hugo Larochelle
Download
45
Neural networks [6.2] : Autoencoder - loss function
Hugo Larochelle
Download
46
Neural networks [6.3] : Autoencoder - example
Hugo Larochelle
Download
47
Neural networks [6.4] : Autoencoder - linear autoencoder
Hugo Larochelle
Download
48
Neural networks [6.5] : Autoencoder - undercomplete vs. overcomplete hidden layer
Hugo Larochelle
Download
49
Neural networks [6.6] : Autoencoder - denoising autoencoder
Hugo Larochelle
Download
50
Neural networks [6.7] : Autoencoder - contractive autoencoder
Hugo Larochelle
Download
51
Neural networks [7.1] : Deep learning - motivation
Hugo Larochelle
Download
52
Neural networks [7.2] : Deep learning - difficulty of training
Hugo Larochelle
Download
53
Neural networks [7.3] : Deep learning - unsupervised pre-training
Hugo Larochelle
Download
54
Neural networks [7.4] : Deep learning - example
Hugo Larochelle
Download
55
Neural networks [7.5] : Deep learning - dropout
Hugo Larochelle
Download
56
Neural networks [7.6] : Deep learning - deep autoencoder
Hugo Larochelle
Download
57
Neural networks [7.7] : Deep learning - deep belief network
Hugo Larochelle
Download
58
Neural networks [7.8] : Deep learning - variational bound
Hugo Larochelle
Download
59
Neural networks [7.9] : Deep learning - DBN pre-training
Hugo Larochelle
Download
60
Neural networks [8.1] : Sparse coding - definition
Hugo Larochelle
Download
61
Neural networks [8.2] : Sparse coding - inference (ISTA algorithm)
Hugo Larochelle
Download
62
Neural networks [8.3] : Sparse coding - dictionary update with projected gradient descent
Hugo Larochelle
Download
63
Neural networks [8.4] : Sparse coding - dictionary update with block-coordinate descent
Hugo Larochelle
Download
64
Neural networks [8.5] : Sparse coding - dictionary learning algorithm
Hugo Larochelle
Download
65
Neural networks [8.6] : Sparse coding - online dictionary learning algorithm
Hugo Larochelle
Download
66
Neural networks [8.7] : Sparse coding - ZCA preprocessing
Hugo Larochelle
Download
67
Neural networks [8.8] : Sparse coding - feature extraction
Hugo Larochelle
Download
68
Neural networks [8.9] : relationship with V1
Hugo Larochelle
Download
69
Neural networks [9.1] : Computer vision - motivation
Hugo Larochelle
Download
70
Neural networks [9.2] : Computer vision - local connectivity
Hugo Larochelle
Download
71
Neural networks [9.3] : Computer vision - parameter sharing
Hugo Larochelle
Download
72
Neural networks [9.4] : Computer vision - discrete convolution
Hugo Larochelle
Download
73
Neural networks [9.5] : Computer vision - pooling and subsampling
Hugo Larochelle
Download
74
Neural networks [9.6] : Computer vision - convolutional network
Hugo Larochelle
Download
75
Neural networks [9.7] : Computer vision - object recognition
Hugo Larochelle
Download
76
Neural networks [9.8] : Computer vision - example
Hugo Larochelle
Download
77
Neural networks [9.9] : Computer vision - data set expansion
Hugo Larochelle
Download
78
Neural networks [9.10] : Computer vision - convolutional RBM
Hugo Larochelle
Download
79
Neural networks [10.1] : Natural language processing - motivation
Hugo Larochelle
Download
80
Neural networks [10.2] : Natural language processing - preprocessing
Hugo Larochelle
Download
81
Neural networks [10.3] : Natural language processing - one-hot encoding
Hugo Larochelle
Download
82
Neural networks [10.4] : Natural language processing - word representations
Hugo Larochelle
Download
83
Neural networks [10.5] : Natural language processing - language modeling
Hugo Larochelle
Download
84
Neural networks [10.6] : Natural language processing - neural network language model
Hugo Larochelle
Download
85
Neural networks [10.7] : Natural language processing - hierarchical output layer
Hugo Larochelle
Download
86
Neural networks [10.8] : Natural language processing - word tagging
Hugo Larochelle
Download
87
Neural networks [10.9] : Natural language processing - convolutional network
Hugo Larochelle
Download
88
Neural networks [10.10] : Natural language processing - multitask learning
Hugo Larochelle
Download
89
Neural networks [10.11] : Natural language processing - recursive network
Hugo Larochelle
Download
90
Neural networks [10.12] : Natural language processing - merging representations
Hugo Larochelle
Download
91
Neural networks [10.13] : Natural language processing - tree inference
Hugo Larochelle
Download
92
Neural networks [10.14] : Natural language processing - recursive network training
Hugo Larochelle
Download