Hyperparameter Tuning

Neural network

Python

NumPy

Logistic Regression

Batch Normalization

Generative adversarial network (GAN)

Shallow Neural Network

Deep Neural Network

Optimization Algorithms

Initialization

Regularization (mathematics)

Gradient Checking

Optimization

TensorFlow

Deep Convolutional Models

Residual Networks

Detection Algorithms

Face Recognition

Neural Style Transfer

You Only Look Once (YOLO)

ConvNets

Image Segmentation

U-Net

Recurrent neural network (RNN)

Long Short-Term Memory (LSTM)

Natural Language Processing (NLP)

Word Embeddings

Attention (machine learning)

Transformer (machine learning model)

Deep Reinforcement Learning

Neural Machine Translation

Trigger Word Detection

Transfer learning

Sequence-to-sequence (Seq2Seq)

CS 230 Deep Learning Stanford University Fall 2022 An in-depth course focused on building neural networks and leading successful machine learning projects. It covers Convolutional Networks, RNNs, LSTM, Adam, Dropout, BatchNorm, Xavier/He initialization, and more. Students are expected to have basic computer science skills, probability theory knowledge, and linear algebra familiarity.  Deep Learning is one of the most highly sought after skills in AI. In this course, you will learn the foundations of Deep Learning, understand how to build neural networks, and learn how to lead successful machine learning projects. You will learn about Convolutional networks, RNNs, LSTM, Adam, Dropout, BatchNorm, Xavier/He initialization, and more.  Students are expected to have the following background, and are invited to take the [Workera](http://www.workera.ai/) technical assessments prior to the class to self-assess themselves prior to taking the class:

- Knowledge of basic computer science principles and skills, at a level sufficient to write a reasonably non-trivial computer program. This corresponds to a Developing level (or badge) in the “Algorithmic Coding” section on [Workera](http://www.workera.ai/).
- Familiarity with the probability theory (CS 109 or STATS 116), which students can assess by taking the “Data Science” section on [Workera](http://www.workera.ai/).
- Familiarity with linear algebra (MATH 51), which students can assess by taking the “Mathematics” section on [Workera](http://www.workera.ai/). 

CS 230 Deep Learning

Deep Learning

K-Nearest Neighbors

Linear Classifiers

Stochastic gradient descent (SGD)

Momentum

AdaGrad

Adam

Learning Rate Schedules

Support Vector Machine (SVM)

Softmax Loss

Multi-layer Perceptron

Backpropagation

Higher-level representations

Image Features

Pooling

AlexNet, VGG, GoogLeNet, ResNet

Activation Functions

Data Processing

Weight initialization

Data Augmentation

Feature visualization and inversion

Adversarial Examples

DeepDream and Style Transfer

Single-stage detectors

Two-stage detectors

Semantic/Instance/Panoptic segmentation

Gated recurrent unit (GRU)

Language Modeling

Image Captioning

Object Detection

Self-Attention

Video classification

3D CNNs

Two-stream networks

Multimodal Video Understanding

Supervised learning

Unsupervised learning

Pixel RNN, Pixel CNN

Variational autoencoder (VAE)

Pretext Tasks

Contrastive Learning

Multisensory Supervision

Optical Flow

Stereo Vision

3D Shape Representations

Shape Reconstruction

Neural Implicit Representations

Convolution

CS231n: Deep Learning for Computer Vision Stanford University Spring 2022 This is a deep-dive into the details of deep learning architectures for visual recognition tasks. The course provides students with the ability to implement, train their own neural networks and understand state-of-the-art computer vision research. It requires Python proficiency and familiarity with calculus, linear algebra, probability, and statistics. Computer Vision has become ubiquitous in our society, with applications in search, image understanding, apps, mapping, medicine, drones, and self-driving cars. Core to many of these applications are visual recognition tasks such as image classification, localization and detection. Recent developments in neural network (aka “deep learning”) approaches have greatly advanced the performance of these state-of-the-art visual recognition systems. This course is a deep dive into the details of deep learning architectures with a focus on learning end-to-end models for these tasks, particularly image classification. During the 10-week course, students will learn to implement and train their own neural networks and gain a detailed understanding of cutting-edge research in computer vision. Additionally, the final assignment will give them the opportunity to train and apply multi-million parameter networks on real-world vision problems of their choice. Through multiple hands-on assignments and the final course project, students will acquire the toolset for setting up deep learning tasks and practical engineering tricks for training and fine-tuning deep neural networks.  - Proficiency in Python  
    All class assignments will be in Python (and use numpy) (we provide a tutorial [here](http://cs231n.github.io/python-numpy-tutorial/) for those who aren't as familiar with Python). If you have a lot of programming experience but in a different language (e.g. C/C++/Matlab/Javascript) you will probably be fine.
- College Calculus, Linear Algebra (e.g. MATH 19 or 41, MATH 51)  
     You should be comfortable taking derivatives and understanding matrix vector operations and notation.
- Basic Probability and Statistics (e.g. CS 109 or other stats course)  
    You should know basics of probabilities, gaussian distributions, mean, standard deviation, etc. 

CS231n: Deep Learning for Computer Vision

Computer Vision

Hyperparameter optimization

Hyperparameter Tuning

2 courses cover this concept

CS 230 Deep Learning

CS231n: Deep Learning for Computer Vision