Introduction to Convolutional Neural Network CNNConv NETinsights from

  • Slides: 24
Download presentation
Introduction to Convolutional Neural Network (CNN/Conv. NET)insights from amateur GEORG E ( TI AN

Introduction to Convolutional Neural Network (CNN/Conv. NET)insights from amateur GEORG E ( TI AN ZHOU)

Big Thanks to Brandon’s Presentation Brandon Rohrer http: //brohrer. github. io/how_convolutional _neural_networks_work. html https:

Big Thanks to Brandon’s Presentation Brandon Rohrer http: //brohrer. github. io/how_convolutional _neural_networks_work. html https: //brohrer. github. io/blog. html

A toy Conv. Net: X’s and O’s CNN X or O

A toy Conv. Net: X’s and O’s CNN X or O

Convolution Kernal, Filter

Convolution Kernal, Filter

Filtering: The math behind the match 1. 2. 3. 4. 5.

Filtering: The math behind the match 1. 2. 3. 4. 5.

1. 2. 3. 4. 5.

1. 2. 3. 4. 5.

55

55

Convolution: Trying every possible match

Convolution: Trying every possible match

Convolution: Trying every possible match =

Convolution: Trying every possible match =

Convolution layer

Convolution layer

Pooling Layer: Reduce the size of image 1. 2. 3. 4.

Pooling Layer: Reduce the size of image 1. 2. 3. 4.

Pooling layer

Pooling layer

Rectified Linear Units (Re. LUs) -Tuning maths

Rectified Linear Units (Re. LUs) -Tuning maths

Stacking

Stacking

Fully connected layer … X O Output

Fully connected layer … X O Output

X O

X O

Fully connected layer of unknown image X O

Fully connected layer of unknown image X O

Putting it all together X O

Putting it all together X O

Backpropagation CNN X O

Backpropagation CNN X O

Minimizing error weight

Minimizing error weight

Decisions for CNN designers • For each convolution layer, How many filter? How many

Decisions for CNN designers • For each convolution layer, How many filter? How many pixels in each filter? • For each pooling layer, What window size? What stride?

References • Brandon Rohrer, http: //brohrer. github. io/how_convolutional_neural_networks_work. html • Gu, J. , Wang,

References • Brandon Rohrer, http: //brohrer. github. io/how_convolutional_neural_networks_work. html • Gu, J. , Wang, Z. , Kuen, J. , Ma, L. , Shahroudy, A. , Shuai, B. , Liu, T. , Wang, X. , Wang, G. , 2015. Recent advances in convolutional neural networks. ar. Xiv: 1512. 07108. • "Convolutional Neural Networks (Le. Net) – Deep. Learning 0. 1 documentation". Deep. Learning 0. 1. LISA Lab. • Hubel, D. and Wiesel, T. (1968). Receptive fields and functional architecture of monkey striate cortex. Journal of Physiology (London), 195, 215– 243

Convolutional Neural Network 20151002 Outline Neural Networks ConvolutionalConvolutional Neural Network 20151002 Outline Neural Networks Convolutional
Convolutional Neural Network NVIDIA Jetson TX 1 ConvolutionalConvolutional Neural Network NVIDIA Jetson TX 1 Convolutional
Convolutional Neural Network CNN Network Architecture designed forConvolutional Neural Network CNN Network Architecture designed for
Convolutional codes Tomashevich Victor Name Introduction Convolutional codesConvolutional codes Tomashevich Victor Name Introduction Convolutional codes
A VERY Brief Introduction to Convolutional Neural NetworkA VERY Brief Introduction to Convolutional Neural Network
CONVOLUTIONAL NEURAL NETWORK INTRODUCTION Used for Signal processingCONVOLUTIONAL NEURAL NETWORK INTRODUCTION Used for Signal processing
Introduction to Convolutional Neural Network and ILSVRC AdvisorsIntroduction to Convolutional Neural Network and ILSVRC Advisors
Signal Modeling From Convolutional Sparse Coding to ConvolutionalSignal Modeling From Convolutional Sparse Coding to Convolutional
Convolutional Coding In telecommunication a convolutional code isConvolutional Coding In telecommunication a convolutional code is
Convolutional Codes Dr Muqaibel EE 430 Convolutional CodesConvolutional Codes Dr Muqaibel EE 430 Convolutional Codes
IV Convolutional Codes Puncturing of Convolutional Codes lIV Convolutional Codes Puncturing of Convolutional Codes l
Convolutional Codes Mohammad Hanaysheh Mahdi Barhoush A convolutionalConvolutional Codes Mohammad Hanaysheh Mahdi Barhoush A convolutional
Convolutional filters Usman Roshan Convolutional filter Mathematically speakingConvolutional filters Usman Roshan Convolutional filter Mathematically speaking
Signal Modeling From Convolutional Sparse Coding to ConvolutionalSignal Modeling From Convolutional Sparse Coding to Convolutional
Convolutional neural network for Image recognition By YunzheConvolutional neural network for Image recognition By Yunzhe
DATA STRUCTURES AND ALGORITHMS PIC CONVOLUTIONAL NEURAL NETWORKDATA STRUCTURES AND ALGORITHMS PIC CONVOLUTIONAL NEURAL NETWORK
ISAAC A Convolutional Neural Network Accelerator with InSituISAAC A Convolutional Neural Network Accelerator with InSitu
Face Recognition A Convolutional Neural Network Approach InstructorFace Recognition A Convolutional Neural Network Approach Instructor
Single Image Dehazing using Ranking Convolutional Neural NetworkSingle Image Dehazing using Ranking Convolutional Neural Network
Similarity Learning with or without Convolutional Neural NetworkSimilarity Learning with or without Convolutional Neural Network
Fast Vehicle Detection with Lateral Convolutional Neural NetworkFast Vehicle Detection with Lateral Convolutional Neural Network
Intelligent Integration of Enterprise Convolutional Neural Network OutlineIntelligent Integration of Enterprise Convolutional Neural Network Outline
Stereo Matching by Training a Convolutional Neural NetworkStereo Matching by Training a Convolutional Neural Network