Skip to main content

How to conduct Hypothesis Testing step by step - simple and elegant (part 3)

Step by Step procedure in Conducting the Hypothesis Testing: prerequisites:   Part 1:  What is Hypothesis Testing and When it is Used? Part 2:  How to decide Null and Alternate Hypothesis?                    https://www.isixsigma.com/   Before diving into the steps, first let’s understand the Important Terminology we need to understand: Null Hypothesis: It is a well-established fact which is believed by all the people. It can also defined as an Assumption that treats everything equally and similarly. Alternate Hypothesis: It is a new claim made against the Null Hypothesis. If we have enough evidence against the Null Hypothesis we will reject Null Hypothesis. P-value: Probability of Null Hypothesis being true. Significance level: probability of rejecting the Null Hypothesis when it is true. It is a critical point where we decide whether the Null Hypothesis is rejected or not. Generally, the significant level will be 0.05 which means a 5 percent risk while concluding
Post a Comment

Simple Understanding of RESNET and it's Architecture (part 4)

      RESNET Architecture:        

        Prerequisites: 

        VGGNet OR VGG16 : VGG16 Architecture 

      DEVELOPED BY MICROSOFT ON 2015


PROBLEM OBSERVED: Regular Neural Networks has a problem that as number of layers increase, even after many epochs the train error and test error of 56 layered Neural Network is worse than the 20 layered Neural Network.

source:https://arxiv.org/pdf/1512.03385.pdf

Inorder to solve the above problem, The Microsoft team has come up with an idea known as residual unit or identity unit which have skip connection.

source:https://arxiv.org/pdf/1512.03385.pdf
Basic unit of ResNet Architecture.


The above unit is known as either Residual unit or Identity unit.

Here the key point is during regularization, if we have unimportant layers then we can avoid them with skip connection. so that there will be no impact on our network.

If we observe the above figure, we have two layers, If those both layers are useless then during regularization the weights become close to zero and it will effects the overall architecture. To avoid this kind of situation the skip connection has provided so that eventhough the layers are not useful we can able to skip and transfer the data efficiently to other layers.

After Introducing Residual unit, Lets look at the performance.    

source:https://arxiv.org/pdf/1512.03385.pdf


Wow, Great Innovation.

 Now lets look at the overall Architecture,

source:https://camo.githubusercontent.com

Advantages:

1.       Adding layers wouldn't hurt performance as regularization will skip over them.

2.       We can strongly believe that as layers increases performance will increase.

Disadvantages:

1.       Increased complexity in the Architecture.


Following Blogs might be helpful.

INCEPTION_V3:     INCEPTION V3
ALEXNET:               ALEXNET ARCHITECTURE

If you have any queries, please comment below...
For more content please follow the blogpost...

 


                                               





Comments

Post a Comment

Popular posts from this blog

How to conduct Hypothesis Testing step by step - simple and elegant (part 3)

Step by Step procedure in Conducting the Hypothesis Testing: prerequisites:   Part 1:  What is Hypothesis Testing and When it is Used? Part 2:  How to decide Null and Alternate Hypothesis?                    https://www.isixsigma.com/   Before diving into the steps, first let’s understand the Important Terminology we need to understand: Null Hypothesis: It is a well-established fact which is believed by all the people. It can also defined as an Assumption that treats everything equally and similarly. Alternate Hypothesis: It is a new claim made against the Null Hypothesis. If we have enough evidence against the Null Hypothesis we will reject Null Hypothesis. P-value: Probability of Null Hypothesis being true. Significance level: probability of rejecting the Null Hypothesis when it is true. It is a critical point where we decide whether the Null Hypothesis is rejected or not. Generally, the significant level will be 0.05 which means a 5 percent risk while concluding
Post a Comment
Read more

Simple Understanding of INCEPTION_V3 and it's Architecture (part 3)

INCEPTION_V3 Prerequisites:  VGGNet OR VGG16:  VGG16 Architecture   By looking it's name, everybody think's that it is a complicated story just like the movie INCEPTION. But trust me, I will prove you that it is wrong by explaining in the most detailed way. Till now, If we take a layer in any neural network we only applied single operation like convolution or maxpooling and also with fixed kernel size for the whole layer.  But Now, The idea is, why can't we use all the operations in a single layer at a time. There comes INCEPTION_V3. Lets zoom a single layer in the inception_v3, source: It's a screenshot from AndrewNg class If you observe the above figure, convolution operation with kernel sizes 1x1,3x3,5x5 and the max-pool operation, all have applied at a time. Here comes a problem, COMPUTATION. only from single layer we are getting billions of computations. For example, lets do a simple mathematical calculation here, Note: To understand this you need to know how conv
Post a Comment
Read more

Simple Understanding of VGG16 and it's Architecture (part 2)

Vgg16 Architecture:   Prerequisites:  ALEXNet  :  ALEXNet Architecture   * vgg refers to visual geometry group who has developed vgg16 architecture. * 16 refers to number of layers. VGG16 or VGGNet is a convolution neural network and it is a simplified and better version of Alexnet. Remembering Alexnet architecture is very difficult, Later on 2014, vgg16 came as an architecture and it is very simple to remember. VGG16 is very simple where:  ·   It is built on Convolution operations with fixed kernel_size=(3x3), padding=’same’, and stride=1 for all Convolution layers. ·     And also Maxpooling operation with pool_size=(2x2) and stride=2 for all Maxpool layers.       Let's see the architecture of vgg16 source:https://qph.fs.quoracdn.net/main-qimg-e657c195fc2696c7d5fc0b1e3682fde6 If you observe the figure, As said all convolution layers have 3x3 kernels and all maxpool layers have size of 2x2. Note 1: For maxpool layers the padding=‘valid’ which means there is no paddi
Post a Comment
Read more