Data Preprocessing/ Weight Initialization

Data Preprocessing

1. Step 1 : Preprocess the data

Image 에서는 zero-centered 까지만 하는것이 보편적이다.

Feature의 Spatial한 정보들이 뭉게지기 때문

 

 

In practive for Images - zero center only

consider [32,32,3] images

 1. Subtract the mean image (e.g. AlexNet)

- mean image = mean([32,32,3] array)

 

2. Subtrace -pixel-wise mean (e.g. VGGNet)

 

 

Weight Initializat

https://reniew.github.io/13/

가중치 초기화 (Weight Initialization)