강의

멘토링

커뮤니티

Inflearn Community Q&A

chddhh7419's profile image
chddhh7419

asked

Complete mastery of deep learning theory + PyTorch practice

[Practice] Implementing Initialization with PyTorch

섹션12 실습코드 의 initialization 각각 적용 코드 문의

Written on

·

92

0

실습코드에서 초기화 각각 적용 부분

  self._init_weights(self.fc_layers[0], mode='kaiming')
        self._init_weights(self.fc_layers[1], mode='kaiming')
        self._init_weights(self.fc_layers[2], mode='xavier')

모델을 읽어보면

NeuralNetwork( (fc_layers): Sequential( (0): Linear(in_features=784, out_features=196, bias=True)

(1): ReLU()

(2): Linear(in_features=196, out_features=49, bias=True)

(3): ReLU()

(4): Linear(in_features=49, out_features=10, bias=True)

(5): Sigmoid() ) )

0, 2,4 번에 초기화를 적용해야 실제 작동을 할 것 같습니다.

 

딥러닝pytorchNLP컴퓨터-비전cnnrnntransformerllm

Answer

This question is waiting for answers
Be the first to answer!
chddhh7419's profile image
chddhh7419

asked

Ask a question