← Quiz: Neural Networks from Scratch: all 10 questions
Quiz: Neural Networks from Scratch · Question 9 of 10
Which activation is the usual default for hidden layers in large modern networks?
Which activation is the usual default for hidden layers in large modern networks?
- A.Sigmoid
- B.Step function
- C.ReLU
- D.Softmax
Answer & explanation
Correct answer: ReLU
It is cheap and its gradient does not vanish for positive inputs.
Can you get the rest right without peeking?
Take the timed Quiz: Neural Networks from Scratch quiz free. Pass it to earn XP and count towards your certificate.
Start the quiz →