The Altair Community is migrating to a new platform to provide a better experience for you. In preparation for the migration, the Altair Community is on read-only mode from October 28 - November 6, 2024. Technical support via cases will continue to work as is. For any urgent requests from Students/Faculty members, please submit the form linked here

[SOLVED] Decay Rate of Neural Network

tektek Member Posts: 19 Contributor II
edited November 2018 in Help
Hey there,
quite simple question, for which I couldn't find an answer in any documentation or thread:

What is the decay rate of the learning rate if you activate the "decay" button on a neural network operator?

Thanks for the answer!

Answers

  • Nils_WoehlerNils_Woehler Member Posts: 463 Maven
    Hi,

    I'm afraid you are right. There is no documentation on how the decay influences the learning rate.
    I've just looked it up from the source code: In every learning iteration the learning rate is diveded by the number of learning iterations plus one. Thus it drops to 1/2, 1/3, 1/4, etc.. of the default learning rate.

    Best,
    Nils 
  • tektek Member Posts: 19 Contributor II
    Thanks a lot!
Sign In or Register to comment.