You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Similar to #346, we want to be able to set or change "$c_\text{cov}$".
Review possible ways:
make option 'CMA_on' (and 'CMA_rankone' and 'CMA_rankmu') versatile to be read in dynamically. They are already used to (re-)set the learning rate before the update.
call weights.finalize after self.sm.parameters(), i.e. after resetting the learning rate, (possibly conditioned to any of the multipliers have change)
The "correct" way to change $c_\text{cov}$, say by $\alpha$, is by re-computing $c_1, c_\mu, c_c$ from $\alpha\mu_w$ where $\alpha < 1 / \mu_w$ would need to be checked carefully?
Similar to #346, we want to be able to set or change "$c_\text{cov}$ ".
Review possible ways:
'CMA_on'(and'CMA_rankone'and'CMA_rankmu') versatile to be read in dynamically. They are already used to (re-)set the learning rate before the update.weights.finalizeafterself.sm.parameters(), i.e. after resetting the learning rate, (possibly conditioned to any of the multipliers have change)