Learned optimizers and related topics
Jul. 23rd, 2022 04:43 pm![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
dmmgithub.com/google/learned_optimization - "Meta-learning optimizers and more with JAX"
This is used by various interesting papers including the famous "persistent evolution strategies" paper which I don't understand and "Gradients are Not All You Need" arxiv.org/abs/2111.05803 tempting paper.
Moreover, it is used by a super-interesting "Practical tradeoffs between memory, compute, and performance in learned optimizers" arxiv.org/abs/2203.11860 must-read paper, which is being published at the following conference lifelong-ml.cc/ (Conference on Lifelong Learning Agents - CoLLAs 2022, Aug 18-24)
This is used by various interesting papers including the famous "persistent evolution strategies" paper which I don't understand and "Gradients are Not All You Need" arxiv.org/abs/2111.05803 tempting paper.
Moreover, it is used by a super-interesting "Practical tradeoffs between memory, compute, and performance in learned optimizers" arxiv.org/abs/2203.11860 must-read paper, which is being published at the following conference lifelong-ml.cc/ (Conference on Lifelong Learning Agents - CoLLAs 2022, Aug 18-24)
no subject
Date: 2022-07-29 05:20 pm (UTC)Очень красиво. Стоит поизучать.
no subject
Date: 2022-08-09 11:47 pm (UTC)https://github.com/JuliaObjects/Accessors.jl
https://juliaobjects.github.io/Accessors.jl/stable/getting_started/
*****
Оказывается, если код не понимаешь, то надо его набрать и начать отлаживать; тогда материал лучше ложится в голову, чем если просто читать код...
no subject
Date: 2022-08-10 01:28 am (UTC)Вот уж верно.
У вас уже оптика есть! Классно.