dmm: (Default)
simons.berkeley.edu/workshops/large-language-models-transformers

Youtube livestream (and, presumably, post-conference youtube recording) are available.

Some of the talks look really interesting.

Mastodon

Aug. 3rd, 2023 09:14 am
dmm: (Default)
I updated my Mastodon for the first time since I created it in November: dmm.dreamwidth.org/65045.html

It turns out I follow this cool account: arXiv Highlights AI/ML sigmoid.social/@arxiv@creative.ai

Twitter seems to gradually becoming somewhat less effective as a source of information; I should probably read Mastodon more...
dmm: (Default)
"The First Room-Temperature Ambient-Pressure Superconductor" arxiv.org/abs/2307.12008

discussion makes one to be cautiously hopeful: news.ycombinator.com/item?id=36864624

Meanwhile, JuliaCon has started at MIT.

Conferences

Jun. 3rd, 2023 08:54 am
dmm: (Default)
The details will be in comments (I have mixed feeling about all this).

I am seeing people talking about their talks being accepted for Strange Loop. It seems that this will be the last Strange Loop conference (I have no idea why).

Terence Tao is co-organizing "AI to Assist Mathematical Reasoning" online workshop (June 12-14).

Joint conference of "Algebra and Coalgebra in Computer Science" and "Mathematical Foundations of Programming Semantics" is on June 19-23 (free for those who participate online).
dmm: (Default)
These three days; non-interactive livestream; might be interesting or not.

Links in the comments.
dmm: (Default)
This week, Nov 17-18, Thu-Fri, 8am-11:45am Boston time, "Quantum physics and the first-person perspective": www.essentiafoundation.org/quantum-physics-and-the-first-person-perspective/seeing/

JuliaCon 2023, juliacon.org/2023/ the call for proposals is posted, deadline Dec 18: pretalx.com/juliacon2023/cfp


I've spent more quality time focusing of two breakthroughs in understanding the nature and the behavior of machine learning models which came from the "penumbra" of "prosaic alignment" start-ups and which I wrote about in my previous two posts.

"Grokking is (more or less) solved." I took brief notes between Oct 21 and Oct 23: github.com/anhinga/2022-notes/tree/main/Grokking-is-solved

"Generative autoregressive models are similators." I took extensive notes between Oct 5 and Oct 23: github.com/anhinga/2022-notes/tree/main/Generative-autoregressive-models-are-similators

I am continuing to develop thoughts related to these topics, I am going to gradually write more about those topics in the comments.

dmm: (Default)
github.com/google/learned_optimization - "Meta-learning optimizers and more with JAX"

This is used by various interesting papers including the famous "persistent evolution strategies" paper which I don't understand and "Gradients are Not All You Need" arxiv.org/abs/2111.05803 tempting paper.

Moreover, it is used by a super-interesting "Practical tradeoffs between memory, compute, and performance in learned optimizers" arxiv.org/abs/2203.11860 must-read paper, which is being published at the following conference lifelong-ml.cc/ (Conference on Lifelong Learning Agents - CoLLAs 2022, Aug 18-24)
dmm: (Default)
1st International Conference on Automated Machine Learning: automl.cc/

Follows ICML 2022 🇺🇦 icml.cc/ (one can attend virtually as well)

Neural Architecture Search is prominent and includes a competition: sites.google.com/view/zero-cost-nas-competition/home

The most notable keynote is by Jeff Clune, "AI-generating algorithms: the fastest path to AGI?"

dmm: (Default)
Workshops and minisymposia: July 19-26; main conference: July 27-29

juliacon.org/2022/

A more convenient schedule: pretalx.com/juliacon-2022/schedule/

dmm: (Default)
38th International Conference on Mathematical Foundations of Programming Semantics: www.cs.cornell.edu/mfps-2022/ (July 11-13; virtual participation was 10 dollars last time I checked)

The Genetic and Evolutionary Computation Conference, July 9-13 (Boston and virtual, I'll be attending virtually): gecco-2022.sigevo.org/HomePage (the least expensive way to attend virtually is to become an ACM SIGEVO Member, it's only $25, and then the attendance is free).


Sparsity in Neural Networks

Advancing Understanding and Practice


SNN Workshop 2022 (July 13, virtual, free registration): www.sparseneural.net/
 

dmm: (Default)
Yesterday, today, tomorrow (12 hours diff between that and US East Coast):

math.nie.edu.sg/isdt09/

math.nie.edu.sg/isdt09/programme/9th_ISDT_Program1.pdf

Free zoom; I am listening to some of this right now... Very nostalgic...

But... it's just too difficult (and they don't even seem to record).

In any case, that's the kind of "intelligent assistant" I want - a piece of software with which I could discuss a talk and a slide deck like one of those, and which would help me to understand the details of what's going on.
dmm: (Default)
research.samsung.com/sanw

Free registration, 9am-1pm USA East Coast Time each day

dmm: (Default)
The Tenth International Conference on Learning Representations (Virtual): iclr.cc
dmm: (Default)
The event in Russia is cancelled. Международный конгресс математиков в "Ленинграде" отменён.

The dates remain July 6 - July 14: www.mathunion.org/fileadmin/IMU/ICM2022/ICM_2022_statement.pdf

en.wikipedia.org/wiki/International_Congress_of_Mathematicians
dmm: (Default)
- JuliaCon 2021 (July 30)

- ML Collective Research Jam #3 (Aug 4)

- ML Collective Research Jam #4 (Sep 22)

- Stuttgart Julia Programming Language Meetup (Oct 23)
dmm: (Default)
agi-conference.org/

(Registration for online participation is free; a small fee if one wants to do it in person.)

This is not a "first-tier" AI conference, but this year has a larger number of interesting "external" keynote speakers than usual (perhaps, people are starting to feel that "artificial general intelligence" is no longer a far-in-the-future remote topic, but something becoming acutely relevant): Yoshua Bengio, Francois Chollet, Tomas Mikolov, Joseph Urban.

dmm: (Default)
Starts in 5 minutes:

msml21.github.io/

No registration is needed - they are just handling it in a relaxed fashion
dmm: (Default)
juliacon.org/2021/ and live.juliacon.org/

The talk schedule: pretalx.com/juliacon2021/schedule/ (the default is UTC time, I see that I can switch to New York)

If you register (free), this gives access to discord, gathertown, and hackaton.

I'll keep notes in the comments.

dmm: (Default)
JuliaCon this year is 8 days of workshops (July 20-27), following by 3 days of the main conference (July 28-30).

The list of workshops is here: juliacon.org/2021/workshops/

The most interesting for me is the workshop on the next generation of autodiff systems (July 27), "Diffractor: Next-Gen AD for Julia": pretalx.com/juliacon2021/talk/review/MJ7T9LXLXNDWHPW9WJN7SGTWU7L9QMJW

All workshops start at 10am United States East Coast time and last 3 hours, two parallel workshops each day; if you don't care about interactive real-time aspects, youtube recordings will be available...

Full schedule (UTC time default, can switch to US East Coast): pretalx.com/juliacon2021/schedule/

dmm: (Default)
I am very interested in sparsity in neural nets and I am super-happy that the community around sparsity is growing, and the first workshop on the subject had just taken place.

The key organizer is D.C.Mocanu; I did an experimental PyTorch project building upon his work a couple of years ago.

I learned about this via the ML Collective reading group mailing list. The links are in the comments.

Profile

dmm: (Default)
Dataflow matrix machines (by Anhinga anhinga)

December 2025

S M T W T F S
 123456
78910111213
141516 17181920
21222324252627
28293031   

Syndicate

RSS Atom

Most Popular Tags

Style Credit

Expand Cut Tags

No cut tags
Page generated Jan. 4th, 2026 01:48 am
Powered by Dreamwidth Studios