Dataflow matrix machines (by Anhinga anhinga)

Mastodon

Thu, 03 Aug 2023 13:20:18 GMT

I updated my Mastodon for the first time since I created it in November: dmm.dreamwidth.org/65045.html

It turns out I follow this cool account: arXiv Highlights AI/ML sigmoid.social/@arxiv@creative.ai

Twitter seems to gradually becoming somewhat less effective as a source of information; I should probably read Mastodon more...

comments

GPT-4 всё понимает

Sun, 26 Mar 2023 02:32:57 GMT

Попросил её проанализировать 200 с хвостиком строк кода, удалив практически все комментарии.

Меня поразило, что она сделала правильное обобщение, о чём эта программа:

The main idea of this program is to implement a neural network-like engine using nested dictionaries and custom-defined mathematical operations, allowing for flexible and extensible data processing.

Ну, то есть, там, в именах переменных используются слова типа to_neuron, from_neuron, neuron_name и activation_functions, но всё равно круто...

comments

Conferences; research updates

Thu, 17 Nov 2022 01:44:04 GMT

This week, Nov 17-18, Thu-Fri, 8am-11:45am Boston time, "Quantum physics and the first-person perspective": www.essentiafoundation.org/quantum-physics-and-the-first-person-perspective/seeing/

JuliaCon 2023, juliacon.org/2023/ the call for proposals is posted, deadline Dec 18: pretalx.com/juliacon2023/cfp

I've spent more quality time focusing of two breakthroughs in understanding the nature and the behavior of machine learning models which came from the "penumbra" of "prosaic alignment" start-ups and which I wrote about in my previous two posts.

"Grokking is (more or less) solved." I took brief notes between Oct 21 and Oct 23: github.com/anhinga/2022-notes/tree/main/Grokking-is-solved

"Generative autoregressive models are similators." I took extensive notes between Oct 5 and Oct 23: github.com/anhinga/2022-notes/tree/main/Generative-autoregressive-models-are-similators

I am continuing to develop thoughts related to these topics, I am going to gradually write more about those topics in the comments.

comments

JuliaCon 2022

Sat, 16 Jul 2022 00:11:03 GMT

Workshops and minisymposia: July 19-26; main conference: July 27-29

juliacon.org/2022/

A more convenient schedule: pretalx.com/juliacon-2022/schedule/

comments

"JAX vs Julia (vs PyTorch)"

Mon, 09 May 2022 14:38:22 GMT

kidger.site/thoughts/jax-vs-julia/

Various correspondencies between JAX and Julia constructions he is listing there are quite useful for people practicing either JAX or Julia.

(I am having good time with both JAX and Julia this year.)

comments

SciMLCon all day today (free registration)

Wed, 23 Mar 2022 13:02:46 GMT

Or you can just watch it here: www.youtube.com/watch?v=NSIAfccnq-0

scimlcon.org/2022/

comments

Erasing the difference between symbolic computing and compiler optimizations in Julia

Thu, 06 Jan 2022 03:27:15 GMT

Chris Rackauckas says: "In 2022, the difference between symbolic computing and compiler optimizations will be erased in Julia. Anyone who can come up with a set of symbolic mathematical rules will automatically receive an optimized compiler pass to build better code."

Details in the comments.

comments

Julia v1.7.0 has been released

Wed, 01 Dec 2021 04:37:19 GMT

julialang.org/blog/2021/11/julia-1.7-highlights/

Julia 1.6 is the new LTS (long-term support), instead of Julia 1.0 which is no longer maintained.

comments

GitHub is down - wow, how inconvenient

Sat, 27 Nov 2021 22:19:45 GMT

73 million developer accounts, 100 million repositories, and plenty of processes depending on GitHub being up...

I created this rather interesting color thing a few days ago and committed it and the Julia notebook which generated it

and now I continued this line of thinking and made another one (and a much cleaner version of code)

and hoped to commit it as well, but...

UPDATE: GitHub is fixed: github.com/anhinga/late-2021-julia-drafts/tree/main/color-motifs

comments

"Julia program to a standalone executable"

Fri, 05 Nov 2021 12:42:19 GMT

Last spring I could not figure out how to make a standalone executable in Julia. Which was not good (this prevented me from submitting an entry to a demo party).

Finally, someone has posted detailed instructions for Windows (likely to work on other platforms, but not tested), and they contain steps that I had no idea about:

www.linkedin.com/pulse/julia-program-standalone-executable-anders-persson/

comments

Recent presentations

Sun, 24 Oct 2021 04:43:22 GMT

- JuliaCon 2021 (July 30)

- ML Collective Research Jam #3 (Aug 4)

- ML Collective Research Jam #4 (Sep 22)

- Stuttgart Julia Programming Language Meetup (Oct 23)

comments

Dictionaries with array-like interface

Tue, 03 Aug 2021 19:13:59 GMT

This low-key talk might have been the single most useful talk of the whole JuliaCon 2021:

Dictionaries.jl - for improved productivity and performance

pretalx.com/juliacon2021/talk/WRNAEN/

and live.juliacon.org/talk/WRNAEN (that is, www.youtube.com/watch?v=Y-hAZcqAw28)

github.com/andyferris/Dictionaries.jl

I am going to recall my recent brushes with advanced dictionaries (and with their reshaping into arrays) in the comments.

comments

JuliaCon 2021: the main part starts now

Wed, 28 Jul 2021 12:24:07 GMT

juliacon.org/2021/ and live.juliacon.org/

The talk schedule: pretalx.com/juliacon2021/schedule/ (the default is UTC time, I see that I can switch to New York)

If you register (free), this gives access to discord, gathertown, and hackaton.

I'll keep notes in the comments.

comments

JuliaCon workshops

Sat, 17 Jul 2021 01:00:07 GMT

JuliaCon this year is 8 days of workshops (July 20-27), following by 3 days of the main conference (July 28-30).

The list of workshops is here: juliacon.org/2021/workshops/

The most interesting for me is the workshop on the next generation of autodiff systems (July 27), "Diffractor: Next-Gen AD for Julia": pretalx.com/juliacon2021/talk/review/MJ7T9LXLXNDWHPW9WJN7SGTWU7L9QMJW

All workshops start at 10am United States East Coast time and last 3 hours, two parallel workshops each day; if you don't care about interactive real-time aspects, youtube recordings will be available...

Full schedule (UTC time default, can switch to US East Coast): pretalx.com/juliacon2021/schedule/

comments

Interesting Julia

Sun, 11 Jul 2021 14:12:04 GMT

This sounds very close to some of the things I was playing with recently (differentiable image warps with interpolations and such), but probably done in a more professional manner (for example, resulting in pull requests to a library everyone uses, making a *.jl repository, etc.):

somtambe.github.io/blogs/jsoc_blog_2/

Remarkably enough, I learned about this from someone liking it in LinkedIn and thus placing it to my LinkedIn feed. I guess I was successful in convincing LinkedIn that my interests are centered around Julia.

comments