<?xml version="1.0" encoding="UTF-8"?>
<feed xmlns="http://www.w3.org/2005/Atom" xmlns:dw="https://www.dreamwidth.org">
  <id>tag:dreamwidth.org,2017-07-05:3235132</id>
  <title>Dataflow matrix machines (by Anhinga anhinga)</title>
  <subtitle>Dataflow matrix machines (by Anhinga anhinga)</subtitle>
  <author>
    <name>Dataflow matrix machines (by Anhinga anhinga)</name>
  </author>
  <link rel="alternate" type="text/html" href="https://dmm.dreamwidth.org/"/>
  <link rel="self" type="text/xml" href="https://dmm.dreamwidth.org/data/atom"/>
  <updated>2023-08-03T13:20:18Z</updated>
  <dw:journal username="dmm" type="personal"/>
  <entry>
    <id>tag:dreamwidth.org,2017-07-05:3235132:74583</id>
    <link rel="alternate" type="text/html" href="https://dmm.dreamwidth.org/74583.html"/>
    <link rel="self" type="text/xml" href="https://dmm.dreamwidth.org/data/atom/?itemid=74583"/>
    <title>Mastodon</title>
    <published>2023-08-03T13:20:18Z</published>
    <updated>2023-08-03T13:20:18Z</updated>
    <category term="conference"/>
    <category term="differentiable programming"/>
    <category term="artificial intelligence"/>
    <category term="sparsity"/>
    <category term="program synthesis"/>
    <category term="my talks"/>
    <category term="julia"/>
    <category term="compact ml models"/>
    <category term="twitter"/>
    <dw:security>public</dw:security>
    <dw:reply-count>2</dw:reply-count>
    <content type="html">I updated my Mastodon for the first time since I created it in November: &lt;a href="https://dmm.dreamwidth.org/65045.html"&gt;dmm.dreamwidth.org/65045.html&lt;/a&gt;&lt;br /&gt;&lt;br /&gt;It turns out I follow this cool account: &lt;span&gt;arXiv Highlights AI/ML &lt;a href="https://sigmoid.social/@arxiv@creative.ai"&gt;sigmoid.social/@arxiv@creative.ai&lt;/a&gt;&lt;br /&gt;&lt;br /&gt;Twitter seems to gradually becoming somewhat less effective as a source of information; I should probably read Mastodon more...&lt;br /&gt;&lt;/span&gt;&lt;br /&gt;&lt;br /&gt;&lt;img src="https://www.dreamwidth.org/tools/commentcount?user=dmm&amp;ditemid=74583" width="30" height="12" alt="comment count unavailable" style="vertical-align: middle;"/&gt; comments</content>
  </entry>
  <entry>
    <id>tag:dreamwidth.org,2017-07-05:3235132:66461</id>
    <link rel="alternate" type="text/html" href="https://dmm.dreamwidth.org/66461.html"/>
    <link rel="self" type="text/xml" href="https://dmm.dreamwidth.org/data/atom/?itemid=66461"/>
    <title>CodeGeeX, Riffusion, etc.</title>
    <published>2022-12-20T16:32:04Z</published>
    <updated>2022-12-23T23:56:16Z</updated>
    <category term="program synthesis"/>
    <category term="github copilot"/>
    <category term="artificial intelligence"/>
    <category term="computer art"/>
    <category term="computer music"/>
    <category term="ai art"/>
    <dw:security>public</dw:security>
    <dw:reply-count>7</dw:reply-count>
    <content type="html">CodeGeeX seems to be a reasonably competitive free and open source alternative to GitHub Copilot. It might be a good thing to be aware of (although we do have ChatGPT these days).&lt;br /&gt;&lt;br /&gt;Riffusion is a free and open source app which generates spectrograms via stable diffusion and converts them to music.&lt;br /&gt;&lt;br /&gt;Links are in the comments.&lt;br /&gt;&lt;br /&gt;&lt;img src="https://www.dreamwidth.org/tools/commentcount?user=dmm&amp;ditemid=66461" width="30" height="12" alt="comment count unavailable" style="vertical-align: middle;"/&gt; comments</content>
  </entry>
  <entry>
    <id>tag:dreamwidth.org,2017-07-05:3235132:65388</id>
    <link rel="alternate" type="text/html" href="https://dmm.dreamwidth.org/65388.html"/>
    <link rel="self" type="text/xml" href="https://dmm.dreamwidth.org/data/atom/?itemid=65388"/>
    <title>update on AI progress and AI safety</title>
    <published>2022-12-04T16:18:56Z</published>
    <updated>2022-12-04T16:18:56Z</updated>
    <category term="ai safety"/>
    <category term="program synthesis"/>
    <category term="artificial intelligence"/>
    <category term="technological singularity"/>
    <category term="transformers"/>
    <dw:security>public</dw:security>
    <dw:reply-count>8</dw:reply-count>
    <content type="html">AI-safety-wise, the write-up, &lt;a href="https://scottaaronson.blog/?p=6823" rel="bookmark" title="Permanent Link: My AI Safety Lecture for UT Effective Altruism"&gt;My AI Safety Lecture for UT Effective Altruism&lt;/a&gt; by Scott Aaronson is  very nice reasonably objective and theory-friendly overview of the current state of AI safety as a field of science.&lt;br /&gt;&lt;br /&gt;AI-progress-wise, ChatGPT based on roughly speaking GPT-3.5 has been released recently, with people doing tons of  interesting things with it, including meaningful writing and software  generation... This seems to be another major step-up.&lt;br /&gt;&lt;br /&gt;&lt;img src="https://www.dreamwidth.org/tools/commentcount?user=dmm&amp;ditemid=65388" width="30" height="12" alt="comment count unavailable" style="vertical-align: middle;"/&gt; comments</content>
  </entry>
  <entry>
    <id>tag:dreamwidth.org,2017-07-05:3235132:62501</id>
    <link rel="alternate" type="text/html" href="https://dmm.dreamwidth.org/62501.html"/>
    <link rel="self" type="text/xml" href="https://dmm.dreamwidth.org/data/atom/?itemid=62501"/>
    <title>Open source code generator (an alternative to OpenAI Codex)</title>
    <published>2022-08-09T03:13:17Z</published>
    <updated>2022-08-09T03:13:17Z</updated>
    <category term="understanding internals of ai"/>
    <category term="openai codex"/>
    <category term="transformers"/>
    <category term="github copilot"/>
    <category term="program synthesis"/>
    <category term="machine learning"/>
    <category term="artificial intelligence"/>
    <dw:security>public</dw:security>
    <dw:reply-count>6</dw:reply-count>
    <content type="html">&lt;a href="https://github.com/salesforce/CodeGen"&gt;github.com/salesforce/CodeGen&lt;/a&gt;&lt;br /&gt;&lt;br /&gt;One can also run one of these models via HuggingFace; it is based on &amp;quot;A Conversational Paradigm for Program Synthesis&amp;quot; paper, &lt;a href="https://arxiv.org/abs/2203.13474"&gt;arxiv.org/abs/2203.13474&lt;/a&gt;&lt;br /&gt;&lt;br /&gt;Someone has even created a fake GitHub Copilot based on that (useful for those who prefer VSCode): &lt;a href="https://github.com/moyix/fauxpilot"&gt;github.com/moyix/fauxpilot&lt;/a&gt;&lt;br /&gt;&lt;br /&gt;&lt;br /&gt;&lt;br /&gt;&lt;img src="https://www.dreamwidth.org/tools/commentcount?user=dmm&amp;ditemid=62501" width="30" height="12" alt="comment count unavailable" style="vertical-align: middle;"/&gt; comments</content>
  </entry>
  <entry>
    <id>tag:dreamwidth.org,2017-07-05:3235132:60734</id>
    <link rel="alternate" type="text/html" href="https://dmm.dreamwidth.org/60734.html"/>
    <link rel="self" type="text/xml" href="https://dmm.dreamwidth.org/data/atom/?itemid=60734"/>
    <title>GitHub Copilot general availability</title>
    <published>2022-06-22T03:20:15Z</published>
    <updated>2022-06-22T03:20:15Z</updated>
    <category term="program synthesis"/>
    <category term="github copilot"/>
    <category term="github"/>
    <dw:security>public</dw:security>
    <dw:reply-count>8</dw:reply-count>
    <content type="html">&lt;a href="https://github.blog/2022-06-21-github-copilot-is-generally-available-to-all-developers/"&gt;github.blog/2022-06-21-github-copilot-is-generally-available-to-all-developers/&lt;/a&gt;&lt;br /&gt;&lt;br /&gt;&amp;quot;We&amp;rsquo;re making GitHub Copilot, an AI pair programmer that suggests code in  your editor, generally available to all developers for $10 USD/month or  $100 USD/year. It will also be free to use for verified students and  maintainers of popular open source projects.&amp;quot;&lt;br /&gt;&lt;br /&gt;&lt;br /&gt;&lt;br /&gt;&lt;img src="https://www.dreamwidth.org/tools/commentcount?user=dmm&amp;ditemid=60734" width="30" height="12" alt="comment count unavailable" style="vertical-align: middle;"/&gt; comments</content>
  </entry>
  <entry>
    <id>tag:dreamwidth.org,2017-07-05:3235132:47121</id>
    <link rel="alternate" type="text/html" href="https://dmm.dreamwidth.org/47121.html"/>
    <link rel="self" type="text/xml" href="https://dmm.dreamwidth.org/data/atom/?itemid=47121"/>
    <title>OpenAI Codex (next generation) - it looks like we are finally "there"</title>
    <published>2021-08-12T15:35:14Z</published>
    <updated>2021-08-12T15:37:07Z</updated>
    <category term="openai codex"/>
    <category term="transformers"/>
    <category term="program synthesis"/>
    <dw:security>public</dw:security>
    <dw:reply-count>26</dw:reply-count>
    <content type="html">There was a live demo of the next generation of OpenAI&amp;nbsp;Codex code-generating software on August 10.&lt;br /&gt;&lt;br /&gt;My impression from it is that &amp;quot;we have finally arrived&amp;quot; - this is a programming tool which seems to be more useful than an extra entry-level software engineer on the team. This starts to address the key bottleneck of our times: our limited ability to create software.&lt;br /&gt;&lt;br /&gt;This was always my threshold: can we create an AI software which can be &amp;quot;hired instead of a junior software engineer&amp;quot;? That was the main temporal uncertainty for me: how long would it take to reach that level? It looks like this has been accomplished.&lt;br /&gt;&lt;br /&gt;We are rapidly approaching the situation when AI will actively participate in programming AI software, for better or for worse...&lt;br /&gt;&lt;br /&gt;OpenAI&amp;nbsp;Codex is now a part of OpenAI&amp;nbsp;API&amp;nbsp;(which is still a closed beta with a waitlist), and it will be possible to participate in an informal competition today from 10am Pacific time (1pm Eastern) till 1pm Pacific (4pm Eastern) and try it a bit.&lt;br /&gt;&lt;br /&gt;Links are in the comments.&lt;br /&gt;&lt;br /&gt;&lt;img src="https://www.dreamwidth.org/tools/commentcount?user=dmm&amp;ditemid=47121" width="30" height="12" alt="comment count unavailable" style="vertical-align: middle;"/&gt; comments</content>
  </entry>
  <entry>
    <id>tag:dreamwidth.org,2017-07-05:3235132:44860</id>
    <link rel="alternate" type="text/html" href="https://dmm.dreamwidth.org/44860.html"/>
    <link rel="self" type="text/xml" href="https://dmm.dreamwidth.org/data/atom/?itemid=44860"/>
    <title>GitHub Copilot ("we are getting there")</title>
    <published>2021-06-29T16:23:30Z</published>
    <updated>2021-06-29T16:26:46Z</updated>
    <category term="artificial intelligence"/>
    <category term="technological singularity"/>
    <category term="github copilot"/>
    <category term="program synthesis"/>
    <category term="transformers"/>
    <category term="openai codex"/>
    <dw:security>public</dw:security>
    <dw:reply-count>5</dw:reply-count>
    <content type="html">&lt;a href="https://github.blog/2021-06-29-introducing-github-copilot-ai-pair-programmer/"&gt;github.blog/2021-06-29-introducing-github-copilot-ai-pair-programmer/&lt;/a&gt;&lt;br /&gt;&lt;br /&gt;&amp;quot;Today, we are launching a technical preview of &lt;a href="http://copilot.github.com" target="_blank" rel="noopener"&gt;GitHub Copilot&lt;/a&gt;,  a new AI pair programmer that helps you write better code. GitHub  Copilot draws context from the code you&amp;rsquo;re working on, suggesting whole  lines or entire functions. It helps you quickly discover alternative  ways to solve problems, write tests, and explore new APIs without having  to tediously tailor a search for answers on the internet. As you type,  it adapts to the way you write code&amp;mdash;to help you complete your work  faster. &lt;p&gt;Developed in collaboration with OpenAI, GitHub Copilot is powered by  OpenAI Codex, a new AI system created by OpenAI. OpenAI Codex has broad  knowledge of how people use code and is significantly more capable than  GPT-3 in code generation, in part, because it was trained on a data set  that includes a much larger concentration of public source code. GitHub  Copilot works with a broad set of frameworks and languages, but this  technical preview works especially well for Python, JavaScript,  TypeScript, Ruby and Go.&amp;quot;&lt;br /&gt;&lt;br /&gt;If you are using Visual Studio Code often, it might make sense to try to sign-up for the technical preview phase...&lt;/p&gt;&lt;br /&gt;&lt;br /&gt;&lt;img src="https://www.dreamwidth.org/tools/commentcount?user=dmm&amp;ditemid=44860" width="30" height="12" alt="comment count unavailable" style="vertical-align: middle;"/&gt; comments</content>
  </entry>
</feed>
