Entries tagged with program synthesis

Entry tags:

Mastodon

I updated my Mastodon for the first time since I created it in November: dmm.dreamwidth.org/65045.html

It turns out I follow this cool account: arXiv Highlights AI/ML sigmoid.social/@arxiv@creative.ai

Twitter seems to gradually becoming somewhat less effective as a source of information; I should probably read Mastodon more...

Entry tags:

CodeGeeX, Riffusion, etc.

CodeGeeX seems to be a reasonably competitive free and open source alternative to GitHub Copilot. It might be a good thing to be aware of (although we do have ChatGPT these days).

Riffusion is a free and open source app which generates spectrograms via stable diffusion and converts them to music.

Links are in the comments.

Entry tags:

update on AI progress and AI safety

AI-safety-wise, the write-up, My AI Safety Lecture for UT Effective Altruism by Scott Aaronson is very nice reasonably objective and theory-friendly overview of the current state of AI safety as a field of science.

AI-progress-wise, ChatGPT based on roughly speaking GPT-3.5 has been released recently, with people doing tons of interesting things with it, including meaningful writing and software generation... This seems to be another major step-up.

Entry tags:

Open source code generator (an alternative to OpenAI Codex)

github.com/salesforce/CodeGen

One can also run one of these models via HuggingFace; it is based on "A Conversational Paradigm for Program Synthesis" paper, arxiv.org/abs/2203.13474

Someone has even created a fake GitHub Copilot based on that (useful for those who prefer VSCode): github.com/moyix/fauxpilot

Entry tags:

GitHub Copilot general availability

github.blog/2022-06-21-github-copilot-is-generally-available-to-all-developers/

"We’re making GitHub Copilot, an AI pair programmer that suggests code in your editor, generally available to all developers for $10 USD/month or $100 USD/year. It will also be free to use for verified students and maintainers of popular open source projects."

Entry tags:

OpenAI Codex (next generation) - it looks like we are finally "there"

There was a live demo of the next generation of OpenAI Codex code-generating software on August 10.

My impression from it is that "we have finally arrived" - this is a programming tool which seems to be more useful than an extra entry-level software engineer on the team. This starts to address the key bottleneck of our times: our limited ability to create software.

This was always my threshold: can we create an AI software which can be "hired instead of a junior software engineer"? That was the main temporal uncertainty for me: how long would it take to reach that level? It looks like this has been accomplished.

We are rapidly approaching the situation when AI will actively participate in programming AI software, for better or for worse...

OpenAI Codex is now a part of OpenAI API (which is still a closed beta with a waitlist), and it will be possible to participate in an informal competition today from 10am Pacific time (1pm Eastern) till 1pm Pacific (4pm Eastern) and try it a bit.

Links are in the comments.

Entry tags:

GitHub Copilot ("we are getting there")

github.blog/2021-06-29-introducing-github-copilot-ai-pair-programmer/

"Today, we are launching a technical preview of GitHub Copilot, a new AI pair programmer that helps you write better code. GitHub Copilot draws context from the code you’re working on, suggesting whole lines or entire functions. It helps you quickly discover alternative ways to solve problems, write tests, and explore new APIs without having to tediously tailor a search for answers on the internet. As you type, it adapts to the way you write code—to help you complete your work faster.

Developed in collaboration with OpenAI, GitHub Copilot is powered by OpenAI Codex, a new AI system created by OpenAI. OpenAI Codex has broad knowledge of how people use code and is significantly more capable than GPT-3 in code generation, in part, because it was trained on a data set that includes a much larger concentration of public source code. GitHub Copilot works with a broad set of frameworks and languages, but this technical preview works especially well for Python, JavaScript, TypeScript, Ruby and Go."

If you are using Visual Studio Code often, it might make sense to try to sign-up for the technical preview phase...