New integrated mode for GPT-4 in ChatGPT+

[dmm]

They switched me to the new integrated mode. This is supposed to have all kinds of upgrades, in particular it is possible to read and write images in one session.

I still don't know if it is possible to competently edit images via this workflow (I'll try, and I'll read what other people say, but it might be difficult without a more image-oriented input system). Nevertheless, just like in dmm.dreamwidth.org/76698.html I read my avatar icon I am using here and talk to the new GPT-4 about it, and then I ask it to produce images based on that, see the comments for conversation and images.

Comments

[dmm]

It is still the case that "Sharing conversations with images is not yet supported"

So I am just copy-pasting it here.

ME: uploading my dreamwidth avatar and asking: "What is in this image?"

GPT-4:

The image appears to be a schematic representation of a physics concept. Specifically, it looks like a diagram of an optical system involving ray tracing through lenses or a lens system.

Here’s a breakdown of what the diagram might represent:

* There are two sets of parallel lines that could represent two lenses or a system with a lens and a mirror.

* The lines with arrows might depict light rays.

* The light rays are converging or diverging, indicating the focal points of the lenses or mirrors.

* The "f" symbols represent the focal length, the distance between the center of a lens or mirror and its focal point.

* The curved line with two arrows might represent a lens that is focusing the parallel light rays to a point, or it could indicate a curved mirror doing the same.

This kind of diagram is used in optics to illustrate how light behaves as it passes through or reflects off optical components. It’s a fundamental tool in designing and understanding optical systems like cameras, telescopes, microscopes, and eyeglasses.

ME: I like your interpretation! Actually, this is a neural machine, where single neurons are powerful enough to transform flexible tree-shaped tensors. Can you make an image creatively inspired by this?

[dmm]

[dmm]

GPT-4: Here is the image creatively inspired by the concept of a neural machine where single neurons are powerful enough to transform flexible tree-shaped tensors. This visualization represents the intricate, high-tech workings of such a system.

(That's actually quite good.)

ME: Great, this is an awesome image! Now, can you try to remix it with the image I uploaded?

[dmm]

[dmm]

GPT-4: The image has been remixed with the elements from the schematic you uploaded, integrating the concept of a neural machine with the design features of the schematic.

(Mmmmm... may be... the question whether one can have good control over image creation process remains open.)

[dmm]

ME:

Great! What were the prompts you have sent to DALL-E for these two images?

GPT-4:

For the first image, the prompt sent to DALL-E was:

"Visualize a futuristic neural machine, where single neurons are depicted as intricate, metallic structures with branching, tree-like cables or conduits representing flexible tree-shaped tensors. These neurons are interconnected with glowing pathways of data flow, highlighting the transformation and processing power within a complex network. The entire scene should have a luminous, high-tech feel, with a clear sense of advanced computation and artificial intelligence at work. The background should be dark to contrast the bright, energy-filled connections of the neural network."

For the second image, the prompt was:

"Combine the concept of a neural machine with the schematic design from the user's uploaded image. The image should depict a fusion of the intricate, metallic tree-like structures representing neurons with the optical lens-like elements from the schematic. The neurons should have branching, flexible tensors interwoven with the schematic's lens and ray design, creating a harmonious blend of organic and structured elements. The entire composition should be illuminated with glowing pathways of data flow, set against a dark background to emphasize the complexity and elegance of this neural optical machine."

These prompts were designed to create a visual representation that merges the abstract concept of a neural network with the schematic structure you provided.