shipping container construction carnegie mellon

AI systems use these models to generate new text or images based on a prompt. Then, it uses large vision-language models trained on massive datasets that pair text and images scraped from the internet, such as OpenAI’s Contrastive Language-Image Pre-Training (CLIP), to understand the input. First, it spends an hour or more learning how to use its paintbrush. “FRIDA is using the kind of AI models that have been developed to do things like caption images and understand scene content and applying it to this artistic generative problem.”įRIDA taps into AI and machine learning several times during its artistic process. “FRIDA is a project exploring the intersection of human and robotic creativity,” McCann says.

If FRIDA makes a mistake, it riffs on it, incorporating the errant splotch of paint into the end result. They lack the precision sought so often in robotic endeavors. FRIDA simulates how it would paint an image with brush strokes and uses machine learning to evaluate its progress as it works.įRIDA’s final products are impressionistic and whimsical. The robot uses AI models similar to those powering tools like OpenAI’s ChatGPT and DALL-E 2, which generate text or an image, respectively, in response to a prompt. The artist can specify high-level goals for FRIDA and then FRIDA can execute them.” FRIDA is a system that an artist could collaborate with. “FRIDA is not generating the ideas to communicate. “FRIDA is a robotic painting system, but FRIDA is not an artist,” Schaldenbrand says.

They played ABBA’s “Dancing Queen” and asked FRIDA to paint it. The team is experimenting with other inputs as well, including audio. Users can direct FRIDA by inputting a text description, submitting other works of art to inspire its style, or uploading a photograph and asking it to paint a representation of it.

Shipping container construction carnegie mellon