• Home
  • AI News
  • AI Startups
  • Deep Learning
  • Interviews
  • Machine-Learning
  • Robotics

Subscribe to Updates

Get the latest creative news from FooBar about art, design and business.

What's Hot

Tsahy Shapsa, Co-Founder & Co-CEO at Jit – Cybersecurity Interviews

March 29, 2023

CMU Researchers Introduce Zeno: A Framework for Behavioral Analysis of Machine Studying (ML) Fashions

March 29, 2023

Mastering the Artwork of Video Filters with AI Neural Preset: A Neural Community Strategy

March 29, 2023
Facebook Twitter Instagram
The AI Today
Facebook Twitter Instagram Pinterest YouTube LinkedIn TikTok
SUBSCRIBE
  • Home
  • AI News
  • AI Startups
  • Deep Learning
  • Interviews
  • Machine-Learning
  • Robotics
The AI Today
Home»Robotics»CMU Researchers Create AI Robotic That Paints
Robotics

CMU Researchers Create AI Robotic That Paints

By February 24, 2023Updated:February 24, 2023No Comments3 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Reddit WhatsApp Email
Share
Facebook Twitter LinkedIn Pinterest WhatsApp Email


Researchers at Carnegie Mellon College’s Robotics Institute have developed a device referred to as FRIDA, which is a robotic arm with a paintbrush hooked up to it. The device leverages synthetic intelligence (AI) to work along with people on artwork tasks.

The group is about to current the analysis titled “FRIDA: A Collaborative Robotic Painter With a Differentiable, Real2Sim2Real Planning Setting” on the 2023 IEEE Worldwide Convention on Robotics and Automation in Could.

Peter Schaldenbrand is a Ph.D. pupil within the Robotics Institute on the College of Laptop Science. He works with FRIDA and explores AI and creativity.

“There’s this one portray of a frog ballerina that I feel turned out actually properly,” he stated. “It’s actually foolish and enjoyable, and I feel the shock of what FRIDA generated primarily based on my enter was actually enjoyable to see.”

FRIDA is an acronym for Framework and Robotics Initiative for Growing Arts. It’s named after Frida Kahlo.

The analysis was led by Schalderbrand, together with RI school members Jean Oh and Jim McCaam, and it has enticed college students and researchers from throughout CMU.

Collaborative Instrument Not Artist

Customers can information FRIDA by inputting a textual content description, submitting different artistic endeavors to encourage its fashion, or importing {a photograph} and asking it to color a illustration of it. The group can also be testing different inputs, resembling audio.

“FRIDA is a robotic portray system, however FRIDA will not be an artist,” Schalderbrand continued. “FRIDA will not be producing the concepts to speak. FRIDA is a system that an artist might collaborate with. The artist can specify high-level objectives for FRIDA after which FRIDA can execute them.”

To color a picture, the robotic makes use of AI fashions which might be corresponding to these powering OpenAI’s ChatGPT and DALL-E 2, which produce textual content or a picture in response to a immediate. FRIDA simulates how it might paint a picture with brush strokes and makes use of machine studying to evaluate its progress as it really works.

The top merchandise of FRIDA are whimsical and impressionistic. The brushstrokes are daring and lack the precision that’s continuously sought in robotic endeavors.

“FRIDA is a mission exploring the intersection of human and robotic creativity,” McCann added. “Frida is utilizing the sort of AI fashions which were developed to do issues like caption photographs and perceive scene content material and making use of it to this inventive generative downside.”

FRIDA makes use of AI and machine studying a number of occasions throughout its art-making course of. First, it spends an hour or extra studying how you can use its paintbrush. Then, it employs vision-language fashions which were educated on big datasets pairing textual content and pictures scraped from the web, resembling OpenAI’s Contrastive Language-Picture Pre-Coaching (CLIP), to know the enter.

One of the crucial important technical challenges in producing a bodily picture is lowering the simulation-to-real hole, which is the disparity between what FRIDA creates in simulation and what it paints on the canvas. FRIDA makes use of an concept referred to as real2sim2real, the place the robotic’s precise brush strokes are used to coach the simulator to replicate and mimic the bodily capabilities of the robotic and portray supplies.

FRIDA’s group now goals to deal with a few of the limitations in present massive vision-language fashions by frequently refining those they use. They fed the fashions headlines from information articles to supply them with a way of what was occurring on the planet and additional educated them on photographs and textual content which might be extra consultant of numerous cultures to keep away from an American or Western bias.

Related Posts

Tiny Robotic Might Assist Medical doctors Carry out Surgical procedure

March 3, 2023

Robotic Helps Youngsters With Studying Disabilities Keep Targeted

March 2, 2023

Are Legged Robots Secure within the Office?

February 9, 2023

Leave A Reply Cancel Reply

Trending
Interviews

Tsahy Shapsa, Co-Founder & Co-CEO at Jit – Cybersecurity Interviews

By March 29, 20230

Tsahy Shapsa is the Co-Founder & Co-CEO at Jit, a platform that that allows simplifying…

CMU Researchers Introduce Zeno: A Framework for Behavioral Analysis of Machine Studying (ML) Fashions

March 29, 2023

Mastering the Artwork of Video Filters with AI Neural Preset: A Neural Community Strategy

March 29, 2023

Databricks Open-Sources Dolly: A ChatGPT like Generative AI Mannequin that’s Simpler and Quicker to Practice

March 29, 2023
Stay In Touch
  • Facebook
  • Twitter
  • Pinterest
  • Instagram
  • YouTube
  • Vimeo
Our Picks

Tsahy Shapsa, Co-Founder & Co-CEO at Jit – Cybersecurity Interviews

March 29, 2023

CMU Researchers Introduce Zeno: A Framework for Behavioral Analysis of Machine Studying (ML) Fashions

March 29, 2023

Mastering the Artwork of Video Filters with AI Neural Preset: A Neural Community Strategy

March 29, 2023

Databricks Open-Sources Dolly: A ChatGPT like Generative AI Mannequin that’s Simpler and Quicker to Practice

March 29, 2023

Subscribe to Updates

Get the latest creative news from SmartMag about art & design.

Demo

The Ai Today™ Magazine is the first in the middle east that gives the latest developments and innovations in the field of AI. We provide in-depth articles and analysis on the latest research and technologies in AI, as well as interviews with experts and thought leaders in the field. In addition, The Ai Today™ Magazine provides a platform for researchers and practitioners to share their work and ideas with a wider audience, help readers stay informed and engaged with the latest developments in the field, and provide valuable insights and perspectives on the future of AI.

Our Picks

Tsahy Shapsa, Co-Founder & Co-CEO at Jit – Cybersecurity Interviews

March 29, 2023

CMU Researchers Introduce Zeno: A Framework for Behavioral Analysis of Machine Studying (ML) Fashions

March 29, 2023

Mastering the Artwork of Video Filters with AI Neural Preset: A Neural Community Strategy

March 29, 2023
Trending

Databricks Open-Sources Dolly: A ChatGPT like Generative AI Mannequin that’s Simpler and Quicker to Practice

March 29, 2023

Can Synthetic Intelligence Match Human Creativity? A New Examine Compares The Technology Of Authentic Concepts Between People and Generative Synthetic Intelligence Chatbots

March 28, 2023

Nvidia Open-Sources Modulus: A Recreation-Altering Bodily Machine Studying Platform for Advancing Bodily Synthetic Intelligence Modeling

March 28, 2023
Facebook Twitter Instagram YouTube LinkedIn TikTok
  • About Us
  • Contact Us
  • Privacy Policy
  • Terms
  • Advertise
  • Shop
Copyright © MetaMedia™ Capital Inc, All right reserved

Type above and press Enter to search. Press Esc to cancel.