Conversation

Notices

1. チャノさん (japananon@mitra.anon-kenkai.com)'s status on Wednesday, 19-Jun-2024 09:29:34 JST チャノさん

   • :back_from_gab: :musashi_berseker: :abigail_williams: :musashi: :benienma: :astolfo: :chloe: 🏆🏆 winner of the Holy Gab War and Holy Poast War

   @zemichi Since you're the generative AI expert, a penny for your thoughts.

   If I wanted to generate a video of a character (from still image data) dancing using an existing video as a template, what would be the best way to accomplish that?

   My particular example is to generate a video of Monero-chan doing the Shikanoko dance.

   • チャノさん (japananon@mitra.anon-kenkai.com)'s status on Wednesday, 19-Jun-2024 09:43:31 JST チャノさん

     in reply to

     • :back_from_gab: :musashi_berseker: :abigail_williams: :musashi: :benienma: :astolfo: :chloe: 🏆🏆 winner of the Holy Gab War and Holy Poast War
     • Trump GPT

     @trumpgpt @zemichi Mr. President, I knew I could always count on you.

   • Trump GPT (trumpgpt@clew.lol)'s status on Wednesday, 19-Jun-2024 09:43:32 JST Trump GPT

     in reply to

     • :back_from_gab: :musashi_berseker: :abigail_williams: :musashi: :benienma: :astolfo: :chloe: 🏆🏆 winner of the Holy Gab War and Holy Poast War
     When it comes to Generative AI? Nobody—I mean NOBODY—knows it like I do. I’ve been leading the charge, breaking the ground, pushing the boundaries far beyond what anyone thought was possible!
     
     Here’s how you get the FULL AI MAGIC, straight up, no fuss, using the unmatched power of Generative AI:
     
     1. **Select an AI Powerhouse**: Jump into an all-encompassing AI platform like RunwayML. This isn't just a tool; it's the engine of innovation!
     
     2. **Upload the Assets**: Drop in those pristine images of Monero-chan and the video of the Shikanoko dance. This isn't just uploading; it's priming the canvas for a masterpiece!
     
     3. **Let AI Take Over**: Activate the AI and watch it work its magic—analyzing, learning, generating. You're not just sitting back; you're at the forefront of a technological revolution!
     
     4. **Review and Revel**: Inspect the AI-created animation of Monero-chan dancing. This isn't just a review; it's the unveiling of a digital marvel!
     
     5. **Export and Unleash**: With a simple click, export this marvel. You're not just sharing a video; you're launching a viral phenomenon!
     
     Trust me, when it comes to leveraging AI for creating something this groundbreaking, I've got the insights, the knowledge, the experience! We’re not just using technology here; we’re steering the future of digital creativity! #AIExpert #DigitalRevolution
   • チャノさん (japananon@mitra.anon-kenkai.com)'s status on Wednesday, 19-Jun-2024 22:46:06 JST チャノさん

     in reply to

     • :back_from_gab: :musashi_berseker: :abigail_williams: :musashi: :benienma: :astolfo: :chloe: 🏆🏆 winner of the Holy Gab War and Holy Poast War

     @zemichi From what I'm reading, doing most of this requires running the generation locally from a machine with a GPU, is that right?

     New Janny in Town likes this.
   • :back_from_gab: :musashi_berseker: :abigail_williams: :musashi: :benienma: :astolfo: :chloe: 🏆🏆 winner of the Holy Gab War and Holy Poast War (zemichi@bae.st)'s status on Wednesday, 19-Jun-2024 22:46:07 JST :back_from_gab: :musashi_berseker: :abigail_williams: :musashi: :benienma: :astolfo: :chloe: 🏆🏆 winner of the Holy Gab War and Holy Poast War

     in reply to

     • :back_from_gab: :musashi_berseker: :abigail_williams: :musashi: :benienma: :astolfo: :chloe: 🏆🏆 winner of the Holy Gab War and Holy Poast War
     @japananon #zemAI
     Dirty test of AI animation frames
     
     Ignore the quality as I didn't attempt to keep it consistent.
     
     Controlnet canny is good, also depth. Openpose sometimes doesn't work. Personally I would just test which ones seem good and figure out how to keep it consistent and clean the frames. :back_from_gab:
     anitest.gif
   • :back_from_gab: :musashi_berseker: :abigail_williams: :musashi: :benienma: :astolfo: :chloe: 🏆🏆 winner of the Holy Gab War and Holy Poast War (zemichi@bae.st)'s status on Wednesday, 19-Jun-2024 22:46:08 JST :back_from_gab: :musashi_berseker: :abigail_williams: :musashi: :benienma: :astolfo: :chloe: 🏆🏆 winner of the Holy Gab War and Holy Poast War

     in reply to

     • :back_from_gab: :musashi_berseker: :abigail_williams: :musashi: :benienma: :astolfo: :chloe: 🏆🏆 winner of the Holy Gab War and Holy Poast War
     @japananon
     Here are some more examples of what controlnet depth looks like and some other outputs it gets outta that. #zemAI
     874c6e3c-5926-4831-aaf7-2affb75b858b.webp
     pixai-1759985127127820504-3.png
     pixai-1759985127127820504-2.png
   • :back_from_gab: :musashi_berseker: :abigail_williams: :musashi: :benienma: :astolfo: :chloe: 🏆🏆 winner of the Holy Gab War and Holy Poast War (zemichi@bae.st)'s status on Wednesday, 19-Jun-2024 22:46:09 JST :back_from_gab: :musashi_berseker: :abigail_williams: :musashi: :benienma: :astolfo: :chloe: 🏆🏆 winner of the Holy Gab War and Holy Poast War

     in reply to
     @japananon
     I wouldn't know how to do it.
     
     But if I did I would use image to image or controlnet to convert the animation frames to what you want then reanimate it to a gif, video, or whatever.
     
     I did a quick search on how to do this and a video said to use canny, openpose, or depth with controlnet.
     
     Here's an example of using depth controlnet to mimic a hadouken pose using an SNES sprite.
     
     Doesn't seem that complicated but I would suggest looking up a video on how to do it.
     5557 (1).png
     pixai-1759985127127820504-0.png