AI tool - help!
Author
Discussion

EdT

Original Poster:

5,197 posts

301 months

There seems to be a zillion tools to create anything like alien pigs flying through infinite galaxies etc etc.. but I want one which can simply revise a couple of words spoken in a client video I've shot (nothing malicious, they've just amends a product's price) . He's sat still ,talking to camera. Thought this would be easy!

Hoofy

78,825 posts

299 months

Depends on what you have access to but the simplest way might be to sample/clone his voice then when he's saying the new bit do a B-roll side on or looking over his shoulder at the interviewer or at his hands. You might need to throw in a few more B-roll sections of him so it just feels like it's that style of video. Could even do over the shoulder of the camera man, blurred people, focus on the video camera screen.

Mr Whippy

31,474 posts

258 months

Cut to product, and show price?

I’m pretty sure there’ll be a tool to do the voice recording n the first instance, and then do the video to match the voice, based on your video as reference.
No idea what they’ll be though.

I’m sure there are some good Reddit groups for this kinda thing.


I know in comfyUI there is an advanced live portrait type tool where you can fire in a video of you doing it, and it’ll take the image of someone else and make them do it the same.
That’d get you the video I think, but it might be a string of frames.
Voice, possibly something where you train a model (will be very fast), and then again you’d say it and process it to sound like your reference.

JoshSm

1,927 posts

54 months

Yesterday (00:02)
quotequote all
Have you got the audio?

Otherwise, use a tool to generate the audio, then another to lipsync the revised segment to the new audio?

Plenty of tools out there for both.