Should be able to harvest plenty of material from Twitch Sings, then. Or the "Made me shave my beard" video.
--Patrick
#12
Tinwhistler
from my reading, what people typically do for good results is find a video with a similar face already, and only replace the face. Since you're faking over an entire background, there's going to be obvious problems there with background warping when the head moves.
And celeb faces are easier because the more reference pictures with various expressions you can feed in, the better the deep fake...and celebs have a ton of possible reference photos on the web.
I need a reference video of someone singing it while facing a camera. The process composites a still photo onto this one reference video everybody's been passing around ->
I mean, I practically did. Beat Saber is just Unity. Once I did that, it was minimal effort to port them from there into VR Chat.
... and then the hard drive I had all that on died. But it's not like anybody was terribly interested then >_<
I mean, I practically did. Beat Saber is just Unity. Once I did that, it was minimal effort to port them from there into VR Chat.
... and then the hard drive I had all that on died. But it's not like anybody was terribly interested then >_<
Yeah. I saw Pokimane is trying to become a VTuber, and Crunchyroll is apparently collaborating with Hololive to make english VTubers, and that was my clue that this trend had peaked and it is all downhill from here
#34
GasBandit
Because I am apparently determined to embarrass both myself and Celt Z as much as humanly possible...
Who knew Dei's Twitch Sings archives would come in so "useful" eh...?
Okay, now this want to make me try this, maybe with a Moulin Rouge clip. Did you have to hunt for the clip?
Of course, then I have to figure out the program, and use a photo that isn't NIGHTMARE TEETH.
Okay, now this want to make me try this, maybe with a Moulin Rouge clip. Did you have to hunt for the clip?
Of course, then I have to figure out the program, and use a photo that isn't NIGHTMARE TEETH.
This app seems much more advanced as far as faces go. I made that Lucille Ball image using the same TEETH pic as the other ones.
The downside is it doesn't do replacement of the entire head, just face swaps.
You can provide your own gif or it has a built-in search on tenor, kind of like the desktop version of this forum has a dedicated button for searching gifs.
Almost all of the gifs I used I found inside the app itself by searching for keywords such as Billy Joel or redhead or Spaceballs.
Okay, now this want to make me try this, maybe with a Moulin Rouge clip. Did you have to hunt for the clip?
Of course, then I have to figure out the program, and use a photo that isn't NIGHTMARE TEETH.
A face has to be on screen for more than 5 frames for it to be considered a face, I think. It won't even let you try using a clip that has less than 5 frames at all.
I decided that in order to stop cluttering up the "New Pictures" and "Bring out Gifs" threads, I'd move all my stuff in here, since I can tell I'm not going to be stopping doing this for a minute
I showed these to Mr. Z and he's thoroughly disturbed, but he did bring up something I noticed, too; the weirdest ones are the ones that stretched my features to "fit" the model, like Britney. But you're also working off a photo, so that's to be expected. Oddly enough, the closest ones, proportion-wise, have been either WW or Mera.
I showed these to Mr. Z and he's thoroughly disturbed, but he did bring up something I noticed, too; the weirdest ones are the ones that stretched my features to "fit" the model, like Britney. But you're also working off a photo, so that's to be expected. Oddly enough, the closest ones, proportion-wise, have been either WW or Mera.
It's obviously not a perfect process... and finding videos/gifs with the proper physical proportions is often as important as the quality of the source picture. I've discarded a LOT of attempts that didn't work out. I know I said I had a ton of me-as-Danny-McBride failures, but if I put myself on someone who isn't as husky as me, it often ends up looking like I'm trying to deepfake Colin Farrell instead of myself.
#95
GasBandit
For example:
#96
Tinwhistler
your brad pitt turned out so much better than mine. But i make a nice Nick Cage.
I've only been using pictures of people who have posted pictures of themselves recently or have sent me pictures of themselves. It's been a long long time since Adam posted a picture of himself, and I don't know if he wants them dragged back up or not.
Anybody at all, for that matter, who would be agreeable to me using them in this, please do send me a picture of yourself looking straight at the camera with a neutral expression in front of a blank wall!
And if anybody decides they would rather not have me doing this with their face, also feel free to let me know and I will stop and take them down.
#118
Celt Z
Oh, is that why you had to use the photo with my nose at a weird angle? I was wondering why this thing always had it so strangely. I need to fix that.
I've tried using the other pictures you sent me, too, but IMO the outcomes look even less like you :/ I always try them first, though. But the Wonder Woman Race picture seems to usually produce the best results non-dame-de-yo, speaking, that is.
#120
Celt Z
Eh, if I ever have something better, I'll pass it along. I'm mostly just at the results, odd proportions and all.
I see enough of myself every day; I'm sure I don't need to see more
Besides, if you need a bald guy with a beard, there's a myriad of other choices on HF to choose from. And unfortunately, the only celebrities that suit my face aren't necessarily ones I'd want to insert myself into
Also DeepFaceLab wants to get its face data from a video, and I don't have access to high enough quality video of people other than myself, and even for myself, we get back to the problem of it being too time consuming, because to really work well it wants 20 minutes of you talking in every direction with every facial expression.
Meh, it's doing the weird nose thing again. But, Charlize!!
The other thing I've noticed with these is when the original subject has a "neutral face", it makes the photo person look kinda dead-eyed (for example, the Aeon Flux clip). I feel like these work best when always in motion.
Yeah, like I said before.. I tried using the other ones first, but the eyes just didn't look right. You might be on to something about the neutral face causing dead eyes.
#173
Celt Z
I think it's just one of the limits of the app. It's still fun as hell, though!
#174
GasBandit
The same company that makes this face swapping app also has a web version that only works on still images (and IMO, not quite as well).
Our app seamlessly swaps any face including those in statues, paintings, video games and also retains emotions of the face being transferred to. Try it!
reflect.tech
#175
GasBandit
Time to reinject a little nightmare fuel, The thread is getting to tame.
I get the feeling there's gonna be quite a bit more of that before we're done
#195
Dave
So what I'm hearing is up my storage since I'm still getting alerts that we're close. I've been hoping to not have to do it, but I think I don't have much of a choice now. Jerk.
#196
Bones
what im hearing is we better start chipping in if we are gonna make you host this....
#197
Tinwhistler
what's storage cost?
I was just thinking of this last night, actually.
#198
GasBandit
The thought had occurred to me as well. I can contribute to the bill for the space upgrade, too.
#199
Dave
It's not the cost that's been stopping me, frankly. It's the fact that we would probably have to move to another server, which is ALWAYS a pain in the ass. I think the way they are set up is that each server farm has X capabilities and if we wanted to add memory they'd move us instead of upgrading the server we're currently on. Which makes sense but is a huge headache for everyone involved.
#200
GasBandit
@Dave do you have a venmo set up? That'd probably be the easiest way to get funds to you.
And yeah, I understand that moving servers is a headache... but whatyagonnado, eh?
#201
PatrThom
Some day in the future, I fully expect we're gonna have to go dedi colo, I just know it.
--Patrick
#202
Dave
Guys, it's $7 more a month. It's not going to affect me.
...yes. Yes, that happens to be exactly what I'm intimating.
--Patrick
#205
GasBandit
I own a server already, and I have gigabit... But my isp blocks the normal http and https ports for residential customers. Probably for this exact reason.
#206
PatrThom
I own at least a few machines which could be purposed for it, but I live in rural-ville and have no contingency plan for if my ISP goes down, the power goes out, etc. Plus I'm away from home for 12hrs/day, so if something were to happen, the board would just sit there down for most of a day every time.
--Patrick
#207
Dave
My power goes out too frequently. Besides, I rent and will have to move at some point.
I'm disappointed they didn't use "Weapon of Choice" for they music. But oddly, the haircut and the suit make you look like a post-weightloss John Goodman.
I'm disappointed they didn't use "Weapon of Choice" for they music. But oddly, the haircut and the suit make you look like a post-weightloss John Goodman.
Well, that's partially my fault there. I was browsing through coub looking for deepfake fodder, and found that Christopher Walken clip, and they already had Bad Guy as the music, so I just left it. I could have changed it, but I didn't.
#242
drifter
It occurs to me that deepfakes would be a great way to test drive a new hairstyle.
Alright, alright, I guess we don't all appreciate Undertale.
#263
GasBandit
These next couple were too long for Coub (ReFace lets you do up to 15 seconds, Coub only does 10) so I had to fall back to gfycat. Down side of that one is they autoplay, but they enlarge way past their resolution and the sound handling isn't as good.
(They can still be saved though, by right-clicking and choosing save video as, if you're on firefox. Chrome is probably similar)
#264
GasBandit
One more Hermione gif for good measure. I think Keltsy will appreciate it.
#265
PatrThom
I was wondering when you’d get to Hermione.
And I assume your Iron Man villain’s name would actually be “Quiplash.”
—Patrick
#266
GasBandit
So I tried to put a face on a non-photographic medium...
... actually it kinda worked better than I thought it would.
#267
GasBandit
I was disappointed this one didn't come out as well as I'd hoped. Filters and special effects on the original medium seem to play hell with the face-swapping process.
Well, facial expression is part of it (and Celt Z's seems to fit smiling faces better, actually - at least she complains about her nose less when the subject is smiling - probably because the source photo I'm using of her is smiling), but another big part of it is dimensions, or more precisely, aspect ratio of the face. For example Jun didn't really fit well at all on Tila Tequila in Between Two Ferns. And I've referenced how faces of the wrong dimensions make me look like other actors, too. But also, I had to really pick my shot because I've found one thing that absolutely KILLS the program is if the subject moves something (a hand, a microphone, etc) in front of their face even briefly. The program doesn't deal well with that.
In unrelated news, my ability to deepfake will be severely curtailed this week because I'll be on the road and I don't have Adobe Premiere on my laptop. So I'll be limited to only the stuff provided within the reface app itself.
A still picture is all I need for this.... for the more advanced stuff, I need 20 minutes... with every possible phoneme, every possible facial expression, and every possible camera angle.
#301
GasBandit
This one is specially for @Emrys, who continues to try to inculcate me into this strange, guttural language.
I don't think anyone would want this. Sure, the house will be clean and you'll be well-fed, but I am going to sass the shit out of you. Probably, like, Rosie the Robot crossed with Peg Bundy, sans the smoking.
I don't think anyone would want this. Sure, the house will be clean and you'll be well-fed, but I am going to sass the shit out of you. Probably, like, Rosie the Robot crossed with Peg Bundy, sans the smoking.
shit..I already get that without the cooking and cleaning thrown in. It'd be a step up
#307
Celt Z
I asked Mr. Z to explain why this would be bad idea, and, I quote,
"I'M NOT ANSWERING THIS IT'S A TRAP" *picks up phone upside down* "OH HELLO WHAT'S THE PROBLEM HONEY I HAVE TO TAKE THIS BUSINESS BUSINESS BUSINESS".
Yeah, I agree completely. But like I said, I was limited to items supplied within the app itself, and the message conveyed by the lyrics seemed particularly apropos for making deepfakes
I asked Mr. Z to explain why this would be bad idea, and, I quote,
"I'M NOT ANSWERING THIS IT'S A TRAP" *picks up phone upside down* "OH HELLO WHAT'S THE PROBLEM HONEY I HAVE TO TAKE THIS BUSINESS BUSINESS BUSINESS".
I don't think anyone would want this. Sure, the house will be clean and you'll be well-fed, but I am going to sass the shit out of you. Probably, like, Rosie the Robot crossed with Peg Bundy, sans the smoking.
Just in case anyone was curious, here is what a failed deepfake looks like.
Emrys had suggested this scene for use with me and Celt Z, And I had plans to make more of a production of it, but my first test run is a complete failure. I guess the low lighting screws with its ability to detect faces.
#374
GasBandit
Similarly here. "Asps. Very dangerous. You go first."
The odd angles and the lighting just makes the process break down, unfortunately.
#375
PatrThom
Do you think it would help to blow out the original video, and then diff it back down afterwards? Or is that too much work?
I saw the first one and thought, "Aww, it's Cajun Z! *hears chorus*...oh no. Maybe not."
I also have a theory that the underware ones keep working best because whomever is filming makes sure the whole, almost naked body is shown and the face stays in better portion because the program can track it better. Or maybe the smaller face makes it less noticeable?
In any case, now that we know you're secretly Hagrid, you should have gone with the "I shouldn't have said that" clip for future use.
You can also use other sources so long as you turn them into GIFs. It's a real pain in the ass that Reface doesn't let you use mp4s as source material when it so clearly can be used as such, as evidenced by the dailies. (and also how much it lowers the resolution of what you use, most 640x360 images get shrunk down to something like 400x280 or something)
To be fair, the visor covers so much that Kevin might as well only have half a face.
--Patrick
#456
Tinwhistler
say hello to my little friend.
#457
GasBandit
Ha! Damn. Woke up earlier to me and got today's only good daily.
XD
#458
Tinwhistler
Deleted by youtube as "violating community standards". Even though it's an unlisted video. Strange.
Updated post to show coub instead. Unfortunately, it lost half the length when I moved it over there
Deleted by youtube as "violating community standards". Even though it's an unlisted video. Strange.
Updated post to show coub instead. Unfortunately, it lost half the length when I moved it over there
I've been trying to find things that involve more dudes (I swear 90% of coub is videos of ladies) so that I can include more faces, but it's hard... and then 90% of the ones with dudes don't pan out. This one has some oddness but it's the closest I've gotten in a while.
Yeah, that's the trick. Finding the right scene. It's often difficult because:
It can't have anybody in more than 45 degree profile
It can't have anybody looking too far up or down
It can't have anybody's face tilted 90 degrees or more
The camera has to show the faces fairly closely (most head-to-toe shots are too zoomed out to process the faces)
It can't have any special effects
Any hands or other obstructions passing in front of a face, even briefly, can screw everything up
It can't pan any faces into or out of the frame over time, or the effect will cut out as soon as it isn't recognizable as a full face anymore
And even with all that... sometimes it just doesn't look right.
#475
Celt Z
More dude stuff: Ghostbusters, MP and the Holy Grail (the scene arguing polictics and this forum, geez...), Kungfu Hustle, Pirates of the Carribean, Scott Pilgrim, Jaws, Star Trek, anything Kevin Smith.
I mean, I can see what I can do... but movies are often also problematic (remember what happened when I tried those Indiana Jones scenes)... and I also don't have time to rewatch 14 movies looking to piece together a patchwork of talking head scenes :/ I was hoping for more of suggestions like "The gozer scene from Ghostbusters" which I might look at trying though I worry the faces are too small for much of it.
#481
Celt Z
I didn't know if you were also using pre-existing gifs or you had to rip them yourself, i was just trying to think of directions to point you in.
Jesus and his partner come out ok, but Walter's glasses and Donny's distance pose problems.
#485
GasBandit
#486
Celt Z
Funny, that was the part that popped into my head when I suggested it.
#487
GasBandit
Ehhhh this one could have turned out better, I think... but I haven't seen the movie, so if there's another scene anyone would suggest, see if you can find me a youtube link maybe?
#488
GasBandit
Shaun of the Dead turned out to be a little too dynamic to work well, but Hot Fuzz did alright, except for that little bit where Angel looks down...