My thoughts on the backgrounds which have NPCs around, the best thing would probably be for someone to extract the 3d models of those characters and manually put them into the scene.
How about you put the work you've already done into a repo, and let other's have a go?
I feel it's a shame to put the entire project on hold just because of these scenes.
other's may have some ideas on how to solve the problem :)
Holy fuuuuck that looks great! :-o
Regarding the masking, Im' asuming the blocky edges comes from the auto generator? The waifu packs also have them, but they're kinda rounded off.
But I actually think it looks better with these clear blocks, instead of the HQ2X looking edges.
Is it possible to manually touch up the alpha edges? Cause this is an issue in all games with prerendered backgrounds.
It's also an issue with the other waifu upscaled packs. Some areas have really bad masking. Much much worse than I can see here
That looks really good! But it looks like it always has issues with diagonal edges though. There's never a straight line. Wonder if one can code the behavior of these parameters.
But it has to be automated at some point, so it might be wise to not obsess over things you can't really control :D Haha
Is it possible to manually touch everything up? I understand that it might take years to do, but is it possible? :p
Btw, over at the Angelwing thread on the upscaled backgrounds, FanSH posted the backgrounds slightly scaled up and pixellated. That makes everything look much more authentic. Even with the waifu upscaling. Have you tried that out with these?
I just use bicubic resize 25% then use my ff7 vb6 tool to generate this mask, all done with potrace and imagemagik.
If it's helping you ^^
If it's helping you ^^
Just a question, in order to actually edit these alpha layers, would I need specific software to do that? I've noticed the image files are in a weird blocky format, I guess that's what the hashmaps are for?
I was thinking, I'm quite efficient with Photoshop, as I'm an artist myself. And I don't really mind monkeywork like that, manually touching up tiny details :)
Alteast touching up on the worse alpha maps in specific scenes
Going over masks hand by hand will take months and you may end up with seam problems if the overlay isn't matching up.
@blippyp If you want, send me one complete Field with all the Layers, I'll go over my method and send them back to you. After that you can decide if that would be the better way to persue.
If it's helping you ^^
@blippyp If you want, send me one complete Field with all the Layers, I'll go over my method and send them back to you. After that you can decide if that would be the better way to persue.
I don't know if you came up with this process on your own, but buddy, if you did - my hat's off to you. You got mad skills with image manipulation and I thank you for sharing them. :)Thanks.
...
I still need to implement this into my process, but I'd say my masking issues are solved, this is awesome. I don't know how you figured this mess out, but it works pretty darn good.
....
I need to tweak my tools a bit as FFVIII is a bit different then IX, but still, give it a try.
Tell me what you think of the masks.
Thanks.
Yes it's a full process on my own.
By the may i think anyone how realy master imagemagik can probably do the same with less steps and without potrace, i just use many steps because it was easyer for me to understand and debug ^^, so no mastering but some try and die and RTFM of imagemagik ^^.
To avoid black pixels masking issues i merge potrace with a 400% un-interpoled mask, If ff8 don't need this you can try out without de 400% mask merged and the result will be even better.
To my mind, sharing skills is the most important part of the life, is anyone can share is skill freely, the workd will be realy better than it is now ....
@echo off
set infile=%1
set blackImage=%2
set workArea=workArea
set bwavector=%workArea%\bwavector.bmp
set eps=%workArea%\bwavector.eps
set vector4x=%workArea%\vector4x.bmp
set vector4xblack=%workArea%\vector4xblack.png
set raw4x=%workArea%\raw4x.png
set raw4xcoupe=%workArea%\raw4xcoupe.png
set raw4xmix=%workArea%\raw4xmix.png
set raw4xbackmix=%workArea%\raw4xbackmix.png
set fullblack=%workArea%\fullblack.png
set calquedecoupe=%workArea%\calquedecoupe.png
set box25p=%workArea%\box25p.png
set x4novi=%workArea%\x4novi.png
set combi=%workArea%\combi.png
set mask=mask.png
cmd.exe /c start /B /wait /low " " convert -fill black -colorize 100%% -flatten %infile% %bwavector%
cmd.exe /c start /B /wait /low " " potrace --turdsize 0 %bwavector% -o %eps%
cmd.exe /c start /B /wait /low " " convert -density 288 -background #FF00FF -channel alpha -threshold 70%% -alpha remove -flatten %eps% %vector4x%
cmd.exe /c start /B /wait /low " " convert +transparent #000000 %vector4x% %vector4xblack%
cmd.exe /c start /B /wait /low " " convert -scale 400%% -background #FF00FF -alpha remove -alpha off -fill black +opaque #FF00FF %infile% %raw4x%
cmd.exe /c start /B /wait /low " " convert +transparent #FF00FF %raw4x% %raw4xcoupe%
cmd.exe /c start /B /wait /low " " composite -gravity center %raw4xcoupe% %blackImage% %raw4xmix%
cmd.exe /c start /B /wait /low " " convert -alpha remove -alpha off +transparent black %raw4xmix% %raw4xbackmix%
cmd.exe /c start /B /wait /low " " composite -gravity center %raw4xbackmix% %vector4xblack% %fullblack%
cmd.exe /c start /B /wait /low " " convert -background #FF00FF -alpha remove -alpha off -transparent #000000 %fullblack% %calquedecoupe%
cmd.exe /c start /B /wait /low " " convert -define png:format=png32 -fuzz 01%% -fill #FE00FE -opaque #FF00FF %blackImage% %x4novi%
rem cmd.exe /c start /B /wait /low " " composite -gravity center %calquedecoupe% %x4novi% %combi%
rem cmd.exe /c start /B /wait /low " " convert -define png:format=png32 %combi% -transparent #FF00FF %mask%
cmd.exe /c start /B /wait /low " " composite -gravity center %calquedecoupe% %x4novi% -negate %mask%
I'm using a new gimp version where the algorithm is slightly different. I can give you my two scripts that I use and normally no holes should be visible.
Like I said, FF III is a bit different and gimp uses another upres algorithm.
I just wanted your opinion on general. If you like it, maybe you can tweak it a bit or use another gimp version for the old upres algorithm. :)
cmd.exe /c start /B /wait /low " " convert -scale 400%% -background #FF00FF -alpha remove -alpha off -fill black +opaque #FF00FF %infile% %raw4x%
cmd.exe /c start /B /wait /low " " convert +transparent #FF00FF %raw4x% %raw4xcoupe%
cmd.exe /c start /B /wait /low " " composite -gravity center %raw4xcoupe% %blackImage% %raw4xmix%The part you can try to skip is the :Code: [Select]cmd.exe /c start /B /wait /low " " convert -scale 400%% -background #FF00FF -alpha remove -alpha off -fill black +opaque #FF00FF %infile% %raw4x%
cmd.exe /c start /B /wait /low " " convert +transparent #FF00FF %raw4x% %raw4xcoupe%
cmd.exe /c start /B /wait /low " " composite -gravity center %raw4xcoupe% %blackImage% %raw4xmix%
You'll get a way better mask, but if ff8 is as rigid than ff7 with the layering, you may have missing pixels
The other parts of your code seems right to me, maybe not speed optimized as imagemagik can chain lots of action in one command, but this type of optimisation is not my cup of tea ^^'
Satsuki, can you also give the FFVIII background a go? I want to see if your way of masking result in a fiber/better mask then my technique.
Can you post a psd file of that so I can have a look on it or was it multilayered tiff?
What's the problem ingame? The mask looks really clean. :/
Yes it seems ff8 use the same "strick layer system" than ff7 is, what's why you need potrace + non interpolated resize mixed to avoid missing pixels and layer collisions.
It's not perfect on some screens and you'll have to do smalls correction but that's the only way i found to have a correct render in ff7.
Great it have helped you, hopped you found a better way for ff8
Looks damn good! It might be a bit too aggressive on the bottom though, but the overall details are beautiful. The missile looks great, as well as the speakers and the wood. What kind of images are you training it with? The FF9 model was trained with a variety of concept art which has a similar art direction. But not too sure if it would fit FF8 though.
Here's my result of a quick test of this picture with my auto tool (use waifu as prefilter then esrgan), if you want i can clean the tool and give it to you for your tests ^^
Alright, so it finished generating the images in about 40 mins (about 2K images), so that was pretty darn fast. Based on generating Balamb, I think doing the masking takes about twice as long (my gpu does the images, but my nasty i5 does the masking). So I'm gonna go watch a movie and it should be done by the time it's over, then I just need to import the images with Pupu, which shouldn't take long. So I'm guessing I'll be seeing what it's like in-game in less than 2 hours. If I'm still awake enough, I might just spit out a video tonight for this which will free up tomorrow for me since it's my birthday. Seeing no issues would put such a smile on my face and would make for a great b-day gift for myself :P
I'll likely put all/many of the images I can't show in game due to lack of saves into a slide show also so people can see what else was produced in the video.
If you need saves, I have them for just about every part of the game. Don't mind sharing them with you if it helps you out.
It's no problem. :) I'll send them now.
I can't tell you how thankful I am for this, thankyou so much, I'm positive they will be super useful! :)
Hope so. They're at all points in the game for this very reason. Field upscales. Look forward to seeing the results. Be nice to use and to compare with my own tests. And Happy Birthday. :)
I can not resist and ask at least a couple of images), especially with the battle)
my own trained ff7 model finished its 500000 iteration but the results are lower quality than my over models.
if you can share your model once trained, i'd like to test it to check the results on ff7 ^^
This is looking phenomenal blippyp! Masks are really good too! You have a version people can use to try it out?
I'm already using AngelWings backgrounds pack, so I guess it's just a matter of replacing files. I'm guessing this pack only includes the backgrounds from the video? Luckily I just got the ragnarok on disk3 so I can just check out Balamb :)
Were you unable to get the saves working? Or do you plan to just release videos and packs as you progress? Either way, I'm glad to see all this moving forward.
If your gan model is final, i'd like to test it on some ff7 field witch my current method is not realy good
Looks like they finally approved it.Yes, thanks, it's a very huge improvement compared to other, still gorgeous, similar mods.
GUM v0.0b Download (https://www.nexusmods.com/finalfantasy8/mods/1)
I just wonder if I can play with italian texts, but english ingame signs....
CUT
I compared all files in "textures" folder of version ENG and ITA, of Project AW, with an app called WinMerge, and here you can see the results.
Oh thanks, I was about to do the exact same thing actually, still waiting on the downloads to complete. Unfortunately it still doesn't help with the fact that I don't have the original files which I'll need to do the upscale on. I can resize these ones, but they'll be 'off' probably.IMHO, the faster way to have original files, is to change game language on Steam. It downloads about 400mb of files every time you change language. It's not so much if you have a decent connection
Ya, it's likely the first thing I'll try. Aside from some quiet hero lurking in the background who suddenly posts the files for me to just 'click' on like you did showing me which files to change, I can't think of any other method to get what I want atm and I'm assuming at this point that my 'hero' card has already been pulled and likely won't see another. But, if that fails, I'll have no choice but to wait patiently and rely on the generosity of someone else to post the files I need.Really, it takes less than 5 mins to download with Steam.
Even if I want to help, I don't even know how to find and/or extract these original files
As long as that list of files you gave me is accurate, and I have no reason to think it isn't, then it's really just a matter of collecting the files together, they won't take too long to upscale. I just gotta set a couple of hours aside to do it is all.Yes, just these files and an hashmap for italian, but I guess we can use the one from Project AW.
wow that's pretty cool, thanks for posting this for me :)You're welcome. Any update planned in the next few days?
You're welcome. Any update planned in the next few days?
I have no idea tbh, I just take this stuff one day at a time, and I clearly don't work on it every day, then the next I might work on it non-stop for 2-3 days. If you locate a screen that is clearly broken, especially game-breaking. Making me aware of something like that I would likely look into it and try to fix it asap, I would react similarly for a screen that is clearly not done well and you see it all the time, and it's just driving you nuts. I would look into fixing that one as well as long as someone complains about it. But as for setting a 'date' for anything, I have no intentions for anything like that.
...and the problems encountered are things you already know.
And the "wrinkle" effect on some backgrounds, like the one here...
If you still need other language files, and can kinldy explain what files I have to send you, or how extract by myself, just say it.I'm downloading them now, so really nothing, I just have to look at them and try to figure out what I need to do with them. But I certainly appreciate the offer. :)
As fated courage did a waifu HD pack, maybe it would be good to ask him about the checkered effects. :)
if you had access to similar 3D meshes for them you could perspective render them onto the image.
unless there is a good way to remove them from the image and redraw the actual background and replace them with 3D actors similar to how they are done in other areas.
What about setting the field model onto a black background (for instance debug menu), and then increasing size of field model with an appropriate rotation. Could then screenshot it, cut it out clean because of the black background, and then impose the image onto the field over the bad ones? It'd involve shuffling the char.one files within field screens about though, or hex-editing.
If there's a model viewer tool for this game that'd simplify things a lot, but I think it's only for battle models.
Yes, that's the 'checkered' effect I was mentioning and although I've only fixed a couple, seem to know how to fix, but it will be time consuming and slow to fix. I have to figure out which screens are doing it, but you only see the effect of it while in-game, the textures look fine outside of the game, which is why I'm hoping people will post pictures of the backgrounds that are doing this.
I've run into at least 4-5 of these so far, and I'm sure there are many more. I'm trying to come up with a way to fix it thru my script so that this 'needle in the haystack' is automatically fixed, but until then, I can only fix them as I find them. If I can find a solution for that, I will likely regenerate the images again and produce another download, otherwise, I will have to locate each background having this issue and fix it by hand, then once I think I've gotten them all/most of them I will provide another 'patch' download.
...I intend to start a play through tonight with these and will compile a comprehensive list of affected "checkered" areas for you. I'll take screenshots as well. Thanks for all your work! Will check back in soon...
hey , blippyp, I have a good GAN database which I had trained many months.
do you think it's better for the images?
I can help you to generate photos with my GAN database.
Ill glady try this out since im about to start a new run on FF8 where are the files to set-up?
and let me know how I can help do you still need screenshots? How far along are you into the project?
Wow, your work is really impressive! I played FF8 for the first time all the way through last year, but backgrounds back then were MUCH less impressive. The AI stuff we've seen since the start of 2019 for FF7 and FF8 is incredible! I really hope you don't abandon the project! Cause I'd LOVE to play the game again if you do release a complete version....
One of the things I remember having an issue with for FF8 was the character models (the HD ones you used in your tests) don't quite look right to me. Their faces are pretty different and I often remember feeling like the original character designs were superior when it came to their eyes and faces.
I'd have to see a proper comparison again to see if it's what I remember. If I had any skill with modding things myself I'd LOVE to have an updated HD character set that was a bit more realistic looking with their faces. Honestly, reading through this whole thing took around an hour. And in the last few pages I kinda just started skimming because I wanted to get it finished sooner to get to the end and see if you had finished it or not. That and a LOT of the technical aspects just completely flew right over my head.
I mean, I don't even know what a GAN is xD. I'm assuming it has something to do with AI Neural Networking. But I don't know what. I hope you continue this project because it's honestly amazing what you've accomplished! And in such a short time. It reminds me of this guy Jmp who a few years ago tried to make 3D models for FF7, I read through that thread last night before bed too. The difference is your method is already pretty close to being completed, whereas his method no matter how fast the man was working had only completed like a dozen fields in months.
I think it's safe to say AI Neural Networking is a MUCH more practical solution at this point because it's so automated (compared to just straight up manual work) and allows you to do THOUSANDS of backgrounds in mere hours or days, something which is probably utterly impossible if you'd have done them by hand. I realize it's not perfect, and probably will never look as good as if someone just literally redrew ALL of the backgrounds manually again, but it's a pretty amazing result nonetheless! You should be VERY proud of what you've accomplished! :)
Thankyou, I'm glad you like it, I certainly spent a lot of time on this last I was working on it. You're right about the character's though, I'm also really not happy with what happens with them. The issue is obvious, my GAN was trained to rebuild backgrounds, not characters. I'd have to make a new GAN just for the characters to get reasonable results, which would take time. Then there would be the issue of merging a background produced image with the character produced image (which would likely have to be done by hand). Personally, I just think getting an artist to rebuild the characters if not even the backgrounds as well would just be a much better method. But this GAN stuff is pretty neat, not gonna lie. It definitely kept me really interested for a while. If someone had the time and knew more about the specifics on do's/don'ts for training GAN's however, I think you could produce whatever you wanted reasonably well, there's just so much potential, and we've only just scratched the surface on this neural networking stuff I think, although it's definitely getting more and more common in ways most people don't even realize yet, which is also kind of scary.
I'm just wondering, is there a possibility for this to be ported to the 'remastered' edition?
If you document which screens need to be updated, I will update them on my end as well, the issue isn't that they can't be fixed (I already figured that out afaik), it's that I (sorry to say), haven't played the game yet myself with the new images to see which screens need to be updated as well. I'm not sure why some of them got messed up, but when I rebuilt them by hand as a test, it fixed the issue. Bottom line, is that I need a list of which screens need to be updated, if I knew what they were, it would be incentive enough to fix the images I uploaded as well so that no one has to deal with this issue. Either way, glad you're enjoying it regardless. :)
I haven't look into it, but afaik, the remastered edition lacks the mod used by this mod to update those images (sorry, it's been a while, I forget the name of it - tonberry maybe!?!??). So until someone ports it, or something like it, then I don't think this is possible.
l'm finishing disk 1 soon , you want the list of the broken screens until the end of disk 1? l think l put them all in backup folder when l replaced them with angle wings version.
Wow, beautiful work!
I'm hoping someone can crack the backgrounds on the remaster soon. I like the remastered characters and the speed-up option. Except the pretty-boy Squall head. I guess he WAS supposed to be the prettiest one in the room. ;)
I'd like to see your broken screens list as well. I'm looking to mod up my original FF8 and definitely want these wonderful GUMmie backgrounds as the base with a few bits from Angel Wings as back-up while blippyp is working on them.