TTLG|Thief|Bioshock|System Shock|Deus Ex|Mobile
Page 2 of 2 FirstFirst 12
Results 26 to 45 of 45

Thread: Thief 3 ESRGAN Attemt

  1. #26
    Member
    Registered: Feb 2012
    Location: Russia
    Quick test of some upscaled textures
    https://mega.nz/#!cpc1jC5B!UcWHLE6fB...IKlOyD7gnGugN8

    The vanilla textures are not so good in quality, so it differs from file to file. For the good looking textures they upscale quite well (CASdoor for example).
    I first using DXT artifact removal model with PNG as an output file. After ESRGAN with different models and converting back to DDS. DDS is killing some quality, but this is the only way.

    Also I found how to load MatLib files into editor and look for Material Info. There are specular maps and reflection maps used in some textures, so the engine supports it. If only we could hack matlib and insert own data.

  2. #27
    Sneaky Upgrader
    Registered: May 2007
    Looking forward to seeing a full set in-game.

    Can you post the names of the materials you found, which have specular/reflection maps?

    I tried drawing heavy white/black lines over GARbowmetalgriphi_S.dds, but although the file is accessed by the game during start-up, I can't see a difference at all (assuming it's used on Garrett's bow, of course).

  3. #28
    Member
    Registered: Feb 2012
    Location: Russia
    Example of good looking Thief 3 texture upscaling
    https://imgsli.com/MTExNTY

    For some reason not all the textures in Thief 3 looks well.
    I think I will upscale about 400 of the world diffuse textures and upload them for tests.
    I'll test specular/reflection maps myself.

    My theory is - original Thief 3 textures were not the original. Developers took some low-scale textures and upscaled them twice with little filtering. This can explain the results and why ESRGAN can't improve pictures much.
    For test I'll make try next algorithm:
    1. DXT-BC artifact removal
    2. Downscaling 2x
    3. Upscaling with ESRGAN.
    Let's see the differences between two versions.

  4. #29
    Member
    Registered: Feb 2012
    Location: Russia
    Not only that, but movies clearly were made by different people in different time with different encoding options. Some were badly resized like ThiefTrailerNoESRB_engl_none_30 and drepts_tale_engl_none_30, introducing visible lines artifacts.
    I'll try to fix some issues, but it's impossible.

    In drepts_tale_engl_none_30 there is interesting square bug in first part of the video, will try to remove it by hand in several frames.
    https://imgur.com/undefined
    On the center of the screen near the candle. It's in the original video too. I think they tried to apply some post-effect and missed that

  5. #30
    Member
    Registered: Feb 2012
    Location: Russia
    I couldn't see the specular effect on the bow either.
    So the only thing we need is normal maps for everything. Cause game looks very flat on textures without them.

  6. #31
    Sneaky Upgrader
    Registered: May 2007
    Quote Originally Posted by Akven View Post
    Example of good looking Thief 3 texture upscaling
    That does look very good.

    Quote Originally Posted by Akven View Post
    Broken link?

    Quote Originally Posted by Akven View Post
    I couldn't see the specular effect on the bow either.
    So the only thing we need is normal maps for everything. Cause game looks very flat on textures without them.
    Right, I'll have a go at that.

  7. #32
    Member
    Registered: Feb 2012
    Location: Russia
    Yeah, was broken link
    https://imgur.com/JVl8FIK

  8. #33
    Member
    Registered: Feb 2012
    Location: Russia
    Proof of low resolution concept
    ESRGAN 4x vs ESRGAN 2x
    https://imgsli.com/MTExNTk/1/2

    I preprocessed images by DXT-BC 1x removal model and downscaled them 2x of their size.
    After that I ESRGANed them, getting 4x upscale (so it is 2x from the original size)
    And now the comparison: 2x texture (1024x1024) looking better than 4x texture (2048x2048)

    This is vanilla vs ESRGAN 4x texture. ESRGAN even can't do anything because developers used upscaled textures
    https://imgsli.com/MTExNTk/0/1

    Recreation of additional details from vanilla to 2x
    https://imgsli.com/MTExNTk/0/2

    Now it's getting more complicated because I need to upscale every texture twice and see if there will be improvement in 2x mode. So a lot of hand work as always.
    Some textures can be improved by combining in photoshop parts of 2x and 4x upscales (like wooden signs with different quality of wood frame and sign itself).

    P.S. Also I think we need to use minimaps. First of all Collective Texture Pack uses them.
    Second - I read about minimaps and it seems they improve perfomance of the game. The cost is increazed texture size for about 1/3. But since a lot of textures will be 2x instead of 4x - I can allow that.

  9. #34
    Member
    Registered: Feb 2012
    Location: Russia
    Interesting example of combining 2x and 4x results. I found that wooden frame upscaled 4x just excellent. But painting was really ugly (clearly developers used upscaled low-resolution painting with normal looking wood texture).
    So I combined wood from 4x upscale and painting from 2x upscale. And it's looking much better that just 4x upscale.
    Vanilla vs combined 4x image
    https://imgsli.com/MTExOTQ

  10. #35
    Sneaky Upgrader
    Registered: May 2007
    Apparently artificial intelligence still needs some assistance from non-artificial intelligence, but the end result is impressive.

  11. #36
    New Member
    Registered: Nov 2017
    Looking good, thanx for all the hard work

  12. #37
    Member
    Registered: Feb 2012
    Location: Russia
    Edited 77 frames in drepts_tale_engl_none_30 video, removed strange square light box post-effect.
    https://imgsli.com/MTEyMDk

  13. #38
    Sneaky Upgrader
    Registered: May 2007
    Some success with adding normal maps: (GIF, should animate.)


    This is GENfloorA_D with a renamed GENfloorC_N.dds added, via an external .mlb file. It's going to take a small tool to produce the override .mlb from a list of map names, but it looks promising.

    I first tried modifying the material info in memory while reading in the .ibt files - would have been nicer because you'd only need to supply .dds files following a naming convention - but unfortunately it crashes...

  14. #39
    Member
    Registered: Feb 2012
    Location: Russia
    Excellent.
    I upscaled 254 textures so far. Can upload them for tests tomorrow. (There are about 488 world textures ingame not counting normal maps). Also upscaled 11 movies out of 22.

    BTW, how to create screenshots in Thief 3? Print Screen is not working. And what is the magic with Bloom setting overriding Multisampling setting in menu (I can only get Bloom with Multisampling: 1 or Multisampling 16 but without Bloom)?

  15. #40
    Member
    Registered: Feb 2012
    Location: Russia

  16. #41
    Sneaky Upgrader
    Registered: May 2007
    Looking great...

    Quote Originally Posted by Akven View Post
    BTW, how to create screenshots in Thief 3? Print Screen is not working.
    The SneakyTweaker has a page providing some options for screenshots. If you find that those don't work either, then something must have changed in Windows. (I'm a couple of versions behind.)

    And what is the magic with Bloom setting overriding Multisampling setting in menu (I can only get Bloom with Multisampling: 1 or Multisampling 16 but without Bloom)?
    Yes, bloom and multisampling are mutually exclusive. It's probably an artificial restriction for performance reasons anno 2004. I tried once to remove it but it didn't work out.

  17. #42
    Member
    Registered: Feb 2012
    Location: Russia
    For Multisampling I think I can force it from driver.
    Will look screenshot options in the evening
    Also I want to test how Thief 3 will work with Reshade

  18. #43
    Sneaky Upgrader
    Registered: May 2007
    Now that the .mlb files are somewhat understood, it's possible to add more than just normals:



    I tried adding more components for the floor above, in the form of all-black and all-white textures. There was a visible effect for all map types except Mask, Bump and FX. (FX is not used at all in the game.)

    Unless you're interested in experimenting with some of those other map types I'll limit the matlib-generating tool to work with diffuse, normal and specular. (It'll take a bit of time but hopefully a first version can be ready next weekend.)

    Edit: The GARbowmetalgriphi_S texture is used as the Mask component on Garret's bow - must be why changes didn't show up. The bow grip does have specular (specular03) but it's not very visible.

  19. #44
    Member
    Registered: Feb 2012
    Location: Russia
    I found how to do screenshots. Honestly, there are not so much changes with textures, mostly changes are visible up close. But I didn't upscaled everything, not yet.

    I can automate creation of normal maps, but for other things we'll need to use some additional software. For specular I can use AwesomeBump, but it can create textures only one by one, not automated.

    And just to be clear, that is the priority of creating additional maps? And meaning of the maps itself:
    Diffuse - texture itself
    Normal - easily automated
    Specular - it is reflection of highlighted areas in texture, useful for metal and so on. In AwesomeBump I can change the amount of strength for this one (metals are more highlighted, wood is not and so on).
    Detail - some high noise texture for adding additional details in UE when looking upclose.
    Emissive - judging from the google - it is self-shining of the texture (lights/windows)
    Reflection - map for the surrounding reflected in texture, but as I understand you could just use copy of specular map for reflection
    Last edited by Akven; 22nd Jan 2020 at 16:46.

  20. #45
    Member
    Registered: Feb 2012
    Location: Russia
    https://imgsli.com/MTEyNjQ
    There is clearly a bug in texture filtration ingame or with normal/any other map for the stone texture to the left side of the screen.

Page 2 of 2 FirstFirst 12

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •