Results 1 to 11 of 11

Thread: What's the state of modding tools for new Total War games?

  1. #1
    Artifex
    Patrician

    Join Date
    Oct 2008
    Location
    London, UK
    Posts
    1,332

    Default What's the state of modding tools for new Total War games?

    So very long time ago I did a lot of research and modding tool for Empire, with a bit of Napoleon and Shogun 2.

    I've been wondering, how much of that still works for newer games?
    Did officially provided tools or other people's tools provide alternatives?
    Is there something that was possible to mod in older games but no more in newer games?

    In particular, is there any UI files decoder for any game beyond Shogun 2?

    I might look at doing a few quick updates if that's all that's needed.

  2. #2
    Daruwind's Avatar Citizen
    Join Date
    Oct 2013
    Location
    Prague
    Posts
    2,898

    Default Re: What's the state of modding tools for new Total War games?

    Ufff. I long time ago quickly inspected Empire/Napoleon esf file. To put it simply, things are similar yet little different in each newer game.

    For R2/Attila, ToB, Wh1+2 and 3K now we have Assembly Kit dirrectly on steam, which is little different for each game but basically allows you to process DB and startpos and make changes. For R2 we cannot mod battle maps, ,for others yes but for none of them the Campaign map is unlocked. So adding regions, splitting them or adding building slots is way.

    For general modding we have PFM (pack file editor) editor and RPFM (rusted...) which are covering most DB and esf modification. And there are some other tools I almost never use..

    I was speaking with author of "esf via xml" method, for unpacking the esf file into xml tables. And he updated the procedure so it is working with WH1/2. Ha, have no time to check it with 3K....

    I would point you to C&C discord den, where is a lot modders especially for Wh/3K now and lot stuff especially in scripting is being done there. MY impression is, with Wh1 the scripting was seeing renessaince. They created even some debugging tools and consoles..
    DMR: (R2) (Attila) (ToB) (Wh1/2) (3K) (Troy)

  3. #3
    Artifex
    Patrician

    Join Date
    Oct 2008
    Location
    London, UK
    Posts
    1,332

    Default Re: What's the state of modding tools for new Total War games?

    Quote Originally Posted by Daruwind View Post
    I was speaking with author of "esf via xml" method, for unpacking the esf file into xml tables. And he updated the procedure so it is working with WH1/2. Ha, have no time to check it with 3K....
    I mean, that's literally me, that's why I'm asking what works and what doesn't. ;-)

  4. #4
    Daruwind's Avatar Citizen
    Join Date
    Oct 2013
    Location
    Prague
    Posts
    2,898

    Default Re: What's the state of modding tools for new Total War games?

    I´m retarded. Just connected the things. I was thinking more about the line about "new tools" ..so back to unpacking I will check it afternoon and post the result and thanks for even asking!
    DMR: (R2) (Attila) (ToB) (Wh1/2) (3K) (Troy)

  5. #5
    Daruwind's Avatar Citizen
    Join Date
    Oct 2013
    Location
    Prague
    Posts
    2,898

    Default Re: What's the state of modding tools for new Total War games?

    Looks like it is working half way... lower in spoiler is my console log, and compressed data folder is bit empty...crosschecking with PFM, lot stuff is not there.

    Spoiler Alert, click show to read: 

    PS P:\modding\ESFviaXML\etwng-master\esfxml> ./unpackesf.ps1
    str_lookup_fail 21
    Warning: Semantic conversion failures (low level conversion performed instead)
    (this is OK if converting ESFs for game newer than Empire):
    * CAMPAIGN_LOCALISATION: (854 records, 854 failures, 0 quiet failures)
    * REGION_OWNERSHIPS_BY_THEATRE: (1 records, 1 failures, 0 quiet failures)

    LZMA 9.22 beta : Igor Pavlov : Public domain : 2011-04-18
    str_lookup_fail 21
    RuntimeError: Unknown type 0x09 at 54095
    block in setup_esf_type_handlers_get at P:/modding/ESFviaXML/etwng-master/esfxml/esf_parser.rb:723
    default at org/jruby/RubyHash.java:718
    [] at org/jruby/RubyHash.java:1107
    get_rec_contents at P:/modding/ESFviaXML/etwng-master/esfxml/esf_parser.rb:583
    convert_rec_RandSeed at P:/modding/ESFviaXML/etwng-master/esfxml/esf_semantic_converter.rb:1737
    block in convert_rec_basic! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:301
    try_semantic at P:/modding/ESFviaXML/etwng-master/esfxml/esf_parser.rb:677
    convert_rec_basic! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:301
    convert_rec! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:320
    convert_abca_rec! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:338
    block in convert_rec_basic! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:308
    tag! at P:/modding/ESFviaXML/etwng-master/esfxml/dir_builder.rb:122
    tag! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:437
    convert_rec_basic! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:302
    block in convert_rec! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:316
    open_xml at P:/modding/ESFviaXML/etwng-master/esfxml/dir_builder.rb:28
    open_nested_xml at P:/modding/ESFviaXML/etwng-master/esfxml/dir_builder.rb:41
    convert_rec! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:315
    convert_abca_rec! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:338
    block in convert_rec_basic! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:308
    tag! at P:/modding/ESFviaXML/etwng-master/esfxml/dir_builder.rb:122
    tag! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:437
    convert_rec_basic! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:302
    block in convert_rec! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:316
    open_xml at P:/modding/ESFviaXML/etwng-master/esfxml/dir_builder.rb:28
    open_nested_xml at P:/modding/ESFviaXML/etwng-master/esfxml/dir_builder.rb:41
    convert_rec! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:315
    convert_abca_rec! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:338
    block in convert_rec_basic! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:308
    tag! at P:/modding/ESFviaXML/etwng-master/esfxml/dir_builder.rb:122
    tag! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:437
    convert_rec_basic! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:302
    convert_rec! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:320
    convert_abca_rec! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:336
    block in convert! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:416
    tag! at P:/modding/ESFviaXML/etwng-master/esfxml/dir_builder.rb:122
    tag! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:437
    block in convert! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:414
    open_xml at P:/modding/ESFviaXML/etwng-master/esfxml/dir_builder.rb:28
    open_main_xml at P:/modding/ESFviaXML/etwng-master/esfxml/dir_builder.rb:35
    convert! at P:/modding/ESFviaXML/etwng-master/esfxml/esf_converter.rb:413
    <main> at .\esf2xml:33
    PS P:\modding\ESFviaXML\etwng-master\esfxml>

    I try to rembember but you didn´t need the startpos file of DB scheme last time but I can get them for you if you like
    Last edited by Daruwind; July 14, 2019 at 10:04 AM.
    DMR: (R2) (Attila) (ToB) (Wh1/2) (3K) (Troy)

  6. #6
    Artifex
    Patrician

    Join Date
    Oct 2008
    Location
    London, UK
    Posts
    1,332

    Default Re: What's the state of modding tools for new Total War games?

    Which game is it for?

    ESF docs I wrote list 09 as "uint64 (rarely observed in practice)". It seems converter didn't have them, so I just blind-fixed it.

    Could you send me the file so I can verify that the fix works?

  7. #7
    Daruwind's Avatar Citizen
    Join Date
    Oct 2013
    Location
    Prague
    Posts
    2,898

    Default Re: What's the state of modding tools for new Total War games?

    That was startpos file for Three Kingdoms. Looks like it is no longer "rare"...

    I checked a monent ago ToB esf and it looks like everything is being unpacked just fine (after all it is just Attila..) and Wh2 startpos with latest DLCs changes is being processed as well but is giving this one note - Unexpected field type 17 during lookahead of faction ids. I think it was not there before.

    google is okay? I put into rar both esf files.
    https://drive.google.com/open?id=1jY...zNBymflx0FR0KL
    Spoiler Alert, click show to read: 

    ToB

    PS P:\modding\ESFviaXML\etwng-master\esfxml> ./unpackesf.ps1
    Warning: Semantic conversion failures (low level conversion performed instead)
    (this is OK if converting ESFs for game newer than Empire):
    * CAMPAIGN_LOCALISATION: (698 records, 698 failures, 0 quiet failures)
    * MAPS: (1 records, 1 failures, 0 quiet failures)
    * REGION_OWNERSHIPS_BY_THEATRE: (1 records, 1 failures, 0 quiet failures)

    LZMA 9.22 beta : Igor Pavlov : Public domain : 2011-04-18
    Warning: Semantic conversion failures (low level conversion performed instead)
    (this is OK if converting ESFs for game newer than Empire):
    * ANCILLARY_UNIQUENESS_MONITOR: (84 records, 84 failures, 0 quiet failures)
    * CAI_REGION_HLCI: (2457 records, 2457 failures, 0 quiet failures)
    * CAI_SITUATED: (410 records, 410 failures, 0 quiet failures)
    * CAI_TECHNOLOGY_TREE: (82 records, 82 failures, 0 quiet failures)
    * CAMPAIGN_LOCALISATION: (8215 records, 8215 failures, 0 quiet failures)
    * COMMANDER_DETAILS: (794 records, 794 failures, 0 quiet failures)
    * FACTION_FLAG_AND_COLOURS: (395 records, 395 failures, 0 quiet failures)
    * MAPS: (1 records, 1 failures, 0 quiet failures)
    * POPULATION CLASSES: (687 records, 687 failures, 0 quiet failures)
    * REGION_OWNERSHIPS_BY_THEATRE: (1 records, 1 failures, 0 quiet failures)
    * RELIGION_BREAKDOWN: (229 records, 229 failures, 0 quiet failures)
    * TRAITS: (616 records, 234 failures, 0 quiet failures)
    * UNIT_HISTORY: (794 records, 794 failures, 0 quiet failures)
    * UNIT_RECORD_KEY: (794 records, 794 failures, 0 quiet failures)

    WH2

    PS P:\modding\ESFviaXML\etwng-master\esfxml> ./unpackesf.ps1
    Warning: Semantic conversion failures (low level conversion performed instead)
    (this is OK if converting ESFs for game newer than Empire):
    * CAMPAIGN_LOCALISATION: (2370 records, 2370 failures, 0 quiet failures)
    * MAPS: (1 records, 1 failures, 0 quiet failures)
    * REGION_OWNERSHIPS_BY_THEATRE: (1 records, 1 failures, 0 quiet failures)

    LZMA 9.22 beta : Igor Pavlov : Public domain : 2011-04-18
    Unexpected field type 17 during lookahead of faction ids
    Warning: Semantic conversion failures (low level conversion performed instead)
    (this is OK if converting ESFs for game newer than Empire):
    * ANCILLARY_UNIQUENESS_MONITOR: (306 records, 306 failures, 0 quiet failures)
    * CAI_REGION_HLCI: (1751 records, 1751 failures, 0 quiet failures)
    * CAI_SITUATED: (862 records, 862 failures, 0 quiet failures)
    * CAI_TECHNOLOGY_TREE: (304 records, 304 failures, 0 quiet failures)
    * CAMPAIGN_LOCALISATION: (24549 records, 24549 failures, 0 quiet failures)
    * COMMANDER_DETAILS: (3146 records, 3146 failures, 0 quiet failures)
    * FACTION_FLAG_AND_COLOURS: (920 records, 920 failures, 0 quiet failures)
    * MAPS: (1 records, 1 failures, 0 quiet failures)
    * POPULATION CLASSES: (930 records, 930 failures, 0 quiet failures)
    * REGION_OWNERSHIPS_BY_THEATRE: (1 records, 1 failures, 0 quiet failures)
    * RELIGION_BREAKDOWN: (310 records, 310 failures, 0 quiet failures)
    * TRAITS: (795 records, 43 failures, 0 quiet failures)
    * UNIT_HISTORY: (3146 records, 3146 failures, 0 quiet failures)
    * UNIT_RECORD_KEY: (3146 records, 3146 failures, 0 quiet failures)
    PS P:\modding\ESFviaXML\etwng-master\esfxml>
    DMR: (R2) (Attila) (ToB) (Wh1/2) (3K) (Troy)

  8. #8
    Artifex
    Patrician

    Join Date
    Oct 2008
    Location
    London, UK
    Posts
    1,332

    Default Re: What's the state of modding tools for new Total War games?

    Both type 24 crash and type 17 lookahead issues should be fixed now.

  9. #9
    Daruwind's Avatar Citizen
    Join Date
    Oct 2013
    Location
    Prague
    Posts
    2,898

    Default Re: What's the state of modding tools for new Total War games?

    I tried to (un)pack all newer TWs ..R2/Attila/ToB/Wh1+2/3K and looks like all startpos are working just fine. Thanks a lot!

    By the way. Just in theory. Would it be possible to unpack other esf files as well? I´m meddling with startpos..buidling slots and other stuff and basically I would like to see into other map files if possible. Not sure it would help...

    dynamic_resources.esf
    hlp_data.esf
    map_data.esf

    the first two probably hold no interesting data but for Rome 2, I´m trying to use map_data.. there is regions_block array holding interesting data similar to startpos settlement info... I uploaded all three files
    https://drive.google.com/open?id=1qa...-Lu8WY204YdQOo
    Spoiler Alert, click show to read: 


    Last edited by Daruwind; July 14, 2019 at 03:12 PM.
    DMR: (R2) (Attila) (ToB) (Wh1/2) (3K) (Troy)

  10. #10
    Artifex
    Patrician

    Join Date
    Oct 2008
    Location
    London, UK
    Posts
    1,332

    Default Re: What's the state of modding tools for new Total War games?

    Quote Originally Posted by Daruwind View Post
    By the way. Just in theory. Would it be possible to unpack other esf files as well? I´m meddling with startpos..buidling slots and other stuff and basically I would like to see into other map files if possible. Not sure it would help...

    dynamic_resources.esf
    hlp_data.esf
    map_data.esf
    The converter is supposed to handle all esf files not just startpos.

    Just use the esf2xml script, nothing except startpos has this embedded compressed data as far as I know.

  11. #11
    Daruwind's Avatar Citizen
    Join Date
    Oct 2013
    Location
    Prague
    Posts
    2,898

    Default Re: What's the state of modding tools for new Total War games?

    I would swear just before the setup was not working for me for other esf files...but right now..examining map_data.esf after unpacking..the script actually unpacked the stuff. Either I was blind before and missed important parts for me or I have no idea....I bow once more before your programming might!
    DMR: (R2) (Attila) (ToB) (Wh1/2) (3K) (Troy)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •