[Demo Modding] Detailed How-to with Unpacker (Demo Mod General Discussion)

**Vowlesy** · February 22, 2009, 10:04 AM

Big thanks for all the rep!

.Unpacker By Alpaca and using it.

Detailed Instructions on install python,and using the unpacker with exact details.

Spoiler Alert, click show to read:

(XP)Find you 'steamapps' folder, (just search for it, or find it in your program files under steam), then from there, goto 'common\empire total war demo'
You should now have FOUR folders and an assortment of files in front of you. You want to copy the entire 'data' folder and paste it into parent folder (empire total war demo folder) and rename it backup.

Spoiler Alert, click show to read:
Now you need to install Python 3.01 if you havn't got it installed already. Goto 'HERE' and click the download that relates you to (x84 is for 32-bit standard XP and Vista).
Install Python 3.01 with all the default settings nothing needs to be changed.
Once installed, open up your 'empire total war demo' folder again and then go into your 'data' folder but not the backup.
Now create a file called 'emp_unpacker.py' and right-click "Edit with IDLE."

Spoiler Alert, click show to read:
Open up the latest revision of the code (#3 at time of writing this) and copy and paste it into the window. (See Below, "Updated Python Source Code (Revision #)"

Spoiler Alert, click show to read:
Save and exit the program and the 'Python Shell' program.
Open up the command prompt (XP - Start - Run - 'cmd' ) (Vista, goto the 'data' folder, hold SHIFT+Right click and choose 'Open command prompt here).
XP users need to change the command prompts directory to the data's folder.
Mine is 'E:\Program Files (x86)\Steam\steamapps\common\empire total war demo\data'
So I type, "cd /d E:\Program Files (x86)\Steam\steamapps\common\empire total war demo\data". Notice the text before the '>' has changed. If the directory is on your C: drive, you do not need to use the /d switch so it would be
"cd C:\Program Files (x86)\Steam\steamapps\common\empire total war demo\data"

Spoiler Alert, click show to read:
Now Vista and XP users are both in the 'data' directory and have python install you need to enter the following command precisely
'emp_unpacker.py -u all' . If this fails for one reason or another please see trouble-shooting below.
The command prompt should now show lots of files being unpacked into an 'unpacked' folder.
Once finished, copy the contents of the 'unpacked' folder (copy, not cut!)across into the main data folder. Select Yes over any warnings of the same folder ect.
Rename demo1.pack 'backup_demo1' without an extension, people are still missing this. I mean, when you rename it, rename it simpy 'backup_demo1'. NOT 'backup_demo1.pack'!!!
Congratulations, you've now set-up your modding environment! .

When to use the Backups.

Spoiler Alert, click show to read:

MOD: Edit Unit Present in Battles. - Changing units, or unit numbers.

Spoiler Alert, click show to read:

In the Two default battles;
Battle of Brandywine.
Battle of Lagos.
We can simply and quickly edit the amount of units and their type.
We'll use Brandywine as an example.
Open up 'battle_of_brandywine.xml' with WordPad or similar program.
Syntax:
A unit is defined by <unit> to </unit>. Here is the British Generals unit

Spoiler Alert, click show to read:

From that we can change,

unit_category; "infantry","cavalry","dragoons","artillery". (Not sure what effect this has yet)
num_soldiers;"X" where X is a number, we have yet to find a limit to this. Simply change the number inside the quotes to effect the amount of men in that unit. (NOTE, Unit cards prior to battle seem not to update.

Spoiler Alert, click show to read:
script_name;unless you plan on controlling the unit by script this is slightly redundant.
unit_type type; "UNITTYPE", where unit type is a defined unit type, see reference below.
position;starting location on the map.
orientation radians;its rotation on initial map setup? (Yet to see).
width metres; how wide the formation is.
unit_capabilities; not directly edited, defined by whats contained within the tags (a tag is a <[TEXT]> to </[TEXT]>, like how you use BBcode in the forum posts. See reference below.
unit_experience level;change number in quotes from 0-9. Affects the units experience level.

MOD: Add Units Present in Battles. - Add extra units in a army.

Spoiler Alert, click show to read:

MOD: Add a Army Present in Battles. - Add new armies (Ally/enemy).

Spoiler Alert, click show to read:

MOD: Using Fortifications in Battles. - Use the deployment stage real time fortifications.

Spoiler Alert, click show to read:

REFERENCE: Unit Types

Spoiler Alert, click show to read:

REFERENCE: Unit Capabilities

Spoiler Alert, click show to read:

REFERENCE: Naval | Lighting/Weather Presets

Spoiler Alert, click show to read:

Updated Python Source Code (Revision 3):

Spoiler Alert, click show to read:

Code:

import struct, os, sys, re

# For easy file reading and writing interactions
def readLong(fhandle):
    return struct.unpack('l', fhandle.read(4))[0]
def readShort(fhandle):
    return struct.unpack('h', fhandle.read(2))[0]
def readByte(fhandle):
    return struct.unpack('B', fhandle.read(1))[0]
def readBool(fhandle):
    val = fhandle.read(1)
    if val == "00":
        return False
    else:
        return True
    
def writeLong(fhandle, value):
    fhandle.write(struct.pack('l',value))
def writeShort(fhandle, value):
    fhandle.write(struct.pack('h',value))
def writeByte(fhandle, value):
    fhandle.write(struct.pack('B',value))
def writeBool(fhandle, value):
    if value:
        fhandle.write('\x01')
    else:
        fhandle.write('\x00')
        
def removeDir(path):
    # remove all files in a folder
    if not (os.path.isdir(path)):
        return True
    
    files = os.listdir(path)
    
    for x in files:
        fullpath=os.path.join(path, x)
        if os.path.isfile(fullpath):
            os.remove(fullpath)
        elif os.path.isdir(fullpath):
            removeDir(fullpath)
    os.rmdir(path)

def parseArgs(args):
    pack = packFile('demo1.pack','unpacked')
    
    # create argument tree
    argtree = []
    for arg in args[1:]:
        if arg.startswith('-'):
            argtree.append([arg,[]])
        else:
            argtree[-1][1].append(arg)
    
    # wander the tree, top level always has hyphenated arguments
    for arg in argtree:
        # case 1: list
        if arg[0] == '-l':
            if len(arg[1]) > 0:
                for file in arg[1]:
                    pack.printEyeCandy(str(file))
            else:
                pack.printEyeCandy('./list.txt')
        # case 2: unpack
        elif arg[0] == '-u':
            for file in arg[1]:
                if file == 'all':
                    for i in range(len(pack.files)):
                        pack.exportFile(i)
                else:
                    pack.exportFile(file)
        # case 3: unpack (regexp)
        elif arg[0] == '-ur':
            for file in arg[1]:
                pack.exportFile(file, True)
        # case 4: change pack
        elif arg[0] == '-p':
            for file in arg[1]:
                print()
                print('Changing pack to '+file)
                print()
                pack.newPack(file,pack.outputdir)
        # case 5: change output directory
        elif arg[0] == '-o':
            for file in arg[1]:
                print()
                print('Changing output directory to '+file)
                print()
                pack.changeOutputDir(file)
    

class packFile:
    def __init__(self, path='', outputdir=None):
        self.handle = None
        if outputdir:
            removeDir(outputdir)
        self.newPack(path,outputdir)
    
    def newPack(self,path,outputdir=None):
        # safely open new pack
        if self.handle:
            self.handle.close()
            self.handle = None
        self.files = []
        self.numFiles = 0
        self.arr = 0
        self.outputdir = outputdir
        self.defLength = 0
        self.path = path
        self.readPackDefinition()
    
    def changeOutputDir(self,path):
        self.outputdir = path
        if self.outputdir != None:
            removeDir(self.outputdir)
    
    def packOpen(self):
        if not self.handle:
            self.handle = open(self.path,"rb")
        return self.handle
            
    def packClose(self):
        self.handle.close()
        
    def readPackDefinition(self):     
        pack = self.packOpen()
        
        # skip empty bytes and stuff at the start
        pack.seek(16)
        self.defLength += 16

        # read number of files
        self.numFiles = readLong(pack)
        self.defLength += 4
        
        # read ??
        self.arr = readLong(pack)
        self.defLength += 4
        
        # store the offset of a certain file
        offset = 0
        # read file metadata
        for i in range(self.numFiles):
        
            # read length of file
            length = readLong(pack)
            self.defLength += 4
            
            # read file name
            char = ''
            filename = ''
            while char != b'\x00':
                char = pack.read(1)
                if (char != b'\x00'):
                    filename += char.decode()
                self.defLength += 1
            self.files.append((filename,length,offset))
            offset += length
            
    def exportFile(self, arg, regexp = False):
        try: 
            arg = int(arg)
            # option a: arg is an index
            list = [self.files[arg]]
        except:
            # option b: arg is a string
            if regexp:
                list = filter(lambda x: re.search(str(arg),x[0]),self.files)
            else:
                list = filter(lambda x: arg in x[0],self.files)
        for (path,length,offset) in list:
            print('Exporting '+path+', length: '+str(length)+', at offset: '+str(offset))
            
            # create output directory    
            dir = os.path.split(os.path.join(self.outputdir,path))[0]
            if not os.path.isdir(dir):
                os.makedirs(dir)
            output = open(os.path.join(self.outputdir,path),'wb')
            
            # open pack and go to offset
            pack = self.packOpen()
            pack.seek(self.defLength+offset)
            # copy content
            i = 0
            # read MB-sized chunks as long as possible
            j = length//(2**20)
            while i < j:
                output.write(pack.read(2**20))
                i+=1
            i = 0
            j = (length%(2**20))//(2**10)
            # read KB-sized chunks
            while i < j:
                output.write(pack.read(2**10))
                i+=1
            i = 0
            j = length%(2**10)
            # read byte-sized chunks
            while i < j:
                output.write(pack.read(1))
                i+=1
            output.close()
        return True
        
        
    
    def printEyeCandy(self, outfile):
        output = open(outfile,'w')
        for (path,length,offset) in self.files:
            output.write(str(path)+'\r\n')
        output.close()
        

# main
parseArgs(sys.argv)

**ColdFire** · February 22, 2009, 10:10 AM

Mah mod:

HOW TO HAVE AMERICAN UNITS AS THE BRITISH

backup demo1.pack
Use Textpad to open demo1.pack
Find this section of text using the find command at the top:

Spoiler Alert, click show to read:

Now where is says this like: <unit_type type="americas_hessian_infantry"/>

That is the only important bit for changing unit type
So swap it with an American one, such as <unit_type type="americas_long_rifle_men"/>
You must swap them around, this means in my example the Americans will have a unit of hessian_infantry, there are ways of getting around this, but this is easiest.

HOW TO USE BATTLE DEPLOYMENT SCREEN

Find: <skip_deployment></skip_deployment>
Change to something similar to: <skip_deploym-nt></skip_depl--ment>

**sinople** · February 22, 2009, 10:12 AM

For the rank_fire you need to delete two characters as there is 9 letters instead of 11.

Changing the experience is also possible, you just need to change the amount at the refering line. Warning : the max limite of experience is 9.

Here is the mod for playing as american : http://www.twcenter.net/forums/showt...83#post4501583

Great work, +rep

**oneah** · February 22, 2009, 10:21 AM

Sinople there is a problem when doing that

i change everything but i get game error when starting game.

Every simple change i make i can't enter the game then.

**sinople** · February 22, 2009, 10:31 AM

For which modification ?

**oneah** · February 22, 2009, 10:34 AM

any modification, even when i change firing modes.. i dunno if its how i save the file or something
i just click save and exit

**Methoz** · February 22, 2009, 10:41 AM

hmm,i add 80 soldiers ,save and game crash

(i just repalce with original and just ctd if i make some change)

**sinople** · February 22, 2009, 10:48 AM

any modification, even when i change firing modes.. i dunno if its how i save the file or something
i just click save and exit

The rank_fire showed by Coldfire need a improvement, because you remove two letters when changing fire_volley to rak_fire so you need to add two letters like he said :

As it stands, due to the nature of the pack file and the fact we haven't yet opened it. There is most likely an index stating the size of the files in the pack, so. When something is edited . You must ensure for every character* you add is taken away elsewhere.

(i just repalce with original and just ctd if i make some change)

You add 80 so you have now 80 + 80 = 160 ? You need to remove a letter somewhere.

**Vowlesy** · February 22, 2009, 10:54 AM

@oneah, reload the backup and check the game starts up as normal, then take things from there. Easiest thing to try to see if it working is change a units experience.

@Methoz
"You are left with +2 character change (rank_fire is two characters shorter than fire_volley), you could add two letters to a generals name or change two units numbers to over two digits (IE, 100,150,199,500) to balance this."

**peterbcfcfan** · February 22, 2009, 10:55 AM

Im crashing when trying to play as the americans

**oneah** · February 22, 2009, 10:57 AM

and what about the mod change to allow playing with the americans? anything we must change in that one?

**peterbcfcfan** · February 22, 2009, 10:58 AM

Can anyone help, I am just crashin on start-up, as soon as it gets to the licensing screen.

**ilikeicehockey** · February 22, 2009, 11:00 AM

How do I find the folder in Vista? I tried a search but couldn't find steamapps

**Methoz** · February 22, 2009, 11:01 AM

noo.. i want to chage 45 british soldiers to 80,but my game just crash if i make it....

**sinople** · February 22, 2009, 11:04 AM

How do I find the folder in Vista? I tried a search but couldn't find steamapps

c:\username\AppData\roaming\the creative assembly

**Vowlesy** · February 22, 2009, 11:05 AM

I imagine you've unknowingly changed something else, revert to backup and try again. 45-80 shouldn't be a problem.

American mod should work, if not, simply add "-- "(defining a comment line in the file) and remove three characters from the start of the line following this.

enemy_america_euro_generals_bodyguard = enemy_units:item("america_euro_generals_bodyguard")
controller_america_euro_generals_bodyguard = enemy_army:create_unit_controller()
controller_america_euro_generals_bodyguard:add_units(enemy_america_euro_generals_bodyguard)
controller_america_euro_generals_bodyguard:take_control()
controller_america_euro_generals_bodyguard:halt()

too

enemy_america_euro_generals_bodyguard = enemy_units:item("america_euro_generals_bodyguard")
controller_america_euro_generals_bodyguard = enemy_army:create_unit_controller()
conntroller_america_euro_generals_bodyguard:add_units(enemy_america_euro_generals_bodyguard)
-- troller_america_euro_generals_bodyguard:take_control()
-- troller_america_euro_generals_bodyguard:halt()

Do this for all the british and american units defined after line 3042477,
leave the first three lines and comment out the last two (or the take_control() and halt() lines).

**peterbcfcfan** · February 22, 2009, 11:08 AM

Originally Posted by Vowlesy

I imagine you've unknowingly changed something else, revert to backup and try again. 45-80 shouldn't be a problem.

I'm looking at the american mod right now and will post my fix.

Ok thanks

**Dr. Croccer** · February 22, 2009, 11:13 AM

Originally Posted by sinople

c:\username\AppData\roaming\the creative assembly

There isn't a pack file or a data file in there....

**sinople** · February 22, 2009, 11:16 AM

I don't have Vista this is just what some of the people posting in the other thread said

**Dr. Croccer** · February 22, 2009, 11:21 AM

Originally Posted by sinople

I don't have Vista this is just what some of the people posting in the other thread said

Well, never mind because it's on the XP spot for some reason. Editting now.

Thread: [Demo Modding] Detailed How-to with Unpacker (Demo Mod General Discussion)

Thread Tools

Search Thread

Display

[Demo Modding] Detailed How-to with Unpacker (Demo Mod General Discussion)

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Re: Demo MOD:Detailed How-to

Posting Permissions