High Compression of files.

[4537256]

I have seen a few files this past year, namely some games that are like 5 gigs compressed into about 1 gig, usually i noticed that a small few people ever do it, seems to be a key secret to it and never have i been able to get that kind of compression from a file normally.

I have a few videos and games i need to store for extra backup and would love to know the secret. Can anyone help?

 

[Sam25]

I did a Google search and found some suggestions for this:

http://www.klaimsoft.com/winuha/

 

[0roo0roo]

what are these files you've seen?
any decently compressed video/audio wont compress much at all in a zip or rar.

let alone 5:1.

never mind the problem of corruption rendering the entire archive useless.

 

[HexiumVII]

try the free 7zip. Use Ultra compression level with 32 or 64 MB dictionary. You can compress office 2003 700MB down to 60MB with that option. YMMV.

 

[4537256]

Originally posted by: 0roo0roo
what are these files you've seen?
any decently compressed video/audio wont compress much at all in a zip or rar.

let alone 5:1.

never mind the problem of corruption rendering the entire archive useless.

like i said games and a few i noticed was blue ray and these i'm talking about are from Torrents. The decompression method is very different, usually this Command prompt comes up and does the decomression itself which takes 2-3 times longer than normal.

one game i have was like 6.7 gig normally rar'd by other uploaders and one guy has it at 1.6 gigs. it plays perfectly.
i have a blue ray video that was only 6 gigs and others have it at over 50 gigs. Looks great but i cant say certainly that its quality is same as original but looks it enough to me.

so thats all i know about it and just wanted to see if anyone knew more. The video's might be downgraded some way but the games size's i'm definitly impressed with and would like to do some of my data files like that.
no setting in 7zip nor winrar ever got near that ratio for me.

 

[sriraj46]

ya,zipped file wont be that lesser in size compared to normal

 

[4537256]

yeah, this here is what i'm talkn about

Windows Xp 64bit 6 In 1 only 10mb File size: Compressed=10 MB Un-compressed=3.7 GB

and yes, it really works and full XP

 

[0roo0roo]

Originally posted by: 4537256

Originally posted by: 0roo0roo
what are these files you've seen?
any decently compressed video/audio wont compress much at all in a zip or rar.

let alone 5:1.

never mind the problem of corruption rendering the entire archive useless.

like i said games and a few i noticed was blue ray and these i'm talking about are from Torrents. The decompression method is very different, usually this Command prompt comes up and does the decomression itself which takes 2-3 times longer than normal.

one game i have was like 6.7 gig normally rar'd by other uploaders and one guy has it at 1.6 gigs. it plays perfectly.
i have a blue ray video that was only 6 gigs and others have it at over 50 gigs. Looks great but i cant say certainly that its quality is same as original but looks it enough to me.

so thats all i know about it and just wanted to see if anyone knew more. The video's might be downgraded some way but the games size's i'm definitly impressed with and would like to do some of my data files like that.
no setting in 7zip nor winrar ever got near that ratio for me.

there is no chance in hell that a 6 gig bluray rip looks like a 50 gig bluray rip. it just is impossible, you think the studios are ignoring some fancy video compression when they chose bluray? of course not, bluray is already using the best h264 encoding we have right now. the only bluray rips that make it to 6gb are the 720rips, aka half resolution recompression of bluray and using the same h264. on a small screen you might not see the difference, on a large one its half the resolution no way around that.

games are different, its code, that compresses well. and if they cheat and rip out secondary language content or whatever and try to get around whatever copy protection tricks they had by compressing dummy files full of garbage and recreating them..it might make the difference in size, but its not magic there either. release teams sometimes rip stuff out of games/recompress media content to get rips to such low levels. these are folks that dig into games to write the cracks after all, it is not as simple as "zipping" something. its not something that can be automated.

 

[vshah]

no way that 10mb xp is legit...

 

[Fardringle]

Originally posted by: vshah
no way that 10mb xp is legit...

Agreed. Some of the files on the Windows XP install CD compress very well, but most don't. WinRAR's best possible compression settings only shrunk the Windows XP 9in1 CD ISO from 700 MB to 642 MB. There's no possible way that a 3.7GB XP64 DVD ISO was compressed to 10MB unless they deleted everything from the image other than the TXT files and then compressed just those remaining files...

 

[4537256]

lol i just said it works, i installed it on my compaq presario. decompressed its around 4 gigs and looks like all the components are there, i mean it doesnt seem nlited or nothing.

anyway, thats exactly the kind of file compression i was reffering to in my first post, cause quite a few very high compressed files exist that actually do work..i know cause i have downloaded some. Obviously no one here knows the tricks to doing such so no need to further discuss. if you cant believe it then look in torrents, you'll cross some...that particular one came as a bonus for Stalker Clear skys torrent...anyway, i'm not here to prove anything, i'm here to ask how they do it...dont know then dont bother

 

[Quiksilver]

Well that XP 6 in 1 your talking about says it was compressed using:
http://kgbarchiver.net/

So give it a shot?

There is probably more to it than just compressing stuff though.

 

[4537256]

awesome i didnt even notice it said what was used, i'll give it a shot and play with the settings if there is any

 

[0roo0roo]

Originally posted by: 4537256
lol i just said it works, i installed it on my compaq presario. decompressed its around 4 gigs and looks like all the components are there, i mean it doesnt seem nlited or nothing.

anyway, thats exactly the kind of file compression i was reffering to in my first post, cause quite a few very high compressed files exist that actually do work..i know cause i have downloaded some. Obviously no one here knows the tricks to doing such so no need to further discuss. if you cant believe it then look in torrents, you'll cross some...that particular one came as a bonus for Stalker Clear skys torrent...anyway, i'm not here to prove anything, i'm here to ask how they do it...dont know then dont bother

i've seen some tricks. i've seen an installer regenerate the games format of audio files from higher compression mp3s and such. but thats basically a hack, its not lossless compression at all. it takes a lot of digging and expertise and trouble to do such things. but thats their hobby. its not something you can do yourself easily

 

[4537256]

Originally posted by: 0roo0roo


i've seen some tricks. i've seen an installer regenerate the games format of audio files from higher compression mp3s and such. but thats basically a hack, its not lossless compression at all. it takes a lot of digging and expertise and trouble to do such things. but thats their hobby. its not something you can do yourself easily

makes sense, would be fun to learn some of it though but not sure what to search for but KGB archiver did a pretty good job, i compressed 3.6 gig backup game down to 667 megs, saves me alot of room on my backup drive. now i'm curious to compress even lower hehe

 

[0roo0roo]

well assuming you've not been trojaned and root kitted lol

you can't be sure you haven't!

 

[4537256]

Originally posted by: 0roo0roo
well assuming you've not been trojaned and root kitted lol

you can't be sure you haven't!

if you mean from the XP...its installed on a P3 compaq. lol, who cares

 

[Fardringle]

Originally posted by: Quiksilver
Well that XP 6 in 1 your talking about says it was compressed using:
http://kgbarchiver.net/

So give it a shot?

There is probably more to it than just compressing stuff though.

I know this is a little bit old but I was intrigued by the claims made about KGB Archiver and it took some time to do the testing I wanted to do since my computer has plenty of RAM but the CPU isn't particuarly fast, and I've been distracted playing games.

Overall I'm really disappointed with the results. I tested it with my Windows XP 9-in-1 utility ISO and a couple of game images and even on Maximum compression setting it didn't shrink the ISO files significantly better than WinRAR did, and it took more than 13 times longer to finish the process. WinRAR's Best compression setting took 14 minutes to shrink the 700MB XP image file to 642 MB. KGB's Maximum setting took 3 hours and 10 minutes to shrink the 700MB image down to the same 642 MB.


I also did the standard test with Calgary Corpus and WinRAR shrunk the collection from 3,175 KB to 771 KB on Best compression (it took 5 seconds). KGB's Maxiumum compression setting did shrink the collection down to 630 KB so it's a little better than WinRAR's best setting, but it took two minutes to finish instead of a few seconds.


Conclusion: KGB Archiver can shrink easily compressed files like text files in Calgary Corpus very well, but it doesn't work as well on applications and disc images.


edit: I forgot the 7zip numbers. 7zip compressed the Calgary Corpus collection to 833 KB in 8 seconds and the XP ISO to 645 MB in 15 minutes using Ultra compression settings and the largest word and library sizes.

 

[4537256]

Originally posted by: Quiksilver


Conclusion: KGB Archiver can shrink easily compressed files like text files very well, but it doesn't work as well on applications and disc images.

i compressed 3.6 gig backup game down to 667 megs.
i got similar with several others, chessmaster 10 is like 50 megs +/-. i havnt tried any other files

 

[Fardringle]

That's probably because the files on the XP CD are already compressed, and the game files you're using are not. It's a nice way to save space if you need to make room, but even when it does a good job I don't think the long processing time of the KGB program is worth the relatively small gains over other compression programs. If the goal is maximum compression, and you're packing the right types of files, it does work well as long as you don't mind waiting.

 

[Ken g6]

If you want lots of compression options, try PeaZip. PeaZip is a GUI interface to lots of different compression programs, including the former world-champion compression program paq8o.

Compression is a tradeoff between size and speed. paq8o compresses things very well, but extremely slowly. Furthermore, there are diminishing returns to taking longer: paq8o won't do very much more compression than 7-zip, for instance.

Oh, and apparently KGB Archiver is a frontend to PAQ6v2, an older, less-effective version of PAQ.

 

[Fardringle]

Interesting. The paq8o option in PeaZip got the Calgary Corpus down to 605 KB, which is pretty impressive, but it took 10 minutes to do it. That's a huge difference when WinRAR and 7zip both compressed the files in under 10 seconds. Granted, they didn't compress it as much as paq8o did, but they did it 75 to 120 times faster...

I imagine that paq8o could improve on the results that the other programs got with my Windows XP ISO test since it did so well with the Calgary Corpus test, but I'm not willing to wait a week for it to finish.

 

[Ayah]

That's a buttload of compression. Good for saving bandwidth.
(internet is limited where I live, 10GB a month for the 60$/month cable package)

 

[4537256]

i keep OS's on dvd/cd so their installable, game backups were my main concern, though the best option is to simply invest in a large hard drive, which i'll do at some point. As far as time it takes to compress...well i dont keep a tight schedule, no big deal to let my computer run while i do other stuff.

i take it paq8p is the best?

As of September 28, 2008 it ranked the latest versions of 198 compression programs. Using the point system, PAQ8P was ranked first (before WinRK 3.0.3). On overall size, PAQ8P was also ranked first.

though i wouldnt mind knowing the secret of the quote below, it works and impressive, but i have no use for a compressed OS.

Windows XP 64Bit 6 In 1 (DVD/ only 10MB) | 10 Mb

It's only 10 MB, and will require 3.5 GB Hard disk space for extract this ISO file.

It contains DVD, 6 x64 versions of windows:
Windows XP X64 Retail
Windows XP X64 Corp
Windows 2003 X64 Ent. Retail
Windows 2003 X64 Std. Retail
Windows 2003 X64 Ent. Corp
Windows 2003 X64 Std. Corp