« previous next »
Pages: [1]   Go Down

Author Topic: best compression method?  (Read 4020 times)

0 Members and 1 Guest are viewing this topic.

Offline Snake X

  • Ancient Veteran
  • LV8 Addict (Next: 1000)
  • ********
  • Posts: 810
  • Rating: +33/-8
    • View Profile
best compression method?
« on: June 24, 2011, 12:02:37 pm »
I have about 170 GB of storage (or will get there shortly), and i need to move that stuff over to a 150 GB raid setup (only way to do it). Now, with that said I need to chop off about 20 GB, and what is the **BEST** compression method that I can do to achieve this? I do NOT care how long it takes to compress, i just need to do it.

rar?
7z?
tar?

which one, or something else?

thanks!  :thumbsup:
Logged
Loved this place, still the best producers of power metal, and sparked my dreams of coding.

Offline Munchor

  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 6199
  • Rating: +295/-121
  • Code Recycler
    • View Profile
Re: best compression method?
« Reply #1 on: June 24, 2011, 12:04:56 pm »
7zip is the best one if you want smaller size. However, zip is the fastest one to compile, but I see you're interested in 7z here.
Logged

Offline Snake X

  • Ancient Veteran
  • LV8 Addict (Next: 1000)
  • ********
  • Posts: 810
  • Rating: +33/-8
    • View Profile
Re: best compression method?
« Reply #2 on: June 24, 2011, 12:06:28 pm »
someone told me tar was the best of them all though... :???
Logged
Loved this place, still the best producers of power metal, and sparked my dreams of coding.

Offline Munchor

  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 6199
  • Rating: +295/-121
  • Code Recycler
    • View Profile
Re: best compression method?
« Reply #3 on: June 24, 2011, 12:08:52 pm »
http://ubuntuguru.wordpress.com/2007/03/09/whats-the-best-file-compression-method/

Well, at least tar.gz and tar.bz2 are missing there, but from all those 7z is the faster.
Logged

Offline Snake X

  • Ancient Veteran
  • LV8 Addict (Next: 1000)
  • ********
  • Posts: 810
  • Rating: +33/-8
    • View Profile
Re: best compression method?
« Reply #4 on: June 24, 2011, 12:14:40 pm »
ok so in 7z, what is the best compression method that I should use?
Logged
Loved this place, still the best producers of power metal, and sparked my dreams of coding.

Offline Munchor

  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 6199
  • Rating: +295/-121
  • Code Recycler
    • View Profile
Re: best compression method?
« Reply #5 on: June 24, 2011, 12:15:13 pm »
Quote from: Snake X on June 24, 2011, 12:14:40 pm
ok so in 7z, what is the best compression method that I should use?

The extension *is* called .7z
Logged

Offline Snake X

  • Ancient Veteran
  • LV8 Addict (Next: 1000)
  • ********
  • Posts: 810
  • Rating: +33/-8
    • View Profile
Re: best compression method?
« Reply #6 on: June 24, 2011, 12:19:40 pm »
i mean as in:

Logged
Loved this place, still the best producers of power metal, and sparked my dreams of coding.

Offline Munchor

  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 6199
  • Rating: +295/-121
  • Code Recycler
    • View Profile
Re: best compression method?
« Reply #7 on: June 24, 2011, 12:30:04 pm »
Sorry, but my Archive Manager doesn't ask for any of that. Try the 4 of them with a 100MB Folder and see which one gives better results. But I don't think it matters so much, go with default.
Logged

Offline AngelFish

  • Is this my custom title?
  • Administrator
  • LV12 Extreme Poster (Next: 5000)
  • ************
  • Posts: 3242
  • Rating: +270/-27
  • I'm a Fishbot
    • View Profile
Re: best compression method?
« Reply #8 on: June 24, 2011, 12:47:02 pm »
If you're going to use 7zip, use PPMd. However, if you'd like something with even higher compression, try PAQ, which is generally considered one of the best general purpose compression algorithms in existence.

That said, what algorithm you use depends heavily on what you're compressing. If you're compressing things with a lot of repetitive data, simple Huffman encoding will give you a near optimal results. If you're compressing random binary noise, no compression algorithm is going to do well.
Logged
∂²Ψ    -(2m(V(x)-E)Ψ
---  = -------------
∂x²        ℏ²Ψ

Offline alberthrocks

  • Moderator
  • LV8 Addict (Next: 1000)
  • ********
  • Posts: 876
  • Rating: +103/-10
    • View Profile
Re: best compression method?
« Reply #9 on: June 24, 2011, 01:05:56 pm »
To correct, tar is NOT a compression method. It's just a nice format to combine directories and files into one file, and then a compression (like BZIP, GZIP, etc.) is applied onto that file.
To explain visually:

Code: [Select]
[ Files and folders! ]       [ TAR Archive    ]       [ bzip2 Compress ]
[ somefolder/        ]       [                ]       [                ]
[    file1           ]       [ DATA           ]       [ data compresed ]
[    file2           ]       [                ]       [ with RLE, BWT, ]
[    file3           ]       [ somefolder blk ]       [ MTF, RLE, then ]
[ somefolder2/       ]  ==>  [   file1 blk    ] ==>   [ Huffman, base  ]
[    afile1          ]       [   file2 blk    ]       [ 1, delta enc., ]
[    afile2          ]       [   file3 blk    ]       [ bit array!     ]
[    afile3          ]       [ somefolder2 blk]       [                ]
[ anotherfile1       ]       [   afile1 blk   ]       [ TAR ARCHIVE    ]
[ anotherfile2       ]       [   afile2 blk   ]       [     ↓↓↓        ]
[ anotherfile3       ]       [   ...          ]       [ BZip2 comp. dat]

blk = data block entry for file/folder/link
More info about tar and compression (bzip2) can be found here:
http://en.wikipedia.org/wiki/Bzip2
http://en.wikipedia.org/wiki/Tar_%28file_format%29

Hope this helps! :)
Logged
Withgusto Networks Founder and Administrator
Main Server Status: http://withg.org/status/
Backup Server Status: Not available
Backup 2/MC Server Status: http://mc.withg.org/status/


Proud member of ClrHome!

Miss my old signature? Here it is!
Spoiler For Signature:
Alternate "New" IRC post notification bot (Newy) down? Go here to reset it! http://withg.org/albert/cpuhero/

Withgusto Networks Founder and Administrator
Main Server Status: http://withg.org/status/
Backup Server Status: Not available
Backup 2/MC Server Status: http://mc.withg.org/status/

Activity remains limited due to busyness from school et al. Sorry! :( Feel free to PM, email, or if you know me well enough, FB me if you have a question/concern. :)

Don't expect me to be online 24/7 until summer. Contact me via FB if you feel it's urgent.


Proud member of ClrHome!

Spoiler For "My Projects! :D":
Projects:

Computer/Web/IRC Projects:
C______c: 0% done (Doing planning and trying to not forget it :P)
A_____m: 40% done (Need to develop a sophisticated process queue, and a pretty web GUI)
AtomBot v3.0: 0% done (Planning stage, may do a litmus test of developer wants in the future)
IdeaFrenzy: 0% done (Planning and trying to not forget it :P)
wxWabbitemu: 40% done (NEED MOAR FEATURES :P)

Calculator Projects:
M__ C_____ (an A____ _____ clone): 0% done (Need to figure out physics and Axe)
C2I: 0% done (planning, checking the demand for it, and dreaming :P)
Pages: [1]   Go Up
« previous next »