If you were to zip the entire forums, from past to present, how big would it be?

jlee

Lifer
Sep 12, 2001
48,518
223
106
If you were to zip the entire forums, you'd wind up with a .zip, not a .rar.

:p
 

EKKC

Diamond Member
May 31, 2005
5,895
0
0
5kb. the person zipping the DB forgot to include the subdirectories.
 

Jawo

Diamond Member
Jun 15, 2005
4,125
0
0
Well if you leave out ATOT, I bet it would be a great deal less with all the neffing going on! :D
 

Jzero

Lifer
Oct 10, 1999
18,834
1
0
Considering it's pretty much entirely text, probably a lot less than you think. Probably < 15 GB.
 

BeauJangles

Lifer
Aug 26, 2001
13,941
1
0
How does fusetalk manage the search feature? if it is anything like phpbb, which indexes every word ever posted, then the DB easily could top 20 gb.
 

The Batt?sai

Diamond Member
Jan 18, 2005
5,170
1
0
Originally posted by: CadetLee
If you were to zip the entire forums, you'd wind up with a .zip, not a .rar.

:p

lol

use rodney's encryption. should be 7% of the regular size of a zip file ;)
 

tfinch2

Lifer
Feb 3, 2004
22,114
1
0
Originally posted by: quasarsky
Originally posted by: CadetLee
If you were to zip the entire forums, you'd wind up with a .zip, not a .rar.

:p

lol

use rodney's encryption. should be 7% of the regular size of a zip file ;)

what the fvck is rodney's encryption?
 

everman

Lifer
Nov 5, 2002
11,288
1
0
A good compression algorithm would realize that we just post the same stuff every day, so the file would be quite small.
 

The Batt?sai

Diamond Member
Jan 18, 2005
5,170
1
0
Originally posted by: tfinch2
Originally posted by: quasarsky
Originally posted by: CadetLee
If you were to zip the entire forums, you'd wind up with a .zip, not a .rar.

:p

lol

use rodney's encryption. should be 7% of the regular size of a zip file ;)

what the fvck is rodney's encryption?

its a sga thing ;)

not the college kind :)
 

duragezic

Lifer
Oct 11, 1999
11,234
4
81
There's multiple computers/servers to deal with the different parts as far as things like the database for searching.

For how much is here, the zip file size probably wouldn't be too bad. AFAIK the way file compression works is finding redundancies with words and groups of characters so with it mostly being text/conversation it should be able to compress fairly well, probably greater than 50%.


edit: And LOL you're right about the reposts and heavy neffing, so expect much greater than 50% compression. :)
 

Evadman

Administrator Emeritus<br>Elite Member
Feb 18, 2001
30,990
5
81
It depends on how the data is actualy stored. This calcualtion only holds true for char and nchar data types, and is based on SQL Server. If fusetalk uses an image, or text data type, then this can be MUCH larger, but the end result is roughly equivelent to the actual text of the post.

varchar or nvarchar: 23168191 * 8000 * 4 = 74138211200 (This post that I am posting in is post number 23168191 if you were wondering)

So, uncompressed, the text that makes up all the posts ever posted would be 74.138 GB.

Straight text compresses VERY well, so assuming what I can compress text fields that are the same size at work with gzip would make 74.138 GB of text be about 7.4 GB.
 

eelw

Lifer
Dec 4, 1999
10,228
5,342
136
Well so far, this topic is 370kB and ZIPed up to 148kB. Let's pretend this is the average size of a topic here on AT, with over 300,000 active posts, that's over 11GB uncompressed. Add the archives, that could very well be around 1/4TB.
 

simms

Diamond Member
Sep 21, 2001
8,211
0
0
Originally posted by: eelw
Well so far, this topic is 370kB and ZIPed up to 148kB. Let's pretend this is the average size of a topic here on AT, with over 300,000 active posts, that's over 11GB uncompressed. Add the archives, that could very well be around 1/4TB.

Just text right? not including the HTML?