Postimage.org is in danger and needs your help

Elixer

Lifer
May 7, 2002
10,371
762
126
This was my go-to image hosting service, and now, they need a new hosting service.
I suppose imgur is the only one left now?


http://Postimage.org
Please contact us if you have a CDN that is capable and willing of serving 1.8 Petabytes of outgoing traffic per month free of charge, or if you can make a donation to help us pay a monthly $12,000 bill from CloudFlare that we are now facing.

What's happening?
On October 27, 2016, CloudFlare abruptly cut us off from most of their services except DNS for abusing their system. This came as a bit of a surprise, since although we've been using one of their cheapest plans for a long time, we had reached an agreement earlier this month that we would be upgrading our account when the next billing cycle started. A couple of Skype calls later we learned the following:

  • CloudFlare was very unhappy that the total traffic usage of our project had surpassed a staggering figure of 1.8 petabytes in the last 30 days.
  • The amount of money we had to pay monthly to make them happy again grew after each Skype call as more people in CF got involved in examining our case: $200 became $1000, which in turn became $12k.
  • The sales team was adamant that although CloudFlare did not officially have bandwidth limits, our violation of Section 10 of their terms of service could not be remedied by serving less image traffic and more HTML traffic (although, being an image hosting company, we have no idea how we would pull this one off anyway without blatantly gaming the system), and that at the level of petabytes of data, they would never allow that on a $200/month Business plan.
  • We were officially screwed.
Let us make this absolutely clear: we do not hold a grudge against CloudFlare for refusing to foot our traffic bill any further. We do realize that we are costing them a ton of money, and it is solely our own fault that our current business model is not sustainable. We also recognize that the deal they offered is probably as good as anything we could reasonably expect from other CDN providers. The only thing we disagree with is that instead of publishing estimates of how much traffic customers are actually allowed to consume at each service plan, CloudFlare insists that their bandwidth is unlimited and declines to comment on the actual terms of service.

What should we do now?
A likely outcome is that Postimage.org will have to shut down, terminating nearly 140 million images embedded into some 450 thousand websites, first and foremost a number of great message boards (although a lot of online auctions, personal galleries and corporate websites will be affected as well).

While we are definitely bothered that the project on which our modest livelihood depends is shutting down, this latter circumstance bothers us much more. We will hopefully find other jobs to pay our bills, but a huge historical layer spanning more than a decade of some of the Internet's most vibrant communities will be obliterated forever. Thus, at this point failure is not an option; we must fight tooth and nail to keep Postimage.org running.

Where's the money?
Historically, advertising revenue has been our main source of income [approximately a 50/50 split between AdSense and content recommendation systems]. While we've recently decided to experiment with header bidding platforms, we have yet to collect a single dollar from these experiments, so we don't really know if this will work.

We are also considering the option of running a crowdfunding effort a la Reddit Gold or a donation system. Our main website is seeing 8 million unique users per month, and if just 0.125% of our userbase sent us $1 every month, that would be enough to cover our traffic bills and stay with CloudFlare.

Finally, there is an option to try a different role in the digital marketing industry, perhaps even become a DMP data source as well as a publisher (our recent measurements indicate that we're serving over 28 million unique daily users over our whole network of 450k websites). However, we have to first answer a couple of important questions such as if this data is actually worth anything, and if such a privacy-impairing tradeoff would be acceptable for our users if that's what it took to keep their images online.
 

Crono

Lifer
Aug 8, 2001
23,720
1,502
136
I use tinypic.

I should just be using my own, though. Maybe I'll put one up tomorrow, if I have time.
 

Red Squirrel

No Lifer
May 24, 2003
70,365
13,687
126
www.anyf.ca
Damn 1.9PB that's a lot. Sucks that Cloudflare advertises unlimited bandwidth, and then pulls off that crap to them. They should not advertise unlimited if it's not really unlimited. I do wonder an image/file hosting service does in fact make money though. Same with Imgur. Apparently Imgur even has actual offices with actual workers, no idea how that works, I would have figured it's just a guy running it from his house (on a bunch of collocated servers somewhere type deal) as a side gig.

One of my forums actually uses it for attachments, I never even realized it initially when I set it up, I normally would not set up something to rely on a 3rd party service. Will be setting up a new forum so it will use local attachments.
 

XavierMace

Diamond Member
Apr 20, 2013
4,307
450
126
SECTION 10: LIMITATION ON NON-HTML CACHING
You acknowledge that CloudFlare’s Service is offered as a platform to cache and serve web pages and websites and is not offered for other purposes, such as remote storage. Accordingly, you understand and agree to use the Service solely for the purpose of hosting and serving web pages as viewed through a web browser or other application and the Hypertext Markup Language (HTML) protocol or other equivalent technology. CloudFlare’s Service is also a shared web caching service, which means a number of customers’ websites are cached from the same server. To ensure that CloudFlare’s Service is reliable and available for the greatest number of users, a customer’s usage cannot adversely affect the performance of other customers’ sites. Additionally, the purpose of CloudFlare’s Service is to proxy web content, not store data. Using an account primarily as an online storage space, including the storage or caching of a disproportionate percentage of pictures, movies, audio files, or other non-HTML content, is prohibited.

All the hosting companies I've dealt with have similar restrictions in their ToS. The second I saw them talking about "$200 becoming $1000" I knew how this was going to end. I saw it all the time back when I worked at a hosting company. People buying a cheaper product against recommendations thinking they could game the system and save themselves buckets of cash. I don't blame them for trying to save money, but eventually the other shoe will drop and they have nobody to blame but themselves. We run about 4TB a day out of each of our CoLo's. When you're dealing with that kind of traffic, $200/mo doesn't come close to covering your ISP bill, to say nothing of the rest of the infrastructure.
 

John Connor

Lifer
Nov 30, 2012
22,757
618
121
I wonder if Amazon AWS S3 could do this? With that amount of traffic go CloudFront at Amazon.
 

Newbian

Lifer
Aug 24, 2008
24,779
882
126
Never used it as I prefer the ease of imgur plus you don't have to deal with account bs if you don't want to for it.

Otherwise yea a business can advertise unlimited but when you exploit it bad things will happen as we have seen with isp's and such.

While it is bs you should not expect to use 1.8 petabytes and think you can get away with a cheap unlimited plan like that.
 

lxskllr

No Lifer
Nov 30, 2004
59,714
10,221
126
Imgur sucks. It's turned into a bloated js pig. I've been using i.sli.mg lately, and it works the way imgur used to.
 

Elixer

Lifer
May 7, 2002
10,371
762
126
Looks like they are now back.
V is for Victory

Thanks to your tremendous efforts and generous donations, the crisis has been averted. The victory belongs to you, our users. Your donations bought us enough time to keep our servers humming while we were figuring out what to do. Your technical expertise allowed us to cut some corners and employ clever tricks. Your connections finally allowed us to establish contact with parties that made a long-term solution affordable. Your emails kept us going on extra-long workdays, because we knew that you were counting on us. We hereby wish to thank everybody who extended their help and advice, and would especially like to mention and recommend the following parties:

AdvancedHosters for their stellar tech support and for offering great terms for their CDN service
SG.GS for their technical expertise and generous bandwidth consumption terms

Also, the following parties readily came to our aid, although our needs did not exactly match their expertise:

DaciHost for offering us a powerful dedicated server for free
Aba-Soft for designing a custom private cloud solution to help us handle the uncached load
Greta.io for offering their ingenious peer-2-peer CDN technology

A special thank you goes to every single one of the 159 people who contributed a total of over $1700 of donations via PayPal. This would not be possible without you.
 

purbeast0

No Lifer
Sep 13, 2001
53,582
6,424
126
Shared hosting and using 1.8 petabytes of data a month and they are surprised their 'unlimited shared' hosting plan isn't going to work out anymore?

While they do say they aren't upset or angry with the hosting company for doing this and understand why they have to, why would anyone in their right mind think that this could be used for a viable long term solution?
 
Feb 25, 2011
16,992
1,621
126
...why would anyone in their right mind think that this could be used for a viable long term solution?
Because a lot of people have great ideas and can design web 2.0 synergy applications cross platform agile disruptive killer apps. But they have no idea how servers and data centers actually work.

"Unlimited" plans are for people who don't want to worry about occasionally going over their monthly limit by a GB or two because they had somebody FTP them some files. Transferring 65TB a day is lease-your-own-dedicated-line territory. (Near as I can figure, that's a solid 800Mbps?)

My bet is most of that is .gif uploads.
 

Red Squirrel

No Lifer
May 24, 2003
70,365
13,687
126
www.anyf.ca
To be fair this whole "unlimited is not really unlimited" shit needs to be illegal. It's false advertising. You should not be able to advertise a service as being unlimited when it really is not. I know it's near impossible to offer that for free or cheap so I'm always skeptical when I see it, but a lot of people still think it's really unlimited.