Another 60,000 missing blocks today.

[Russ]

On top of the 60,000 missing yesterday. Yes, I know Dnet's proxies are plugged, but I also know that last time this happened we didn't get back all the blocks; they LOST a good portion of them.

Near as I can calculate, all of Dnet's screwups have cost TA Cube and Team AnandTech over a half million blocks and counting. This is getting damned tiresome.

Russ, NCNE

 

[Viztech]

OGR output is way down for the day as well, but they OGR work always seems to get counted for T-Storm anyway.

Hopefully the new stats box at the new location will clear up these backlog problems...

Hope those Borg blocks get counted.

viz

 

[Adul]

You can not forget about randoms trhat reduce it some. But 60k!? grrrr

 

[Russ]

Adul,

It's not randoms. It's screwups.

Russ, NCNE

 

[Tripleshot]

Something is going on!:| I have 6 puters in my herd cracking RC5(Sorry I haven't built the crack rack yet Russ. When I do,I'll join Borg if there is room)and today I only have submitted 258 blocks? No wonder DPC passed us up. I wish I knew what the hell is going on. I don't feel like wasting electicity on keeping these machines running to have 90% of my blocks vanish in to thin air.

Frustrated again:|

 

[Jarhead]

Tripleshot,

I feel your pain. I'm up to 1,800 blocks and only got credited for 301 or something like that.

However, I flush through the regular servers, and I still lost out.

I've often wondered if the workload at dnet is evenly distributed IAW where the blocks are comming from...

 

[lilstevo]

that sucks that we lost 60K blocks. you guys notice them power cows outnumber us like 2 to 1. we must be doing really well if we top there with a them.

 

[Nohr]

That's odd. I have all my herd flushing through proxy.teamanandtech.com and the stats at dnet show I did 18 blocks more than what the proxy says. Just something I thought I'd mention.

Nohr.

 

[Lord Demios]

All I got to say, is that DAMN, we all know blocks are getting lost/not counted yet. And bitching about it doesn't do anything. It only detracts from the team.

So we lost 1/2 million blocks. This also means other teams are loosing blocks at about the same rate. SO........ We are all still pretty even.

Quit the bitching, and maybe do something useful like get more machines.

LD

 

[Ken g6]

Nohr, note that the proxies don't flush instantly. Is it possible your 18 blocks got recorded for yesterday on the proxy, but today on D.Net?

 

[Dennis Travis]

Something is wrong for sure. I had to take my main box offline for a few hours to do a hardware upgrade and repair Win 2k but I still had my other 2 systems online and I am at the lowest for the day that I have been. I should be at 5 times where I am listed for the day.

 

[Nohr]

Yeah Ken, looks like that's what might've happened. Lost 25 blocks on the 17th. I noticed before that I've been losing some blocks the past few days, but usually it's been only one or two. Nothing huge like what others seem to be experiencing.

Nohr.

 

[Marnix]

Ehm because of the 10.000.000 DPC Flush, the Backlog of D.nets RC5 is very high. Some DPC-subteams are still missing blocks a lot af blocks too... Well, we try to flush not too much again so we hope everything will be okay within a day or 2. Maybe the blocks that are missing are in the stats of tomorrow or sunday.

 

[eNeRGy]

I am collecting the total size of the backlog since 2001-01-17 19:00

Graph

 

[TOOCOOL]

Lord
Demios/TMR

this is a forum that has free speech if people want to vent about lost Wu's it's their right!



<< Quit the bitching, and maybe do something useful like get more machines. >>



seems to me that the person bitching has allready got more machines than most(understated)!

just my opinion

 

[LANMAN]

This is very frustrating! You would think for a organization taking on this kind of commitment, they would be more prepared to handle the proxies and more server power for the key server. Did Dnet bit off more then they want to chew? Yet everyone gets all excited when CPU speeds increase, more users join Dnet, and the Dnet's hardware can't handle it.

I don't know about everyone else, but if I did my job half a$$, you can damn believe that I would be replaced with someone that WILL get it done right, the first time.

My words to Dnet? - Quit giving us excuses on why it isn't working.. give us results!! We don't care what the problem is, JUST FIX IT, or find someone else that can! :|:|

--LANMAN

 

[Russ]

<< Quit the bitching, and maybe do something useful like get more machines. >>



LD,

On the 17th, one of the members of TA Cube, a small member who doesn't have a giant herd at his disposal, flushed 30,000 blocks that he had been saving for a long, long time.

I'm sure that he was proud and happy to contribute that work, and was excited waiting to see it reflected in the total.His blocks are not counted.

You go tell him to get more machines after all his effort was just flushed by Dnet's ineptitude.

Russ, NCNE

 

[Quaggoth]

cond that

 

[JHutch]

Russ,

I agree this is frustrating, but as far as the blocks from yesterday ... The proxies are WAY backed up today. There is over 40 MILLION blocks still trying to make it's way to the keyserver. Other than the one time last month, I've seen all blocks eventually make it to the keyserver in these instances. Last month is a big time anomaly, not a normal thing...

To all:

From another perspective, the multiple redundant nature of the proxy system allows the keyserver to go down and still every keeps chugging along. Compare this to the SETI system where there is one database server (equivalent of the DNET keyserver) and if this machine goes down for any reason, no one can get units or turn units in. Basically, the whole distributed computer &quot;stops.&quot;

DNet's system isn't perfect (and despite what some people think, NOTHING is ever perfect). Could it be better? You better believe it! Has the whole DNet system scaled amazingly well? You better believe it! When I first got started, the whole total for a day was less than what just DPC and TA do in a day now! Now, the whole of DNet does over 30million a day regularly.

I'm not trying to be total apologists for DNet, but just want everybody to realize that things are a lot better than you think they are. (Which is also where I think Lord Demios' little rant is coming from. As an admin, he realizes that sometimes things just don't work despite your best laid plans, and at least DNet's design provides lost of built-in redundancy!)

JHutch

 

[gib]

In response to LANMAN's post, I don't think the current problems are distributed.net's fault. Their infrastructure is the most redundant and robust of any distributed computing endeavor to date. However, even the best laid plans can be thwarted by circumstances beyond ones control. As I am sure we all recall, this same sort of backlog problem happened about a week and a half ago. That backlog was a result of the co-lo where the keymaster is hosted having bandwidth problems, and thus preventing the proxies from being able to flush their blocks. This was specifically mentioned in a post by Moose. In that case, distributed.net could do little more than wait for the provider to resolve the issues. I wouldn't be the least bit surprised if the currently backlog is the result of the very same bandwidth issues. In any case, it certainly was not the result of distributed.net's hardware being unable to handle the load. In fact, as it stands now, distributed.net has much more than enough horsepower for the keyserving/processing aspect of the contest. (Statistics processing is another matter, of course).

Incidentally, there is another thing to consider. I am fairly certain that the keymaster currently resides in California (perhaps someone can corroborate this?). As I am sure many are aware, California is in a major energy crisis right now. A large portion of the state has experienced &quot;rolling blackouts&quot; for the last couple days. These power outages may amplify, or even be partly responsible for distributed.net's problems.

 

[Imported]

LD,

On the 17th, one of the members of TA Cube, a small member who doesn't have a giant herd at his disposal, flushed 30,000 blocks that he had been saving for a long, long time.

I'm sure that he was proud and happy to contribute that work, and was excited waiting to see it reflected in the total.His blocks are not counted.

.. They weren't counted?

 

[divide by zero]

Recommendation:
If you are going to do your own mini-flush, before you pull the handle, backup your buff-out and put the backup somewhere else,
not just on your harddrive. I did this in case I was visited by
the head crash fairy. Then if your flush doesn't get counted because
of a problem in the pipeline, wait until things have cleared up and
settled down adn there is no more backlog - then restore your saved buff-out and flush it again. If the blocks *truly* went into la-la land then they will be going through for the first time and show up in the stats. However, if they were prccessed the first time but just not counted then the second flush will be discarded as duplicates.
I believe the latter scenario is what has been happening at dnet most of the time so this may be of limited use but I like to have a backup &quot;just in case&quot;.

 

[HomerSapien]

I agree, it is annoying. I am losing around 800 a day. Thats not much to some, but that is around half of what i send in. So far, i would put my loss around 20,000-30,000 total. Grrrr.

 

[err]

I think I've lost at least 10,000 block myself (

grrrrrrr... is there anything we can do to recover those lost blocks ?

err

 

[Imported]

Bah.. I'ma just flush everyday now. Should be around 1000 a day for me now since I don't just leave my PC to run all day..