It seems that Mika is handling mostly, if not only, 64 block packets (or 2^34) recently.
Thats a great opportunity to reduce
-memory used by the ppoxy on mika's box
-the size of logs, thus the time it takes to process stats every 15 mn
-the uplink time of fetching/flushing
So please everyone set your preferred packet size to 2^33 (or 32 block packets)
and your fetch threshold to a multiple of 32, or better yet, 64.
If you're concerned that your cruncher could be accidentaly stopped in the middle of a 32 block packet (which is quite a beast for slower machines) you should consider using checkpoints, they save work every 10 minutes. The only place where I wouldnt advice this is on a slow and unstable machine that cracks in memory only. But who uses that ? ; )
FYI, a Celery@850 swallows a 32 block packet in a little under 1 hour.
Thats a great opportunity to reduce
-memory used by the ppoxy on mika's box
-the size of logs, thus the time it takes to process stats every 15 mn
-the uplink time of fetching/flushing
So please everyone set your preferred packet size to 2^33 (or 32 block packets)
and your fetch threshold to a multiple of 32, or better yet, 64.
If you're concerned that your cruncher could be accidentaly stopped in the middle of a 32 block packet (which is quite a beast for slower machines) you should consider using checkpoints, they save work every 10 minutes. The only place where I wouldnt advice this is on a slow and unstable machine that cracks in memory only. But who uses that ? ; )
FYI, a Celery@850 swallows a 32 block packet in a little under 1 hour.
