WCG - 15th Birthday Challenge

[Markfw]

I woke up in the middle of the night, for no particular reason.

Well, due to the number of cores, I am only bunkering for 5-6 days, but all the machines are up, except the new 14 core E5-2695v3, waiting on the NVME heatsink !

 

[StefanR5R]

While we sit and wait for the weekend to come, I'm reposting the important dates for quick reference:

• Ongoing: Bunker construction. :-)
  Choose subprojects with several days deadline.
  Your hosts need to be trusted, i.e. have previously returned results and got them validated, if you want to hold many tasks in progress.

• Saturday, November 16, 00:00 UTC = Friday, November 15, 16:00 PST --- Start of the Birthday challenge.
  (convert time and date into local time)

• Friday, November 22, 23:59 UTC = Friday, November 22, 15:59 PST --- End of the Birthday challenge.
  (convert time and date into local time)

Also, there were updates on the status of some of the subprojects.

Africa Rainfall Project (forum) -- active, limited amount of work available

The reality is, we would love to run this at full speed as well. With this project being a beast, it takes a lot to make sure things are processing properly. We are making sure our hosting can handle it with the current setup or if major updates are required to support it. We are also working with the researchers to make sure the data get put in the proper location for result analysis. I had an estimate from early on in this project that we would exceed 1 PByte of data for the scope it is now. Storing this information for say 10 years is not cheap as you need replication to prevent data loss. Also this information needs to be easily and quickly accessed for analysis.

Until some of this is fully resolved, we are processing at the current speed with incremental updates as World Community Grid confirms we don't need to upgrade anything.

Thanks,
-Uplinger

(source)

Microbiome Immunity Project (forum) -- active

Just wrapped up our monthly call with the research team.

1. They're building more work units to add to the current supply of approximately 13 days. At this point the research team anticipates quite a bit more work to come.
2. The WCG tech team is examining about a dozen batches of work units that appear to have come back to us with some issues. (This is a very small percentage of the total output.)
3. The research team did a model quality assessment of roughly 50k batches that they've received back over the past few weeks. They are very pleased with the quality of the data they're receiving from the grid, even with longer models going out and coming back.
4. They're heads-down on getting their first paper ready for submission (with changes made due lots of additional data coming in from us), but have promised to create another project update by the end of the year.

Current Work Unit Status:

Available for Download: 4,130 batches
In Progress: 8,345 (16,453,293 work units)
Completed: 232,858 total - 9,451 in the last 30 days - average of 315 per day
Estimated backlog: 13.1 days

(source)

OpenZika (forum) -- finishing

Here are the details of our monthly call with the research team:

1. As of today, there are about 25 straggler work units that need to be run. The WCG tech team is keeping an eye on them and also seeing if any other work units need to be re-run (there are none at the moment).
2. The team at LabMol is thinking of hiring a new PhD student to help with data analysis and selecting compounds for testing.
3. The research team just had a new paper accepted--more info coming once it's published. They've also submitted a paper for a different journal.
4. The project PI will be presenting the project at a conference of medicinal chemists in a few weeks. Two additional researchers are presenting about the project before the end of the year.

As the project's work on World Community Grid is almost over, here's the current status of work units:

Available for Download: 0 batches
In Progress: 560 batches (736,492 work units)
Completed: 457,567 batches - 7,220 in the last 30 days - average of 240 per day
Estimated backlog: 0 days

(source)

No news on the other projects since last time:

Smash Childhood Cancer (forum) --- in hiatus
Help Stop TB (forum) --- very low volume of work available
FightAIDS@Home - Phase 2 (forum) --- active; 1 day task deadlines
Mapping Cancer Markers (forum) --- most active​

 

[crashtech]

I have a dual Xeon E5440 system that I put to work on MIP just for laughs, but it seems to be doing astonishingly well. Not sure what's going on with it, are there easier MIP WUs for old hardware?

Spoiler: 2x E5440 MIP Screenshot

 

[StefanR5R]

With just 4 cores, no hyperthreads, but 12 MByte level 2 cache, the speed you are seeing there is probably a sign that this processor is not as RAM I/O constrained as newer processors with a lot less cache per thread.

 

[Markfw]

I have a dual Xeon E5440 system that I put to work on MIP just for laughs, but it seems to be doing astonishingly well. Not sure what's going on with it, are there easier MIP WUs for old hardware?

Spoiler: 2x E5440 MIP Screenshot

WOW, those are good times for a 3 ghz quad core.

 

[crashtech]

With just 4 cores, no hyperthreads, but 12 MByte level 2 cache, the speed you are seeing there is probably a sign that this processor is not as RAM I/O constrained as newer processors with a lot less cache per thread.

It is dual-CPU, so all 8 cores share dual-channel 8GB DDR2. Afaik, these older quad-cores are like two dual cores that do not share their cache. Given that the MIP cache footprint should be overflowing the L2 with all threads working, the performance really surprised me.

 

[StefanR5R]

It is dual-CPU, so all 8 cores share dual-channel 8GB DDR2.

Is this not a quad-channel platform?

Afaik, these older quad-cores are like two dual cores that do not share their cache.

Right; there are separate 6 MB L2 caches for each 2 cores.

 

[crashtech]

Is this not a quad-channel platform?

It's this:

Super Micro Computer, Inc. - Products | Motherboards | Xeon Boards | X7DCA-L

www.supermicro.com

I don't know if even quad-CPU boards had quad-channel memory at that point in time. Nehalem-EP was the debut of tri-channel, afaik, then Sandy Bridge-EP finally brought quad-channel.

 

[Ken g6]

How soon after 00:00 can we release our work? I didn't bunker enough on some machines.

 

[crashtech]

Good question, I was figuring on waiting at least until 00:30.

 

[StefanR5R]

How soon after 00:00 can we release our work?

Certainly, the usual guideline applies: Wait for the SG folks to have a Null reading.

On the other hand, while SG pull hourly stats (in Boinc cobblestones, which they then multiply by 7 to display WCG points), they also pull WCG's canonical 24h stats (directly in WCG points) and then reset the daily stats on that basis. From what I remember, while WCG computes the 24h stats virtually exactly at the 00:00 UTC mark, they are not exactly in a great hurry to get the 24h stats published. It can take an indefinite period of time until these stats become available on the front end. (Remember the WCG OpenZika marathon? There were days on which it took many hours until the 24h stats went public.)

The upshot: If it is still true that WCG generates the 24h stats internally very much on time, you can report your results very shortly after 00:00 UTC.

 

[StefanR5R]

No news on the other projects since last time:
Smash Childhood Cancer (forum) --- in hiatus
Help Stop TB (forum) --- very low volume of work available
FightAIDS@Home - Phase 2 (forum) --- active; 1 day task deadlines
Mapping Cancer Markers (forum) --- most active

One day later, there were news from MCM:

Here are the details of our monthly call research call:

1. We've received some sample sarcoma units, which we will start alpha testing next week. No timeline yet for beta testing--first, we will be working with the researchers to determine work unit size, since there might be some wiggle room for having longer-running or shorter work units.
2. There was a very preliminary discussion of the possibility of having MCM run on Android some day. This was just an exploratory conversation so don't everybody get all excited yet. There's a lot of work needed to make this happen and we have more climate projects to launch. I'm including this point in the interest of full disclosure of our calls, so everybody knows that having more Android projects is very much on our minds.
3. We talked about possible modifications to the MCM screensaver once the new sarcoma units are out. We'll make a decision on this based on how much developer time is available.

Status of work units:

Available for Download: 221 batches
In Progress: 813 batches (6,382,703 work units)
Completed: 55,189 batches total - 851 batches in the last 30 days - average of 28.4 batches per day
Estimated backlog: 7.5 days

(source)

And from FAAH phase 2:

We just wrapped up our monthly call with the FAAH research teams.

1. The Phase 1 and 2 teams have decided on a new set of ligands for us to work on. They will be sending us the new work units for these ligands by later this week.
2. The Phase 1 team has decided that they definitely want to run more AutoDock work on WCG. They are coming up with a plan and a timeframe for this; we expect to have more information early next year.
3. The two teams will be meeting face-to-face in January (and we will ask them to take a picture!).

Current status of work units:

In Progress: 98,957 work units*
Completed: 4,159,569 in the last 30 days - average of 138,652 per day

*This project does not use batches like some other projects. Also, due to its use of the AsyncRe analysis method, this project does not keep a backlog of work with World Community Grid like many others. See the latest two project updates for details.

(source)

And HSTB:

Here are details from our monthly call with the HSTB research team:

1. WCG has been contacted by several research groups who are interested in learning more about how the HSTB project uses Gromacs (the software they've chosen for data processing). WCG has put these outside research groups in touch with the HSTB team.
2. The project's PI will be presenting at a conference in a few weeks. While her presentation isn't about HSTB, she will add a slide about World Community Grid to help raise awareness.
3. Advance notice of some very happy news: the HSTB research team will soon have a new member! He has just started working with them on other projects, and they will soon brief him on HSTB and introduce him to World Community Grid. (He was not present for today's call.)

Current status of work units:
In Progress: 56 batches (5,559 work units)
Completed: 22,652 batches - 126 in the last 30 days - average of 4.2 per day

(source)

 

[StefanR5R]

Certainly, the usual guideline applies: Wait for the SG folks to have a Null reading.

Uh oh, they already have a 0-filled table.

Maybe das kleine grüne Männel stays up late and fires the starting shot from the shoutbox.

 

[crashtech]

Google translates that as "the little green cousin."

 

[Markfw]

I thought it was tomorrow that the WCG challenge starts ????? Like 5 pm PST ?

 

[crashtech]

I think the start was 4PM today your time.

 

[Markfw]

Incoming !

 

[StefanR5R]

So... boincstats has a record of the Best Ten Days of the entire WCG project, but it does not agree at all with WCG's own data, even keeping the factor 7 from boinc credits to WCG points in mind.

The WCG stats are only available in chronological order, but pschoefer of SETI.Germany posted a list sorted by daily points:

​

05 May 2019 ___ 1.460.241.023​

16 Nov 2018 ___ 1.448.559.058​

22 Oct 2018 ___ 1.330.559.137​

27 Jan 2019 ___ 1.271.725.039​

16 Nov 2019 ___ 1.262.782.007​

08 Oct 2018 ___ 1.240.388.894​

06 May 2019 ___ 1.230.529.863​

20 Jan 2019 ___ 1.229,914.039​

16 Jan 2019 ___ 1.224.054.730​

​

May 2019: OpenZika marathon at Pentathlon 2019
November 16: annual start of the Birthday Challenge
October 22, 2018: start of week 3 of Thor challenge 2018

Hmm, what about January? It is arguably the coldest month at the northern hemisphere, and maybe it's the month during which holiday presents are given a try-out.

 

[TennesseeTony]

https://stats.free-dc.org/spacehead.php?page=team&proj=bwcg&teamid=16700

I intend to refresh and repost about this time daily. This is going to be VERY inaccurate, but it will at least give us an idea of individual performance. My understanding of the Free-DC stats link above is that it represents the last 7 days. Most of us were bunkering, so this should ROUGHLY indicate our contribution during this event.

EDIT 2: Uhm, the numbers are off...Oh, SG is showing WCG points (7x of BOINC points).

World Community Grid overall position - 51
TeAm total for the week - 10,723,663
TeAm rank for weekly production - 14

__Credit/week _ UserName
1_______2,082,847____markfw.......... 14,579,929 points over at SG
2_______1,484,892____phoenicis....... ‭10,394,244‬
3_______1,274,689____crashtech...... 8,922,823
4_______1,005,674____pututu ............ 7,039,718
5_______889,884______biodoc ........... 6,229,188
6_______558,962______ZipSpeed ........ 3,912,734
7_______427,402______xii5ku .............. 2,991,814
8_______346,491______Howdy ............ 2,425,437 ....and....this is gonna take forever, so i quit.
9_______247,986______cellarnoise2
10______226,432______Kaebu
11______191,235______Orange Kid
12______186,984______Ken_g6
13______117,905______Neurodog
14______81,308_______IcefireQuickSilver
15______73,143_______VirtualLarry
16______45,721_______uallas5
17______41,671_______Rebel Alliance
18______40,526_______Ingleside
19______35,166_______asimperson
20______29,865_______sukhoi_584th
21______23,233_______rainsford
22______19,503_______wayliff
23______16,642_______Viperoni
24______15,427_______geecee
25______10,448_______petrusbroder
26______9,597________somethingsketchy
27______9,523________Aegeon
28______9,087________archeye
29______2,151________EagleKeeper


EDIT: And here is [H]:

World Community Grid overall position - 26
TeAm total for the week - 11,844,381
TeAm rank for weekly production - 11

__Credit/week _ UserName
1_______2,949,193____Lopoetve
2_______1,403,649____RFGuy_KCCO
3_______1,351,246____EXT64
4_______1,257,670____ChelseaOilman
5_______751,688______[H]auntjemima
6_______644,247______motqalden
7_______465,265______Coleslaw
8_______375,162______DooKey
9_______362,488______kuroneko4891
10______357,312______MGMCCALLEY
11______267,455______WFeather
12______237,971______ChristianVirtual
13______150,146______dmaine
14______112,588______Tanner1999
15______108,253______Applejacks
16______96,283_______Priller
17______96,222_______SmokeRngs
18______77,153_______rolsch8942
19______76,905_______dcds1
20______61,863_______genes131
21______58,590_______AgrFan
22______50,409_______MstrBoot
23______49,491_______metallicafan
24______48,766_______mjygvfesz
25______45,895_______Randall_Pink
26______42,028_______perilous[H]
27______41,632_______Jathanis
28______37,413_______ravenpaua
29______36,526_______BalzacLefty
30______34,669_______joebobjones
31______29,280_______justinflux1
32______23,006_______CBBlackWolf
33______22,844_______Rav4ite
34______16,220_______wings2004
35______14,558_______G3NSM0R3S
36______12,804_______xr400rr
37______11,684_______sirmonkey
38______9,107________mobbyland
39______8,552________HodgePodge2
40______7,109________Olendorf
41______5,617________niteguy
42______4,336________dragonslyer1086
43______4,221________All4amd
44______4,175________travanx
45______3,258________DeeFrag
46______3,244________Yeahpie
47______3,101________wsocrates
48______3,097________brycejones
49______2,541________jje1701
50______2,491________chqshaitan
51______1,779________Toconator
52______1,720________alphonsechompman
53______951__________BE04642
54______472__________[H]Emission

 

[Markfw]

WOW thanks Tony. So I only need to do one million more than I do now to keep up with their top guy. Too bad my EPYC chips won;t be here until after the race is over. They are due about a week from now. One business day after they actually arrive, since I can't hear to doorbell to sign for them, I have to go in the next day to the post office and sign for them.

I hate being deaf !!!!

 

[TennesseeTony]

This item is ridiculously over-priced, but is the first result when I searched for doorbell pager. <<<----taking advantage of the deaf/blind with their prices.

Nearly the same item at less than half the price. Actually, I think that is the exact same item.

 

[Markfw]

This item is ridiculously over-priced, but is the first result when I searched for doorbell pager. <<<----taking advantage of the deaf/blind with their prices.

Nearly the same item at less than half the price. Actually, I think that is the exact same item.

Tony, thanks, I couldn't get any feedback on the "ring" doorbell, but the vibrate mode on this puppy with the remote pager is what I need the most, and 1/2 the price !

Edit: unavailable......

 

[Howdy]

Tony, thanks, I couldn't get any feedback on the "ring" doorbell, but the vibrate mode on this puppy with the remote pager is what I need the most, and 1/2 the price !

Edit: unavailable......

They make some with strobe or you can plug it in to a lamp and have it flash.

 

[TennesseeTony]

Dangit. Okay, we're building our own kit then.

Newegg:
Push button $35 w/free shipping
Pager $60 w/free shipping. Both from same seller.

Amazon:
Push button $52 w/free ship
Pager $60 w/free shipping

 

[Howdy]

https://stats.free-dc.org/spacehead.php?page=team&proj=bwcg&teamid=16700

EDIT 2: Uhm, the numbers are off...Oh, SG is showing WCG points (7x of BOINC points).

World Community Grid overall position - 51
TeAm total for the week - 10,723,663
TeAm rank for weekly production - 14

__Credit/week _ UserName___________ Points at SG WCG Challenge Site
1_______2,082,847____markfw.....................14,579,929
2_______1,484,892____phoenicis.................10,394,244‬
3_______1,274,689____crashtech.................8,922,823
4_______1,005,674____pututu.......................7,039,718
5_______889,884______biodoc.....................6,229,188
6_______558,962______ZipSpeed................3,912,734
7_______427,402______xii5ku......................2,991,814
8_______346,491______Howdy.....................2,425,437
9_______247,986______cellarnoise2.............1,735,902
10______226,432______Kaebu.....................1,585,024
11______191,235______Orange Kid..............1,338,645
12______186,984______Ken_g6....................1,308,888
13______117,905______Neurodog.................825,335
14______81,308_______IcefireQuickSilver.....596,156
15______73,143_______VirtualLarry...............512,001
16______45,721_______uallas5......................320,047
17______41,671_______Rebel Alliance..........291,697
18______40,526_______Ingleside..................283,682
19______35,166_______asimperson..............246,162
20______29,865_______sukhoi_584th...........209,055
21______23,233_______rainsford..................162,631
22______19,503_______wayliff......................136,521
23______16,642_______Viperoni...................116,494
24______15,427_______geecee....................107,989
25______10,448_______petrusbroder............73,136
26______9,597________somethingsketchy....67,179
27______9,523________Aegeon....................66,661
28______9,087________archeye....................63,609
29______2,151________EagleKeeper............15,057