Help ! With Linux Mint 18.3

Page 3 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,560
14,514
136
OK, I am starting from scratch, but with no pinnacle card, and no secure boot (2 lessons learned) Give me a bit to reinstall, and lets see what happens,.

edit. dang biodoc, I would have tried that, but its installing. Too quick on the trigger.

BUT it was at 950k ppd on one card, vs 725k average of my 2 cards before ! So if I get this tonight, I get 1,9 million ppd vs 1450k or almost another half million. (but I lost lot in the last 24 hours)
 

biodoc

Diamond Member
Dec 29, 2005
6,262
2,238
136
if you want to try a clean install, here's my modified Hiigaran guide for 64-bit Linux mint cinnamon 18.3

Install mint from CD DVD or usb stick.


Open up a terminal (Ctrl + Alt + T)

Update the system software (always a good idea before installing Nvidia drivers in my experience)

sudo apt-get update
sudo apt-get dist-upgrade

I suspect python is already install on mint but to be sure:

sudo apt-get install python

reboot

Installation of Nvidia drivers:

sudo add-apt-repository ppa:graphics-drivers/ppa

sudo apt-get update
sudo apt-get install nvidia-384
sudo nvidia-settings -a --enable-all-gpus --cool-bits=12

reboot

Install Nvidia CUDA and OpenCL support

sudo apt-get install nvidia-opencl-icd-384

sudo apt-get install libcuda1-384

reboot

Install FAH

EDIT: I corrected some errors and made some changes
 
Last edited:
  • Like
Reactions: Markfw and Ken g6

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,560
14,514
136
if you want to try a clean install, here's my modified Hiigaran guide for 64-bit Linux mint cinnamon 18.3

Install mint from CD DVD or usb stick.


Open up a terminal (Ctrl + Alt + T)

Update the system software (always a good idea before installing Nvidia drivers in my experience)

sudo apt-get install update
sudo apt-get dist-upgrade

I suspect python is already install on mint but to be sure:

sudo apt-get python

reboot

Installation of Nvidia drivers:

sudo add-apt-repository ppa:graphics-drivers/ppa

sudo apt-get update
sudo apt-get install nvidia-384

reboot

Install Nvidia CUDA and OpenCL support

sudo apt-get install nvidia-opencl-icd-384

sudo apt-get install libcuda1-384

Unlock NV-CONTROL to manually control fans and overclocking function

sudo nvidia-xconfig -a --cool-bits=28

reboot

Install FAH
I am going to follow that to the letter on this install !!!! I will keep you appraised.
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,560
14,514
136
Problem... I will wait for a reply:

mark@mark-dual-1080s ~ $ sudo apt-get python
E: Invalid operation python
mark@mark-dual-1080s ~ $
 

biodoc

Diamond Member
Dec 29, 2005
6,262
2,238
136
Problem... I will wait for a reply:

mark@mark-dual-1080s ~ $ sudo apt-get python
E: Invalid operation python
mark@mark-dual-1080s ~ $

Sorry it’s
sudo apt-get install python


Sent from my iPhone using Tapatalk
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,560
14,514
136
well, crap. After that, no light on the second GPU. Then I tried "nvidia-settings -q gpus and I got not installed, do I did this:
sudo apt install nvidia-settings

and then got this:
mark@mark-dual-1080s ~ $ nvidia-settings -q gpus

1 GPU on mark-dual-1080s:0

[0] mark-dual-1080s:0[gpu:0] (GeForce GTX 1080)

Has the following names:
GPU-0
GPU-a9586634-06ae-1b09-f5d6-ef409b1ddfd9



Now what ? still one GPU

Edit: and I got An FAHcontrol error of python support not installed.
 

biodoc

Diamond Member
Dec 29, 2005
6,262
2,238
136
Open your xorg.conf file:

gedit /etc/X11/xorg.conf

copy the entire file and post it here.
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,560
14,514
136
Open your xorg.conf file:

gedit /etc/X11/xorg.conf

copy the entire file and post it here.
Well, I install sonme python stuff per the original post by the pony guy, and that worked, but gedit is not installed

mark@mark-dual-1080s ~ $ gedit /etc/x11/xorg.conf
The program 'gedit' is currently not installed. You can install it by typing:
sudo apt install gedit
mark@mark-dual-1080s ~ $ more /etc/x11/xorg.conf
more: stat of /etc/x11/xorg.conf failed: No such file or directory
mark@mark-dual-1080s ~ $

I am getting over 900k on the one card, so that better than nothing, but missing almost one million ppd hurts.
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,560
14,514
136
Well, it still does not exist. I got a message of to install gedit, and its here now, but still no file.
mark@mark-dual-1080s ~ $ more /etc/X11/xorg.conf
more: stat of /etc/X11/xorg.conf failed: No such file or directory
 

biodoc

Diamond Member
Dec 29, 2005
6,262
2,238
136
need to run to generate an xorg.conf

sudo nvidia-xconfig --probe-all-gpus

then reboot
 

biodoc

Diamond Member
Dec 29, 2005
6,262
2,238
136
As it turns out, Xed is the new text editor for mint cinnamon 18.3.

I'm running 17.3 so the text editor is gedit.
 

biodoc

Diamond Member
Dec 29, 2005
6,262
2,238
136
You can try my xorg.conf file.

sudo gedit /etc/X11/xorg.conf

Then copy the code below into the editor and save it.

then reboot.

Code:
# nvidia-xconfig: X configuration file generated by nvidia-xconfig
# nvidia-xconfig:  version 370.28  (buildmeister@swio-display-x64-rhel04-17)  Thu Sep  1 20:22:52 PDT 2016


Section "ServerLayout"
    Identifier     "Layout0"
    Screen      0  "Screen0" 0 0
    Screen      1  "Screen1" 0 0
    InputDevice    "Keyboard0" "CoreKeyboard"
    InputDevice    "Mouse0" "CorePointer"
EndSection

Section "Files"
EndSection

Section "InputDevice"

    # generated from default
    Identifier     "Mouse0"
    Driver         "mouse"
    Option         "Protocol" "auto"
    Option         "Device" "/dev/psaux"
    Option         "Emulate3Buttons" "no"
    Option         "ZAxisMapping" "4 5"
EndSection

Section "InputDevice"

    # generated from default
    Identifier     "Keyboard0"
    Driver         "kbd"
EndSection

Section "Monitor"
    Identifier     "Monitor0"
    VendorName     "Unknown"
    ModelName      "Unknown"
    HorizSync       28.0 - 33.0
    VertRefresh     43.0 - 72.0
    Option         "DPMS"
EndSection

Section "Monitor"
    Identifier     "Monitor1"
    VendorName     "Unknown"
    ModelName      "Unknown"
    HorizSync       28.0 - 33.0
    VertRefresh     43.0 - 72.0
    Option         "DPMS"
EndSection

Section "Device"
    Identifier     "Device0"
    Driver         "nvidia"
    VendorName     "NVIDIA Corporation"
    BusID          "PCI:1:0:0"
EndSection

Section "Device"
    Identifier     "Device1"
    Driver         "nvidia"
    VendorName     "NVIDIA Corporation"
    BusID          "PCI:2:0:0"
EndSection

Section "Screen"
    Identifier     "Screen0"
    Device         "Device0"
    Monitor        "Monitor0"
    DefaultDepth    24
    Option         "Coolbits" "12"
    SubSection     "Display"
        Depth       24
    EndSubSection
EndSection

Section "Screen"
    Identifier     "Screen1"
    Device         "Device1"
    Monitor        "Monitor1"
    DefaultDepth    24
    Option         "Coolbits" "12"
    SubSection     "Display"
        Depth       24
    EndSubSection
EndSection
 

biodoc

Diamond Member
Dec 29, 2005
6,262
2,238
136
It's way past my bedtime so I'm signing off.

My apologies for my modified installation not working as intended but tomorrow is another day.
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,560
14,514
136
OK, I messed around too much somehow, and now I have no workable slots. giving up for the night.
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,560
14,514
136
OK, I lied, I couldn't stand it. I changed out the motherboard, and reinstalled from scratch. I now have 1.9 millio ppd on one linux + 1.1 million on the other linux. for 3 million total.

Old numbers were 900k + 1450k or 2350k, or I have 650k more just from linux ! And on only 2 boxes... I have many more to go !

A BIG THANKS TO ALL WHO HELPED ME HERE !!!!!!!!!!! AND A BEER OR TEN :beercheers::beercheers::beercheers::beercheers::beercheers::beercheers::beercheers::beercheers::beercheers::beercheers: Estimate 12.3 million ppd total for 24 hours this time tomorrow.

OMG, I can't wait until I get to the threadrippers. they are already at 2.1 million each. New number.. guess.. I am going to guess 2.8 million per box.
 
Last edited:

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,560
14,514
136
Oh, and forget all that HFM monitoring stuff. FAHControl does just fine with linux and Windows. Here is the current farm at 12.4 million ppd:
gwoCv4B.png
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,560
14,514
136
Oh I like that. Does BOINC look similar to that if you set it up to monitor remote clients?
I use boinc tasks, but never tried it on linux. I have no CPU clients running now (the $600 electric bill). AND BTW, 300 cores not working sure coolled this house down. I had to shut all the windows, even with all the video cards churning.
 

StefanR5R

Elite Member
Dec 10, 2016
5,512
7,818
136
Does BOINC look similar to that if you set it up to monitor remote clients?
boincmgr is showing only one client at a time. But you can of course run multiple instances of boincmgr in parallel.

Either select the remote client in the menu of boincmgr, or start boincmgr such that it accesses the remote node right away:
$ boincmgr -n node_name_or_node_address -g port_number -p password

The -g parameter is only necessary if the client is configured for a GUI port other than the default 31416. BTW, you may have to open this port in the desktop firewall of the client or/and of the controlling computer.

The -p parameter is not necessary if an empty password was set in the client's gui_rpc_auth.cfg.

On Windows and certainly also on various Linux desktops, you can conveniently create shortcuts to boincmgr which call it with the above parameters.

I use boinc tasks, but never tried it on linux.
I tried BoincTasks on Gentoo Linux, and it was rather sluggish and occupied a processor thread almost fully. I plan to try it on Linux Mint too, to see if it performs better there.

On Linux, you run the Windows executable of BoincTasks by means of the Wine API shim.
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
25,560
14,514
136
New problem. Box number 3, E5-2658 ES CPU and dual 1070TI's, and everything is installed and working fine, sort of, but nothing will run. Below is the log file:
Code:
22:13:27:Adding folding slot 00: READY gpu:0:GP104 [GeForce GTX 1070 Ti] 8186
22:13:27:Adding folding slot 01: READY gpu:2:GP104 [GeForce GTX 1070 Ti] 8186
22:13:27:Saving configuration to /etc/fahclient/config.xml
22:13:27:<config>
22:13:27:  <!-- Client Control -->
22:13:27:  <fold-anon v='true'/>
22:13:27:
22:13:27:  <!-- Folding Slot Configuration -->
22:13:27:  <gpu v='false'/>
22:13:27:
22:13:27:  <!-- HTTP Server -->
22:13:27:  <allow v='127.0.0.1,192.168.1.1-192.168.1.255'/>
22:13:27:  <deny v='0.0.0.0/0'/>
22:13:27:
22:13:27:  <!-- Network -->
22:13:27:  <proxy v=':8080'/>
22:13:27:
22:13:27:  <!-- Remote Command Server -->
22:13:27:  <command-allow-no-pass v='127.0.0.1,192.168.1.1-192.168.1.255'/>
22:13:27:  <command-deny-no-pass v='0.0.0.0/0'/>
22:13:27:
22:13:27:  <!-- User Information -->
22:13:27:  <passkey v='********************************'/>
22:13:27:  <team v='198'/>
22:13:27:  <user v='Mark_F_Williams'/>
22:13:27:
22:13:27:  <!-- Folding Slots -->
22:13:27:  <slot id='0' type='GPU'/>
22:13:27:  <slot id='1' type='GPU'/>
22:13:27:</config>
22:13:27:WU00:FS00:Connecting to 171.67.108.45:80
22:13:28:WU01:FS01:Connecting to 171.67.108.45:80
22:13:28:WU00:FS00:Assigned to work server 171.67.108.157
22:13:28:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GP104 [GeForce GTX 1070 Ti] 8186 from 171.67.108.157
22:13:28:WU00:FS00:Connecting to 171.67.108.157:8080
22:13:28:WU01:FS01:Assigned to work server 171.67.108.157
22:13:28:WU01:FS01:Requesting new work unit for slot 01: READY gpu:2:GP104 [GeForce GTX 1070 Ti] 8186 from 171.67.108.157
22:13:28:WU01:FS01:Connecting to 171.67.108.157:8080
22:13:28:WU00:FS00:Downloading 8.82MiB
22:13:28:ERROR:WU01:FS01:Exception: Server did not assign work unit
22:13:28:WU01:FS01:Connecting to 171.67.108.45:80
22:13:29:WU01:FS01:Assigned to work server 171.67.108.157
22:13:29:WU01:FS01:Requesting new work unit for slot 01: READY gpu:2:GP104 [GeForce GTX 1070 Ti] 8186 from 171.67.108.157
22:13:29:WU01:FS01:Connecting to 171.67.108.157:8080
22:13:29:ERROR:WU01:FS01:Exception: Server did not assign work unit
22:13:29:WU00:FS00:Download complete
22:13:29:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9431 run:785 clone:1 gen:425 core:0x21 unit:0x000001ecab436c9d586fdd3a2c8c76f3
22:13:30:WU00:FS00:Starting
22:13:30:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 00 -suffix 01 -version 704 -lifeline 26147 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
22:13:30:WU00:FS00:Started FahCore on PID 26206
22:13:30:WU00:FS00:Core PID:26210
22:13:30:WU00:FS00:FahCore 0x21 started
22:13:30:WARNING:WU00:FS00:FahCore returned: UNKNOWN_ENUM (127 = 0x7f)
22:13:30:WU00:FS00:Starting
22:13:30:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 00 -suffix 01 -version 704 -lifeline 26147 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
22:13:30:WU00:FS00:Started FahCore on PID 26211
22:13:30:WU00:FS00:Core PID:26215
22:13:30:WU00:FS00:FahCore 0x21 started
22:13:31:WARNING:WU00:FS00:FahCore returned: UNKNOWN_ENUM (127 = 0x7f)
22:13:43:Saving configuration to /etc/fahclient/config.xml
22:13:43:<config>
22:13:43:  <!-- Client Control -->
22:13:43:  <fold-anon v='true'/>
22:13:43:
22:13:43:  <!-- Folding Slot Configuration -->
22:13:43:  <gpu v='false'/>
22:13:43:
22:13:43:  <!-- HTTP Server -->
22:13:43:  <allow v='127.0.0.1,192.168.1.1-192.168.1.255'/>
22:13:43:  <deny v='0.0.0.0/0'/>
22:13:43:
22:13:43:  <!-- Network -->
22:13:43:  <proxy v=':8080'/>
22:13:43:
22:13:43:  <!-- Remote Command Server -->
22:13:43:  <command-allow-no-pass v='127.0.0.1,192.168.1.1-192.168.1.255'/>
22:13:43:  <command-deny-no-pass v='0.0.0.0/0'/>
22:13:43:
22:13:43:  <!-- User Information -->
22:13:43:  <passkey v='********************************'/>
22:13:43:  <team v='198'/>
22:13:43:  <user v='Mark_F_Williams'/>
22:13:43:
22:13:43:  <!-- Folding Slots -->
22:13:43:  <slot id='0' type='GPU'/>
22:13:43:  <slot id='1' type='GPU'/>
22:13:43:</config>
22:14:28:WU01:FS01:Connecting to 171.67.108.45:80
22:14:29:WU01:FS01:Assigned to work server 171.67.108.157
22:14:29:WU01:FS01:Requesting new work unit for slot 01: READY gpu:2:GP104 [GeForce GTX 1070 Ti] 8186 from 171.67.108.157
22:14:29:WU01:FS01:Connecting to 171.67.108.157:8080
22:14:29:WU01:FS01:Downloading 5.13MiB
22:14:30:WU01:FS01:Download complete
22:14:30:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9414 run:1272 clone:0 gen:567 core:0x21 unit:0x0000028bab436c9d585e0699343cf24e
22:14:30:WU01:FS01:Starting
22:14:30:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 26147 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:14:30:WU01:FS01:Started FahCore on PID 26226
22:14:30:WU01:FS01:Core PID:26230
22:14:30:WU01:FS01:FahCore 0x21 started
22:14:30:WARNING:WU01:FS01:FahCore returned: UNKNOWN_ENUM (127 = 0x7f)
22:14:30:WU00:FS00:Starting
22:14:30:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 00 -suffix 01 -version 704 -lifeline 26147 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
22:14:30:WU00:FS00:Started FahCore on PID 26231
22:14:30:WU00:FS00:Core PID:26235
22:14:30:WU00:FS00:FahCore 0x21 started
22:14:31:WU01:FS01:Starting
22:14:31:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 26147 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:14:31:WU01:FS01:Started FahCore on PID 26236
22:14:31:WU01:FS01:Core PID:26240
22:14:31:WU01:FS01:FahCore 0x21 started
22:14:31:WARNING:WU00:FS00:FahCore returned: UNKNOWN_ENUM (127 = 0x7f)
22:14:31:WARNING:WU01:FS01:FahCore returned: UNKNOWN_ENUM (127 = 0x7f)
22:15:31:WU00:FS00:Starting
22:15:31:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 00 -suffix 01 -version 704 -lifeline 26147 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
22:15:31:WU00:FS00:Started FahCore on PID 26253
22:15:31:WU00:FS00:Core PID:26257
22:15:31:WU00:FS00:FahCore 0x21 started
22:15:31:WU01:FS01:Starting
22:15:31:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 26147 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:15:31:WU01:FS01:Started FahCore on PID 26258
22:15:31:WU01:FS01:Core PID:26262
22:15:31:WU01:FS01:FahCore 0x21 started
22:15:31:WARNING:WU00:FS00:FahCore returned: UNKNOWN_ENUM (127 = 0x7f)
22:15:31:WARNING:WU01:FS01:FahCore returned: UNKNOWN_ENUM (127 = 0x7f)
22:16:31:WU00:FS00:Starting
22:16:31:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 00 -suffix 01 -version 704 -lifeline 26147 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
22:16:31:WU00:FS00:Started FahCore on PID 26270
22:16:31:WU00:FS00:Core PID:26274
22:16:31:WU00:FS00:FahCore 0x21 started
22:16:31:WU01:FS01:Starting
22:16:31:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 26147 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:16:31:WU01:FS01:Started FahCore on PID 26275
22:16:31:WU01:FS01:Core PID:26279
22:16:31:WU01:FS01:FahCore 0x21 started
22:16:31:WARNING:WU00:FS00:FahCore returned: UNKNOWN_ENUM (127 = 0x7f)
22:16:31:WARNING:WU00:FS00:Too many errors, failing
22:16:31:WU00:FS00:Sending unit results: id:00 state:SEND error:FAILED project:9431 run:785 clone:1 gen:425 core:0x21 unit:0x000001ecab436c9d586fdd3a2c8c76f3
22:16:31:WU00:FS00:Connecting to 171.67.108.157:8080
22:16:31:WARNING:WU01:FS01:FahCore returned: UNKNOWN_ENUM (127 = 0x7f)
22:16:32:WU02:FS00:Connecting to 171.67.108.45:80
22:16:32:WU00:FS00:Server responded WORK_ACK (400)
22:16:32:WU00:FS00:Cleaning up
22:16:33:WU02:FS00:Assigned to work server 171.67.108.157
22:16:33:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GP104 [GeForce GTX 1070 Ti] 8186 from 171.67.108.157
22:16:33:WU02:FS00:Connecting to 171.67.108.157:8080
22:16:33:WU02:FS00:Downloading 5.13MiB
22:16:34:WU02:FS00:Download complete
22:16:34:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9415 run:821 clone:0 gen:663 core:0x21 unit:0x00000319ab436c9d585e06cffd2551f6
22:16:34:WU02:FS00:Starting
22:16:34:WU02:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 26147 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
22:16:34:WU02:FS00:Started FahCore on PID 26286
22:16:34:WU02:FS00:Core PID:26290
22:16:34:WU02:FS00:FahCore 0x21 started
22:16:35:WARNING:WU02:FS00:FahCore returned: UNKNOWN_ENUM (127 = 0x7f)
22:16:35:WU02:FS00:Starting
22:16:35:WU02:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 02 -suffix 01 -version 704 -lifeline 26147 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
22:16:35:WU02:FS00:Started FahCore on PID 26291
22:16:35:WU02:FS00:Core PID:26295
22:16:35:WU02:FS00:FahCore 0x21 started
22:16:35:WARNING:WU02:FS00:FahCore returned: UNKNOWN_ENUM (127 = 0x7f)