Just got one. Glad I have a 1GB GPU 'cause it's using 874MB of its memory!
____________

Have been getting many. None completed as yet, but so far no problems. Are these the same type as before?

These new units are using really low CPU power. The gpus are way cooler aswell, and the processing times seems to be very high. Not using all the hardware.

After over 4 hours execution with 12 hours estimated runtime to completion, I aborted one. The second one is showing the same issues. Estimated runtime to completion is rising with almost every second of execution.

GPU is hardly working, temps are lower than the CPU, that is unusual.

The process is using 30-35% of GPU memory (12% display, balance for computing)

Just finished my first NOELIA_klebe workunit on my GTX 670 (W7)! Nothing unusual: runtime 34480.037 s, credit 127,800.00, which is by the way similar to NOELIA_PEPTGPRC: 29748.680 s, 113,250.00, last/oldest NOELIA WU I was able to find on my register (after that I only had NATHANs). About same credit/time ratio within NOELIAs and hey it is not all about credits, so no reason to abort just because NATHANs do better on credits, within the GPUGRID it will level out. So I am quite happy with these new NOELIAs, if the WUs don't start to crash down the road.

I have a short run NOELIA klebe in process. on a 4 core AMD with 2 boincsimap tasks and wuprop running CPU use is low in comparison to NATHAN. CPU use is varying between 15% and 100% depending on which core, but the CPU is never saturated.

After 4 hours, it is 10.7% complete and BOINC 7.0.28 on Ubuntu 13.04 forecasts completion after another 9 hours 54 minutes. This forecast is rising with every few seconds of execution. Nvidia driver version is 319.17. All updates to Ubuntu are applied daily. This is on a GTX660Ti that processes NATHANs in 5 hours 15 minutes.

This wu will NOT finish before I have to go to work in 5 hours so I will report results when I get back home after work.

I did not want to abort the workunits, the Long Runs were working so slowly, I did not expect them to complete in less than 24 hours. This Short Run may take nearly that long to execute.

I personally hope that this batch of NOELIA klebe are exhausted soon.

After 9 hours running. only 18% complete. Remaining time is still climbing.

I will come back to GPUGrid in a few days once these wu are gone. ACEMD for Linux cannot run these tasks correctly.

Hi, everyone:

I believe my system may not be running at optimal settings. Can someone please advise this non-technical user how to achieve maximum system usage?

Many thanks!

I get the following results with my AMD A10 5800K and GTX 650 Ti GPUs processing NOELIA tasks. I am also running three WCG SN2S tasks. I do not have an app_config file.

Device 0

temperature 46C
CPU usage 0.61
GPU usage ~70 -85% fluctuating
Fan speed 54%
Core clock at 979.8 MHz

Device 1

temperature 54C
CPU usage 0.61
GPU usage ~66 -92% fluctuating
Fan speed 46%
Core clock at 979.8 MHz

Running NATHAN tasks I was averaging 33,400 sec with 70,800 credits. The NOELIA tasks completed in about 67,700 sec, returning 127,800 credits.

John

Still computing on the first one, but seems to run normal 12h on my 560ti 448 cores @ 98% gpu load and 2-6% pentium 4 load :)
____________
DSKAG Austria Research Team: http://www.research.dskag.at

Just got one. Glad I have a 1GB GPU 'cause it's using 874MB of its memory!

They start to crash on all machines. Lost like 50hr of processing since yesterday. Uncool to say the least.

They start to crash on all machines. Lost like 50hr of processing since yesterday. Uncool to say the least.

They start to crash on all machines. Lost like 50hr of processing since yesterday. Uncool to say the least.

There's quite a lot of doom & gloom over this latest batch of NOELIAs.
My own experience, on an oc'd GTX 460 1MB, is positive; one completed in under 18 hours with 127,800 credit, and one now running, almost six hours elapsed and 12+ hours remaining.

They start to crash on all machines. Lost like 50hr of processing since yesterday. Uncool to say the least.

There's quite a lot of doom & gloom over this latest batch of NOELIAs.
My own experience, on an oc'd GTX 460 1MB, is positive; one completed in under 18 hours with 127,800 credit, and one now running, almost six hours elapsed and 12+ hours remaining.

An experience of 1 is not much experience. Firehawk is having crashing problems on his very fast GPUs, sure a few completed there too. They don't seem to run at all on GPUs with under 1GB ram. Another user posted above that they will not run on Linux on his 660 Ti. Other people are also having crashes. Why are we inflicted with these WUs without testing or warning? It's ridiculous IMO. It's a waste of our resources and our money.

I have had two NOELIA tasks successfully complete with two more half way through....fingers crossed.

Up to now 4 of them in Linux in 660Ti without problem, the fourth one is about to finish yet, between 11 and 12 hours. Lower ppd than Nathan's but better for the summer as they stress less the GPUs :)

Edit: crunching times seems to improve, maybe they were that high due to the problems I'm having with WCG CEP unit uploading. I will report once I have additional data

Have processed 40 Noelias so far without error. I've had 15 of Nathans fail in the last 7 days!

I've completed 21 NOELIA's so far and have had 0 errors.

An experience of 1 is not much experience.

An experience of 1 is not much experience.

65 recently-reported successes is an experience!!

Hey guys, I wasn't trying to diminish from the problems you are having and I apologize for coming off wrong.

@Firehawk: well.. you're completing quite a few of them with driver 301.42. Anyway, in case of problems (which surely applies now) the 1st thing I'd do is to update the driver.

I had two failures, and many successful 'NOELIA_klebe_run-0-3's.
The first one was stuck for 8 hours before I noticed it, but after a system restart it immediately ran into an error "Kernel not foundAssertion failed: a, file swanlibnv2.cpp, line 59".
The second one ran for 3 hours, then ran into an "ERROR: file deven.cpp line 1743: deven_Cellresize(): invalid dimensions" - it's probably due to overclocking.

These new units are using really low CPU power. The gpus are way cooler aswell, and the processing times seems to be very high. Not using all the hardware.

@neilp62: taking a look at your failures I see that other people return many of those tasks just fine. And they all fail within 5.x seconds, i.e. during/after initialization. That means it's not a random error, it's systematic. In which case a driver update is the first thing to try. You're using 301.42, which is rather old by GPU standards. Try 314.22 (works for me) or the current one

Going straight for the leading edge can be painful in the BOINC world, it's more like the bleeding edge :p

When Tomba first started this thread, I jumped up and checked my computers and discovered that I had 3 running. I use Precision X to adjust my Evga cards, the 3 NOELIA's that were running had caused those cards boost clock to jump up considerably along with more frequent voltage spikes. Now that all my cards are running these new NOELIA's, I've had to adjust the voltage and core clock on all the cards back down to where I know they are in a safe range.

Every card is different from each other and I have now turned on K-Boost which locks all the voltages to where I want them to be. I've had pretty good luck with that feature of Precision X, I did have issue's getting it to work in Windows XP Pro x64 because of the lack of SP3. When I installed it, I put it in compatibility mode (the installation files and the installed program) and it worked. That doesn't mean that any of this stuff will work for anyone else, I just thought it might be worth mentioning especially how my cards core clock jumped up so high on their own, if I hadn't used a utility to adjust the clocks and voltages, then these issue's may have not showed at all.

I tested NOELIAs on Ubuntu 13.04 with Nvidia 319.17 on a GTX660Ti. Progress thru 9 hours of execution of a SHORT RUN, showed less than 20% progress. Further tests with Long Runs indicated a runtime of over 5000 minutes, minimum.

I will wait for these to be exhausted, or for the GPUGrid admins to fix ACEMD for Linux so that it runs these klebe NOELIAs as well as the Windoze version of ACEMD

If you're still running an older app there we'd have an easy explanation.

Yes, delete the app_info file and restart Boinc.

At present I doubt that you will get a significant improvement running two tasks...

I have one Noelia finished in 147,962.58 seconds on a GTX550Ti with driver 314.7.
I have now two running one on the same card and one on the older GTX285 and is expected to exceed 40 hours.
____________
Greetings from TJ

I have recently completed seven NOELIA tasks in an average of 69,589 seconds (19.3h) on my GTX 650 Ti GPUs, driver 314.22. CPU is AMD A10 5800K. Two more tasks are running with about 15h to go.

Going by that, and I know you both use W7, Johns GTX650Ti is 2.12 times as fast as TJ's GTX550Ti. Don't know the CPU usage on both systems though, and that's important.

Computed already 9 units, no problems so far :), 42500 secs on (my new 24/7) 570 and 45000 on 560ti 448cores.
____________
DSKAG Austria Research Team: http://www.research.dskag.at

Going by that, and I know you both use W7, Johns GTX650Ti is 2.12 times as fast as TJ's GTX550Ti. Don't know the CPU usage on both systems though, and that's important.

We are looking into it.

Noelia is not to blade. She is simply trying desperately to run some new science which uses a new algorithm within acemd. The others are not.

We absolutely needs this to run, but it is giving us problems it seems.
gdf

Ran a few Noelias recently on my 660 TI, no problems finishing them. Did have the issue with drivers crashing after suspending the wu. But just now I suspended the gpu to do some gaming and it didn't crash, odd.

Just finished my first Noella on a newly acquired 660TI. 10 hours to complete, no problems on Linux Mint, 127,800 credits. Will be rebooting to XP soon to see how they run there.

Problem for me: much too long, won't finish on time on my 470GTX. :(

185 hours and a deadline on Monday 13...

No problems at all for me with the Noelia's - 17 have gone through without a hitch - there again I am not overclocking my systems to their limit.

Not overclocking at all, but this is obviously not the point. :(

Problem for me: much too long, won't finish on time on my 470GTX. :(

185 hours and a deadline on Monday 13...

Thanks, but that will not help I'm afraid, this is apparently not a performance issue.

Just looked at my account, all previous Noelia WU ended in error this week.

Like this one:
Stderr output
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
MDIO: cannot open file "restart.coor"
SIGSEGV: segmentation violation
Stack trace (12 frames):
../../projects/www.gpugrid.net/acemd.2868(boinc_catch_signal+0x4d)[0x56709d]
/lib/x86_64-linux-gnu/libpthread.so.0(+0xf030)[0x7f775251c030]
/lib/x86_64-linux-gnu/libc.so.6(fwrite+0x34)[0x7f77517cf034]
../../projects/www.gpugrid.net/acemd.2868[0x47f9c7]
../../projects/www.gpugrid.net/acemd.2868[0x4813a0]
../../projects/www.gpugrid.net/acemd.2868[0x492d74]
../../projects/www.gpugrid.net/acemd.2868[0x47f18a]
../../projects/www.gpugrid.net/acemd.2868[0x422c27]
../../projects/www.gpugrid.net/acemd.2868[0x408c04]
../../projects/www.gpugrid.net/acemd.2868[0x407bc9]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd)[0x7f7751784ead]
../../projects/www.gpugrid.net/acemd.2868[0x407a39]

Exiting...

</stderr_txt>
]]>

I've upgraded to the latest Nvidia PAU driver in the Debian Wheezy packages, and of course, stopped CPU WU, restarted the PC (was up for 35 days).

So far, the current task shows some progress (10% after 02:25:00) even though the ETC remains at 12 and half hour. I keep you posted !


Edit: only uses up to 4% CPU, so this is really not the point, even for an old PIV.

Now, the very same WU that was in progress a couple of minutes ago also ended up in error.

Sorry, but have to stop the Noelia long runs, they all end up in error, for some of them pretty fast, for others after days......

Finished my first Noelia without errors on XP running a 660TI. Took about 35 minutes longer than the same card on Linux Mint

There is a problem on some Linux operating systems; they want to take for ever to complete. I think it's the more recent versions of Linux that are impacted, but not all. It's possible there is something missing in the drivers or Linux that is preventing the correct use of the drivers; missing libraries.

If you consistently get SIGSEGV errors on Linux or these WU's are going to take hundreds of hours (go by the % complete) just abort them.

If anyone finds a fix, post it up.

I2HDQ_17R4-SDOERR_2HDQc-1-4-RND1951_0
I99R11-NATHAN_dhfr36_6-8-32-RND2501_0 202 (0xca) EXIT_ABORTED_BY_PROJECT


http://www.gpugrid.net/result.php?resultid=6878277
http://www.gpugrid.net/result.php?resultid=6851367

Errors and errors again and again, and another noelias incomimng-(((
After cca two weeks without problems and restarting/blue screen.
Every time when i have rac about 620k incoming some wrong jobs noelia..but is not the first time when im complained to the problem when I have just about 600-620 rac..Now it is all my participation in the project after two weeks in the ass. Is there any conspiracy behind it or just incompetence?

Can I do something more than complain here?...-)))

Every time when i have rac about 620k incoming some wrong jobs noelia..but is not the first time when im complained to the problem when I have just about 600-620 rac..It is the third time exactly when again I have a problem of Noelia and just when I got 620k rac, it is amazing Mr. Scientist----------And that's your answer, Mr. moderator?

I have to prove it in the logs of work.

do you think that people in not perfect English can not understand simulations of proteins?! shame om you

It's obviously an international conspiracy to keep your RAC low. We're all involved and participate in LJRAC (Lowering Jozef's Recent Average Credit). BTW, the checks are in the mail...

JK. Seriously, we're all suffering the same problem. This is not what one would call a smoothly running project. Just saying...

Well I have two systems with nVidia cards, slow ones though. However they do Noelia's without problems so far, taking between 2 and 3 days. The systems are stable nothing is overclocked and not the latest BOINC or drivers. If it works than I leave it as is. If not I'll try to update the video drivers. One CPU core is always free, that seems to be important.

It could be the setup of system and drivers that results in errors, Microsoft Windows overall is a complex and heavy controlling OS.
____________
Greetings from TJ

I was running 5 climate models and lost several hundred hours - scunnered!

I have read here in the forum many times that suspending a GPUGRID WU will cause error and blue screen. That is why I have never tried it. For Albert and Einstein at home it can be done without harm (in my case).
____________
Greetings from TJ

Hi all,
after 25 hours (72 % completed) i suspend this Noelia's WU.
During resume i had this error, after my abort because it starts from 0%.
Did you have an idea about this ?
Thanks in advance.
K.

http://www.gpugrid.net/result.php?resultid=6879994

____________
Dreams do not always come true. But not because they are too big or impossible. Why did we stop believing.
(Martin Luther King)

The suspend-restart blue screen has never happened to me and I suspend quite often (Windows XP Pro x64). Maybe it's an OS specific issue, I also have my checkpoints set to 900 seconds (15 minutes), I did this mainly for the climate models I run. I do have problems when finishing a SDOERR and starting a NOELIA on the same GPU, no crashes, just the card running wild on the GPU clock.

This caused the driver to restart two or three times, and then I got a blue screen. On reboot lots of C+ errors and all my running WU's crashed and burned. Not an issue if I had been running FightMalaria@home, but I was running 5 climate models and lost several hundred hours - scunnered!

The climate models (CPDN) are very, very sensitive to any kind of an interruption. When I set my checkpoints to every 15 minutes, my computation error rate dropped by 70% and if I do 3 or more suspend/restarts within 10 minutes, I'll get at least 1 error.

When I reboot my computers (every 200 hours), I suspend the tasks and close BOINC by clicking exit, that works every time for me. If I get any kind of a crash or system freeze (neither have happened in over a year), it's a guarantee that I will lose some Climate models, I even have new APC units just incase.

The climate models (CPDN) are very, very sensitive to any kind of an interruption. When I set my checkpoints to every 15 minutes, my computation error rate dropped by 70% and if I do 3 or more suspend/restarts within 10 minutes, I'll get at least 1 error.

Hi all,

My GTX 650Ti is currently working on a NOELIA, but the GPU utilization looks pretty low: elapsed 10h, remaining 17h. That will be a total of 27 hours! A previous SDOERR took 18h.

I use Linux and so can't observe GPU utilization directly, but judging by the temperature (50C), the GPU is clearly not being fully used. It gets at >60C when it is.

Has anyone else observed this?

Edit: The WU's process (acemd.2868) consumes 5-10% CPU, but this doesn't seem to be the cause of the under-utilization, rather the symptom of it. I tried suspending CPU tasks and projects and it didn't change.

My configuration:
Ubuntu Server 12.04 x86_64
Kernel 3.2.0-41-generic.
NVIDIA driver 319.17
BOINC 7.0.65

My GTX 650Ti is currently working on a NOELIA, but the GPU utilization looks pretty low: elapsed 10h, remaining 17h. That will be a total of 27 hours! A previous SDOERR took 18h.

I use Linux and so can't observe GPU utilization directly, but judging by the temperature (50C), the GPU is clearly not being fully used. It gets at >60C when it is.

Has anyone else observed this?

PS. Finger pointed at CPDN (no system or WU failures since I stopped crunching climate models)!

I run CPDN too and had BSoD's a while back and traced my problem to the USB 3.0, I uninstalled the drivers, rebooted, went in to the BIOS and turned off USB 3.0. That was 4 to 5 months ago and it seems to have fixed it, maybe CPDN and the new USB doesn't get along. I figured that the drivers weren't mature enough, I don't need it so it's no big deal for me (knocking on wood).

Is Prefer Maximum Performance 'presently' selected (as in, did you set it since you last rebooted)?


PS. Finger pointed at CPDN (no system or WU failures since I stopped crunching climate models)!

My last task on the GTX285 was a NATHAN and took 196,443.98 seconds. That is 10,000 seconds than a NOELIA on the same card.
So these new NOELIA's are not all bad.
____________
Greetings from TJ