Linode.com Forum Forum Index Linode.com Forum
Linode Community Forums
 


Variability in Xenode parallelization test results

Click here to go to the original topic

 
       Linode.com Forum Forum Index -> Performance and Tuning
Author Message
zunzun



Joined: 18 Feb 2005
Posts: 163
Location: Birmingham, Alabama USA

Posted: Sun Feb 10, 2008 8:54 pm    Post subject: Variability in Xenode parallelization test results  

I'm having some difficulty testing different parallelization methods and parameters on my Xenode, in that test result variability is high.

Since the physical server is shared, any other CPU usage appears as a slower test in my results - sometimes taking 4 times as long as the minimum time. Re-running the same test repeatedly yields varying times, yet with a floor minimum time (presumably when the hardware CPUs are all available).


There seem to be two ways to reduce the testing uncertainty.

1) I repeat the tests many times, taking the minimum test time as the result. This slows down testing and takes away resources from other users, so I don't like this method at all. I can never be sure that I've hit a time when all CPUs were avaiable to me, and the only way to reduce this uncertainty is to repeat the tests more and more often for a greater statistical sampling.

2) Force my share of the Xenode CPU utilization to minimum. This reduces CPU availability uncertainty to zero (they will never run any slower than this), so I only run my tests once. This also has the absolute minimum possible impact on other users. So I like this method.

How can I force my Xenode to minimum CPU share? Is there a way?

James
Back to top  
bdonlan



Joined: 22 Jan 2008
Posts: 59

Posted: Sun Feb 10, 2008 9:31 pm    Post subject: Re: Variability in Xenode parallelization test results  

zunzun wrote:
How can I force my Xenode to minimum CPU share? Is there a way?

I don't think it's possible; most OSes (including probably Xen) won't leave the CPU idle when there's a runnable domain.
Back to top  
OverlordQ



Joined: 04 Jun 2004
Posts: 199

Posted: Mon Feb 11, 2008 12:06 am    Post subject:  

Well your best solution is to use a good testing method, ala not run it on a shared machine.
Back to top  
zunzun



Joined: 18 Feb 2005
Posts: 163
Location: Birmingham, Alabama USA

Posted: Mon Feb 11, 2008 7:45 am    Post subject:  

OverlordQ wrote: Well your best solution is to use a good testing method, ala not run it on a shared machine.

Can I borrow one of your multi-core servers for testing?

James
Back to top  
zunzun



Joined: 18 Feb 2005
Posts: 163
Location: Birmingham, Alabama USA

Posted: Mon Feb 11, 2008 1:10 pm    Post subject: Re: Variability in Xenode parallelization test results  

bdonlan wrote: I don't think it's possible; most OSes (including probably Xen) won't leave the CPU idle when there's a runnable domain.

Allow me to rephrase the question: Could it be set it to use *no more than* my minimum share?

James
Back to top  
yejun



Joined: 19 Feb 2008
Posts: 9
Location: USA

Posted: Tue Feb 19, 2008 1:32 pm    Post subject:  

I think amazon ec2 has hard limit on cpu resources. Their xlarge instance has 8 cores.
Back to top  
 
       Linode.com Forum Forum Index -> Performance and Tuning
Page 1 of 1