[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Xen-users] Re: Xen, LVM, DRBD, Linux-HA



Nico Kadel-Garcia <nkadel@xxxxxxxxx> writes:


[...]

>> The only issue I worry about right now is a disk performance,
>> i.e. how much do I drop of my current ~100MB/s decent speed
>> (ext3 on LVM2 on S/W Raid10,f2 on 2xSAS SFF 10K)
>> putting somewhere into all that one more layer - DRDB.
>>
> Good question. I've not played with DRBD, and would also welcome
> information on it.

here are some tests i ran when testing my cluster

all 32bit dom0/domU, centos5.1 xen 3.0 drbd 8.0.11

disks are sata

Vendor: ATA       Model: Hitachi HUA72105  Rev: GK6O

drbd is synced via gigabit crossover cable on a pair of BCM5721

hopefully this formats well ;)

bonie++ results

name    file_size       putc    putc_cpu        put_block       put_block_cpu   
rewrite rewrite_cpu     getc    getc_cpu        get_block       get_block_cpu   
seeks
xxx     1G      32835   84      36672   3       15330   0       45565   37      
81288   0       214.4
xxx     1G      33447   85      36397   3       17187   0       43458   35      
80600   0       226
xxx     1G      32904   84      35061   2       16423   0       44402   34      
79767   0       222.4
xxx     1G      35623   55      36679   2       16757   0       43347   31      
80110   0       210.3
xxx     1G      36225   57      36461   3       14908   0       39560   54      
78780   0       214.9
xxx     1G      33914   53      33150   2       15838   0       43829   34      
81146   0       212.4
xxx     1G      34580   73      35840   2       12504   0       32321   67      
81201   0       216
xxx     1G      35957   58      35184   2       14923   0       44902   35      
81854   0       222.7
xxx     1G      36743   58      36733   3       14998   0       46162   35      
80467   0       223.2
xxx     1G      35407   55      33088   2       15780   0       38761   30      
81010   0       225.1
avg             34763.5 66.2    35526.5 2.4     15464.8 0       42230.7 39.2    
80622.3 0       218.74

noatime,nodiratime,data=writeback                                               
                                                
xxx     1G      37214   59      36412   2       22132   0       43897   40      
78985   0       250.9
xxx     1G      35971   57      39619   3       21283   0       44129   38      
79904   0       254.8
xxx     1G      35299   55      38084   2       21073   0       43567   36      
78576   0       250.2
xxx     1G      35728   56      39035   2       23278   0       43812   36      
79060   0       252.2
xxx     1G      36807   58      40318   3       21518   0       43926   40      
78694   0       251.1
xxx     1G      36934   59      38663   3       23104   0       43691   36      
67848   0       235
xxx     1G      34884   55      39836   3       22323   0       42778   34      
78294   0       248.8
xxx     1G      36630   58      40599   2       20535   0       43880   34      
79439   0       255
xxx     1G      35963   57      40535   3       20716   0       43539   34      
78697   0       253.7
xxx     1G      36111   57      36946   2       23118   0       44323   34      
79656   0       247.1
avg             36154.1 57.1    39004.7 2.5     21908   0       43754.2 36.2    
77915.3 0       249.88

to base         1390.6  -9.1    3478.2  0.1     6443.2  0       1523.5  -3      
-2707   0       31.14
                3.85%   -15.94% 8.92%   4.00%   29.41%          3.48%   -8.29%  
-3.47%          12.46%

protocol=B,noatime,nodiratime,data=writeback                                    
                                                        
xxx     1G      35641   56      38721   2       22342   0       43493   39      
79768   0       247.6
xxx     1G      35846   56      37661   2       22608   0       43794   38      
79423   0       252.4
xxx     1G      36957   59      38804   2       23436   0       44014   37      
80370   0       248
xxx     1G      37655   59      36757   2       23312   0       43821   36      
79384   0       251.2
xxx     1G      36126   57      37796   2       22240   0       43322   35      
79189   0       243.3
xxx     1G      37010   59      37124   3       22273   0       43703   36      
78480   0       246.1
xxx     1G      36342   57      37965   2       22615   0       43825   35      
80078   0       256.1
xxx     1G      37205   59      38391   2       21258   0       43524   33      
80328   0       251.1
xxx     1G      36284   57      37569   2       22638   0       43666   34      
80152   0       243.5
xxx     1G      37751   60      37565   3       21748   0       43702   35      
78545   0       248.3
avg             36681.7 57.9    37835.3 2.2     22447   0       43686.4 35.8    
79571.7 0       248.76

to noatime              527.6   0.8     -1169.4 -0.3    539     0       -67.8   
-0.4    1656.4  0       -1.12
                1.44%   1.38%   -3.09%  -13.64% 2.40%           -0.16%  -1.12%  
2.08%           -0.45%

to base         1918.2  0.173186453     -0.120081513    -0.176363636    
-0.270090493    0       -0.036371485    0.071699744     0.055559301     0       
-0.129122149
                5.23%   0.30%   0.00%   -8.02%  0.00%           0.00%   0.20%   
0.00%           -0.05%


protocol=A,noatime,nodiratime,data=writeback                                    
                                                        
xxx     1G      36481   58      39849   3       22559   0       45600   35      
78342   0       260.4
xxx     1G      38373   61      41659   3       25262   0       46306   39      
79128   0       254.4
xxx     1G      38403   61      40145   3       22839   0       41231   32      
78267   0       260.3
xxx     1G      38048   61      41926   3       21506   0       44942   36      
79753   0       255
xxx     1G      37734   60      39419   3       22692   0       44637   37      
80066   0       261.3
xxx     1G      38553   62      38847   2       24376   0       45162   38      
80295   0       257.7
xxx     1G      38605   91      38709   2       23814   0       37731   63      
80322   0       256.9
xxx     1G      37455   59      39987   3       21526   0       45214   40      
79139   0       251.2
xxx     1G      38451   61      40734   3       24739   0       45160   37      
78289   0       250.9
xxx     1G      37001   91      38912   3       22429   0       40696   61      
66910   0       257.5
avg             37910.4 66.5    40018.7 2.8     23174.2 0       43667.9 41.8    
78051.1 0       256.56

to protocol=b           1228.7  8.6     2183.4  0.6     727.2   0       -18.5   
6       -1520.6 0       7.8
                3.24%   12.93%  5.46%   21.43%  3.14%   #DIV/0! -0.04%  14.35%  
-1.95%  #DIV/0! 3.04%

to protocol=C, noatime          1756.3  9.4     1014    0.3     1266.2          
-86.3   5.6     135.8           6.68
                4.63%   14.14%  2.53%   10.71%  5.46%           -0.20%  13.40%  
0.17%           2.60%

to base         3146.90 0.30    4492.20 0.40    7709.40         1437.20 2.60    
-2571.20                37.82
                8.30%   0.45%   11.23%  14.29%  33.27%          3.29%   6.22%   
-3.29%          14.74%
                                                                                
                

protocol=A,al_extents=3833                                                      
                                        
xxx     1G      36926   58      38374   2       25660   0       43575   34      
80513   0       245.8
xxx     1G      40684   65      42660   3       27165   0       43255   35      
81155   0       247.2
xxx     1G      42181   67      44296   3       27211   0       39922   38      
78175   0       245.4
xxx     1G      41712   67      42931   3       26529   0       43312   37      
81270   0       246.7
xxx     1G      40893   65      44333   3       26047   0       42691   35      
80717   0       240.8
xxx     1G      41157   65      44047   3       28368   0       43275   35      
81241   0       244.1
xxx     1G      40660   65      43618   3       24242   0       43647   39      
82371   0       222.8
xxx     1G      39230   62      43198   3       25762   0       42809   35      
81119   0       209
xxx     1G      39602   63      41687   3       23352   0       43099   37      
82070   0       222.3
xxx     1G      39928   63      42956   3       24787   0       42539   35      
64510   0       209.6
avg             40297.3 64      42810   2.9     25912.3 0       42812.4 36      
79314.1 0       233.37

to extents=287          2386.9  -2.5    2791.3  0.1     2738.1          -855.5  
-5.8    1263    0       -23.19
                5.92%   -3.91%  6.52%   3.45%   10.57%          -2.00%  -16.11% 
1.59%   #DIV/0! -9.94%

to base         5533.8  -2.2    7283.5  0.5     10447.5         581.7   -3.2    
-1308.2 0       14.63
                13.73%  -3.44%  17.01%  17.24%  40.32%          1.36%   -8.89%  
-1.65%  #DIV/0! 6.27%

protocol=A,bmbv,extents=3833                                                    
                                        
xxx     1G      38774   62      41954   3       26871   0       44548   38      
80508   0       252.4
xxx     1G      37119   59      41707   3       26761   0       44931   38      
78643   0       246.5
xxx     1G      37099   59      41287   3       24634   0       44618   40      
79872   0       251.5
xxx     1G      38029   60      41831   3       25955   0       44247   37      
80158   0       253.6
xxx     1G      38063   60      41692   3       26362   0       39694   37      
77554   0       247.1
xxx     1G      38167   61      41958   3       25310   0       44360   36      
80196   0       250.4
xxx     1G      37958   60      42119   3       25936   0       44882   36      
80044   0       249.5
xxx     1G      38432   61      41406   3       26224   0       44737   35      
80305   0       248.8
xxx     1G      38521   62      40864   3       25105   0       44246   36      
81041   0       229
xxx     1G      37439   60      41781   3       24687   0       43397   36      
79838   0       230.7
avg             37960.1 60.4    41659.9 3       25784.5 0       43966   36.9    
79815.9 0       245.95

to base         3196.6  -5.8    6133.4  0.6     10319.7         1735.3  -2.3    
-806.4  0       27.21
                8.42%   -9.60%  14.72%  20.00%  40.02%          3.95%   -6.23%  
-1.01%          11.06%

to protocol=A, no bmbv          -2337.2 -3.6    -1150.1 0.1     -127.8  0       
1153.6  0.9     501.8   0       12.58
                -6.16%  -5.96%  -2.76%  3.33%   -0.50%          2.62%   2.44%   
0.63%           5.11%

unlimited rate                                                                  
                        
xxx     1G      38672   61      40177   3       25345   0       44294   38      
79754   0       250.5
xxx     1G      39369   63      41914   2       25069   0       43973   38      
79088   0       252.2
xxx     1G      40102   64      41508   3       26866   0       40644   35      
80110   0       253.3
xxx     1G      39183   62      42734   3       25661   0       44282   36      
80201   0       254.7
xxx     1G      38521   61      41672   3       25149   0       44723   36      
80452   0       239.2
xxx     1G      37976   60      43040   3       24480   0       44304   37      
80280   0       232.8
xxx     1G      39870   63      41722   3       24268   0       44183   38      
79207   0       233.5
xxx     1G      38650   61      42041   3       25777   0       44533   36      
66930   1       236.3
xxx     1G      39515   63      42254   3       26524   0       44643   37      
80044   0       251.9
xxx     1G      40085   64      40896   3       25889   0       45097   36      
79824   0       248.8
                39194.3 62.2    41795.8 2.9     25502.8 0       44067.6 36.7    
78589   0.1     245.32

to base         4430.8  -4      6269.3  0.5     10038   0       1836.9  -2.5    
-2033.3 0.1     26.58
                11.30%  -6.43%  15.00%  17.24%  39.36%          4.17%   -6.81%  
-2.59%  100.00% 10.83%

to prev         1234.2  1.8     135.9   -0.1    -281.7  0       101.6   -0.2    
-1226.9 0.1     -0.63
                3.15%   2.89%   0.33%   -3.45%  -1.10%          0.23%   -0.54%  
-1.56%  100.00% -0.26%

to protocol=A,al_extents=3832           -1103   -1.8    -1014.2 0       -409.5  
0       1255.2  0.7     -725.1  0.1     11.95
                -2.81%  -2.89%  -2.43%  0.00%   -1.61%  #DIV/0! 2.85%   1.91%   
-0.92%  100.00% 4.87%



-- 
To sto si frustriran, zavidan tko zna na cemu i sto ne vidis dalje od
svoje guzice je tuzno. Da onda barem imas toliko samokontrole da
sutis umjesto da pravis budalu od sebe... izgleda da si prestar da se
promjenis na bolje. - Davor Pasaric, hr.comp.mac


_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users


 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.