ToolboxPerformance: Difference between revisions

From Eigenvector Research Documentation Wiki
Jump to navigation Jump to search
imported>Mathias
imported>Mathias
Line 15: Line 15:




'''PCA time in seconds required to train model'''
'''PCA time in seconds required to build model'''


{| border="1" cellpadding="5" cellspacing="0"
{| border="1" cellpadding="5" cellspacing="0"
Line 46: Line 46:
| |'''20000 samples'''
| |'''20000 samples'''
||  .2 GB
||  .2 GB
||  1 GB
||  1 GB
||  3.5 GB
||  3.5 GB


|- valign="top"  
|- valign="top"  
| |'''50000 samples'''
| |'''50000 samples'''
|| 3.55  
|| 3.55  
|| 9 GB
|| 9 GB
|| 61 GB
|| 61 GB


|-
|-
Line 69: Line 62:




'''PCR time in seconds required to train model'''
'''PCR time in seconds required to build model'''


{| border="1" cellpadding="5" cellspacing="0"
{| border="1" cellpadding="5" cellspacing="0"
Line 78: Line 71:
| |'''20000 samples'''
| |'''20000 samples'''
||  3
||  3
||  6  
||  6  
||  44  
||  44  


Line 87: Line 78:
| |'''50000 samples'''
| |'''50000 samples'''
||  5
||  5
||  12
||  12
||  71
||  71




Line 110: Line 98:


||  1  
||  1  
||  4 GB   
||  4 GB   


Line 119: Line 106:


||  4 GB
||  4 GB
||  11
||  11


Line 126: Line 112:
|-
|-
|}
|}
''' PLS time in seconds required to train model'''
''' PLS time in seconds required to build model'''


{| border="1" cellpadding="5" cellspacing="0"
{| border="1" cellpadding="5" cellspacing="0"
Line 135: Line 121:
| |'''20000 samples'''
| |'''20000 samples'''
|| 3.3
|| 3.3
|| 8   
|| 8   
|| 43   
|| 43   


Line 144: Line 128:
| |'''50000 samples'''
| |'''50000 samples'''
|| 8
|| 8
|| 18
|| 18
|| 98
|| 98
|-
|-
|}
|}
Line 164: Line 143:
| |'''100 samples'''
| |'''100 samples'''
|| 1 GB
|| 1 GB
|| 2 GB
|| 2 GB
|| 5 GB  
|| 5 GB  
|- valign="top"  
|- valign="top"  
| |'''500 samples'''
| |'''500 samples'''
|| 1.6 GB
|| 1.6 GB
|| 5.2 GB
|| 5.2 GB
|| 13 GB
|| 13 GB
|-
|-
|}
|}
Line 187: Line 156:




'''LWR time in seconds required to train model'''
'''LWR time in seconds required to build model'''


{| border="1" cellpadding="5" cellspacing="0"
{| border="1" cellpadding="5" cellspacing="0"
| ||'''1000 variables'''||'''5000 variables'''||'''10000 variables'''
| ||'''1000 variables'''||'''5000 variables'''||'''10000 variables'''
|- valign="top"  
|- valign="top"  
| |'''20000 samples'''
| |'''20000 samples'''
||  4
||  4
|| 65   
|| 65   
|| 76   
|| 76   
|- valign="top"  
|- valign="top"  
| |'''50000 samples'''
| |'''50000 samples'''
|| 10
|| 10
|| 77
|| 77
||  670
||  670
|-
|-
|}
|}




Line 223: Line 179:


| ||'''1000 variables'''||'''2000 variables'''||'''5000 variables'''
| ||'''1000 variables'''||'''2000 variables'''||'''5000 variables'''
|- valign="top"  
|- valign="top"  
| |'''20000 samples'''
| |'''20000 samples'''
||  <1 GB  
||  <1 GB  
||  2 GB  
||  2 GB  
 
||  3.5 GB  
||  3.4 GB  
 
 
|- valign="top"  
|- valign="top"  
| |'''50000 samples'''
| |'''50000 samples'''
||  .6 GB
||  .6 GB
||  3 GB
||  3 GB
||  6.75 GB
||  6.75 GB
|-
|-
|}
|}
Line 249: Line 195:




'''ANN time in seconds required to train model'''
'''ANN time in seconds required to build model'''


{| border="1" cellpadding="5" cellspacing="0"
{| border="1" cellpadding="5" cellspacing="0"
| ||'''100 variables'''||'''500 variables'''||'''1000 variables'''
| ||'''100 variables'''||'''500 variables'''||'''1000 variables'''
|- valign="top"  
|- valign="top"  
| |'''500 samples'''
| |'''500 samples'''
||  6
||  6
|| 28   
|| 28   
|| 95   
|| 95   
|- valign="top"  
|- valign="top"  
| |'''1000 samples'''
| |'''1000 samples'''
|| 10
|| 10
||  370
||  370
||  360
||  360
|- valign="top"  
|- valign="top"  
| |'''2000 samples'''
| |'''2000 samples'''
||  12
||  12
||  550
||  550
||  2810 s
||  2810 s
|-
|-
|}
|}


'''SVM time in seconds required to train model'''
'''SVM time in seconds required to train model'''
Line 296: Line 226:
| |'''100 samples'''
| |'''100 samples'''
|| 8
|| 8
|| 28   
|| 28   
|| 105   
|| 105   
|- valign="top"  
|- valign="top"  
| |'''500 samples'''
| |'''500 samples'''
|| 150
|| 150
|| 640
|| 640
||  2370
||  2370
|- valign="top"  
|- valign="top"  
| |'''1000 samples'''
| |'''1000 samples'''
||
||
||
||
||
||
|-
|-
|}
|}




'''SVM with PCA compression time in seconds required to train model'''
'''SVM with PCA compression time in seconds required to build model'''


{| border="1" cellpadding="5" cellspacing="0"
{| border="1" cellpadding="5" cellspacing="0"
Line 333: Line 251:
| |'''100 samples'''
| |'''100 samples'''
|| 4
|| 4
|| 4   
|| 4   
|| 4  
|| 4  
|- valign="top"  
|- valign="top"  
| |'''500 samples'''
| |'''500 samples'''
|| 38
|| 38
|| 38
|| 38
|| 38
|| 38
|- valign="top"  
|- valign="top"  
| |'''1000 samples'''
| |'''1000 samples'''
||
||
||
||
||
||
|-
|-
|}
|}
Line 363: Line 269:


{| border="1" cellpadding="5" cellspacing="0"
{| border="1" cellpadding="5" cellspacing="0"
| ||'''100 variables'''||'''500 variables'''||'''1000 variables'''
| ||'''100 variables'''||'''500 variables'''||'''1000 variables'''
|- valign="top"  
|- valign="top"  
| |'''100 samples'''
| |'''100 samples'''
||
||
||   
||   
||   
||   
|- valign="top"  
|- valign="top"  
| |'''500 samples'''
| |'''500 samples'''
||
||
||
||
||
||
|- valign="top"  
|- valign="top"  
| |'''1000 samples'''
| |'''1000 samples'''
||
||
||
||
||
||
|-
|-
|}
|}

Revision as of 12:12, 13 September 2016

PLS_Toolbox Performance

The following performance results are for general comparison and expectation. Your own mileage may vary.


Performance Table
Matlab Versoin PLS_Toolbox Version Operating System System Description Data Description Algorithm Performance Result
2015a 8.1.1 OS X El Capitan 2.8 GHz Intel, 16 GB ram cell cell



PCA time in seconds required to build model

1000 variables 2000 variables 5000 variables
20000 samples 2 4.7 40
50000 samples 3.5 9 61


PCA memory requirements

1000 variables 2000 variables 5000 variables
20000 samples .2 GB 1 GB 3.5 GB
50000 samples 3.55 9 GB 61 GB



PCR time in seconds required to build model

1000 variables 2000 variables 5000 variables
20000 samples 3 6 44


50000 samples 5 12 71



PCR memory requirements

1000 variables 2000 variables 5000 variables
20000 samples .2 GB 1 4 GB


50000 samples .5 GB 4 GB 11


PLS time in seconds required to build model

1000 variables 2000 variables 5000 variables
20000 samples 3.3 8 43


50000 samples 8 18 98


PLS Memory requirements

100 variables 500 variables 1000 variables
100 samples 1 GB 2 GB 5 GB
500 samples 1.6 GB 5.2 GB 13 GB



LWR time in seconds required to build model

1000 variables 5000 variables 10000 variables
20000 samples 4 65 76
50000 samples 10 77 670


LWR memory requirements

1000 variables 2000 variables 5000 variables
20000 samples <1 GB 2 GB 3.5 GB
50000 samples .6 GB 3 GB 6.75 GB



ANN time in seconds required to build model

100 variables 500 variables 1000 variables
500 samples 6 28 95
1000 samples 10 370 360
2000 samples 12 550 2810 s

SVM time in seconds required to train model

100 variables 500 variables 2000 variables
100 samples 8 28 105
500 samples 150 640 2370
1000 samples


SVM with PCA compression time in seconds required to build model

100 variables 500 variables 1000 variables
100 samples 4 4 4
500 samples 38 38 38
1000 samples

SVM memory requirements

100 variables 500 variables 1000 variables
100 samples
500 samples
1000 samples