Model Building: Preprocessing Methods: Difference between revisions
imported>Jeremy |
imported>Jeremy |
(No difference)
|
Revision as of 14:29, 13 July 2011
Table of Contents | Previous | Next
Preprocessing Methods
Data preprocessing describes any type of processing procedures that are performed on raw data to prepare it for another processing procedure and ultimately, analysis. Preprocessing linearizes the relationships among the variables in your DataSet and removes extraneous sources of variation that are of no interest to the analysis. A variety of preprocessing methods are available in Solo.
The Preprocessing window section describes the basic steps for setting up preprocessing rules for an analysis and verifying that the rules that you have set up are as you want them.
The Advanced Preprocessing: Introduction page gives a technical discussion of Preprocessing theory.
A thorough discussion of the objectives, theory, and equations associated with specific preprocessing methods can be found in the individual topics listed below:
- Noise, Offset, and Baseline Filtering (e.g. Baselining, Smoothing, Derivatives, Detrending)
- Sample Normalization (e.g. Normalization, MSC, SNV)
- Simple Mathematical Operations
- Variable Centering (e.g. Mean Centering, Median Centering)
- Variable Scaling (e.g. Autoscaling)
- Multiway Centering and Scaling
- Multivariate Filtering (e.g. GLSW, EPO, OSC)
Preprocessing window
You use the Preprocessing window to specify the preprocessing methods that you want to carry out for your data and in what order. The available methods are grouped by type (Filtering, Normalization, and so on) in the Available Methods (left) pane of the window. The methods that you select for preprocessing your data are displayed in the Selected Methods (right) pane. The methods are carried out in the order in which they are listed in the pane. The default selected method is Autoscale.
- Preprocessing window
1. | To open this window, do one of the following: |
|
|
|
2. | In the Available Methods pane, select the method by which you want to preprocess your data, and then click Add. |
- Note: Some preprocessing methods, for example, the Savitzky-Golay method, require you to specify values for method-specific parameters before you can add the method to the Selected Methods pane.
3. | Repeat Step 2 until you have selected all of the necessary preprocessing methods. |
- Note: Regardless of the other preprocessing steps selected, Autoscale or Mean Centering should typically be the final preprocessing step in the series.
4. | Optionally, after you have selected all of the necessary preprocessing methods, you can do one or more of the following: |
|
|
|
|
Note: The figure below shows preprocessing using default preprocessing methods on a 200 x 30 DataSet for a simple PCA model.
- Preprocessing using default preprocessing methods on a 200 x 30 DataSet for a simple PCA model
|
After you have selected preprocessing methods for your data, you can point your mouse cursor on the Preprocessing icon for a control in which you have loaded data. Tooltip text opens with preprocessing information.
- Tooltip text with preprocessing information