NAME
r.object.activelearning - Active learning for classifying raster objectsKEYWORDS
SYNOPSIS
Flags:
- --overwrite
- Allow output files to overwrite existing files
- --help
- Print usage summary
- --verbose
- Verbose module output
- --quiet
- Quiet module output
- --ui
- Force launching GUI dialog
Parameters:
- training_set=name [required]
- Training set (csv format)
- test_set=name [required]
- Test set (csv format)
- unlabeled_set=name [required]
- Unlabeled samples (csv format)
- learning_steps=integer
- Number of samples to label at each iteration
- Default: 5
- nbr_uncertainty=integer
- Number of samples to select (based on uncertainty criterion) before applying the diversity criterion.
- Default: 15
- diversity_lambda=float
- Lambda parameter used in the diversity heuristic
- Default: 0.25
- c_svm=float
- Penalty parameter C of the error term
- gamma_parameter=float
- Kernel coefficient
- search_iter=integer
- Number of parameter settings that are sampled in the automatic parameter search (C, gamma).
- Default: 15
- update=name
- Training set update file
- predictions=name
- Output file for class predictions
- training_updated=name
- Output file for the updated training file
- unlabeled_updated=name
- Output file for the updated unlabeled file
Table of contents
DESCRIPTION
This module uses SVM from the scikit-learn python package to perform classification on regions of raster maps. These regions can be the output of i.segment or r.clump.The module enables learning with only a small initial labeled data set via active learning. This semi-supervised learning algorithm interactively query the user to label the regions that are most useful to improve the overall classification score. With this technique, the number of examples to learn the classification is often much lower than the number of examples needed in normal supervised algorithms. You should start the classification with a small training set and run the module multiple times to label new informative samples to improve the classification score. The score metric is the number of correctly predicted labels over the total number of samples in the test set.
The samples that are chosen to be labeled are the ones where the class prediction is the most uncertain [2]. Moreover, from the more uncertain samples, only the most different samples are kept [1]. This diversity heuristic takes into account for each uncertain sample the distance to its closest neighbour and the average distance to all other samples. This ensures that newly labeled samples are not redundant with each other.
The learning data should be composed of features extracted from the regions, for example with the i.segment.stats module. The features of the training set, the test set and the unlabeled set should be in three different files in csv format. The first line of each file must be a header containing the features' name. Every regions should be uniquely identified by the first attribute. The classes for the training and test examples should be the second attribute.
Example of a training and test files :
cat,Class_num,attr1,attr2,attr3 167485,4,3.546,456.76,6.76 183234,6,5.76,1285.54,9.45 173457,2,5.65,468.76,6.78
Example of an unlabeled file :
cat,attr1,attr2,attr3 167485,3.546,456.76,6.76 183234,5.76,1285.54,9.45 173457,5.65,468.76,6.78
The training set can be easily updated once you have labeled new samples. Create a file to specify what label you give to which sample. This file in csv format should have a header and two attributes per line : the ID of the sample you have labeled and the label itself. The module will transfer the newly labeled samples from the unlabeled set to the training set, adding the class you have provided. This is done internally and does not modify your original files.
If the user wants to save the changes in new files according to the updates, new files can be created with the new labeled samples added to the training file and removed from the unlabeled file. Just specify the path of those output files in the parameters (training_updated, unlabeled_updated).
Example of an update file :
cat,Class_num 194762,2 153659,6 178350,2
Here are more details on a few parameters :
- learning_steps : This is the number of samples that the module will ask to label at each run.
- nbr_uncertainty : Number of uncertain samples to choose before applying the diversity filter. This number should be higher than learning_steps
- diversity_lambda : Parameter used in the diversity heuristic. If close to 0 only take into account the average distance to all other samples. If close to 1 only take into account the distance to the closest neighbour
- c_SVM : Penalty parameter C of the error term. If it is too large there is a risk of overfitting the training data. If it is too small you may have underfitting.
- gamma_SVM : Kernel coefficient. 1/#features is often a good value to start with. If C or gamma is left empty (or both), a good value based on the data distibution is found by cross-validation (at least 3 samples per class in the training set is needed, more is better). This automatic parameter tuning requires more computation time as the training set grows.
- search_iter :Number of parameter settings that are sampled in the automatic parameter search (C, gamma). search_iter trades off runtime vs quality of the solution.
EXAMPLES
The following examples are based on the data files found in this module repository.Simple run without an update file
r.object.activelearning training_set=/path/to/training_set.csv \ test_set=/path/to/test_set.csv \ unlabeled_set=/path/to/unlabeled_set.csv Parameters used : C=146.398423284, gamma=0.0645567086567, lambda=0.25 12527959 9892568 13731120 15445003 13767630 Class predictions written to predictions.csv Training set : 70 Test set : 585 Unlabeled set : 792 Score : 0.321367521368
With an update file
The five samples output at the previous example have been labeled and added to the update file.r.object.activelearning training_set=/path/to/training_set.csv \ test_set=/path/to/test_set.csv \ unlabeled_set=/path/to/unlabeled_set.csv \ update=/path/to/update.csv Parameters used : C=101.580687073, gamma=0.00075388337475, lambda=0.25 Class predictions written to predictions.csv Training set : 75 Test set : 585 Unlabeled set : 787 Score : 0.454700854701 8691475 9321017 14254774 14954255 15838185
NOTES
This module requires the scikit-learn python package. This module needs to be installed in your GRASS GIS Python environment. Please refer to r.learn.ml's notes on how to install this package.The memory usage for ~1450 samples of 52 features each is around ~650 kb. This number can vary due to the unpredictablity of the garbage collector's behaviour. Everything is computed in memory; therefore the size of the data is limited by the amount of RAM available.
REFERENCES
[1] Bruzzone, L. and Persello, C. (2009). Active learning for classification of remote sensing images. 2009 IEEE International Geoscience and Remote Sensing Symposium. doi:10.1109/igarss.2009.5417857[2] Tuia, D. et al (2011). A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification. IEEE Journal of Selected Topics in Signal Processing, 5(3), 606-617. doi:10.1109/jstsp.2011.2139193
AUTHOR
Lucas Lefèvre (ULB, Brussels, Belgium)Last changed: $Date: 2017-11-11 13:53:04 +0100 (Sat, 11 Nov 2017) $
SOURCE CODE
Available at: r.object.activelearning source code (history)
Main index | Raster index | Topics index | Keywords index | Graphical index | Full index
© 2003-2019 GRASS Development Team, GRASS GIS 7.4.5svn Reference Manual