r.object.activelearning - GRASS GIS manual

NAME

r.object.activelearning - Active learning for classifying raster objects

KEYWORDS

SYNOPSIS

r.object.activelearning

r.object.activelearning --help

r.object.activelearning training_set=name test_set=name unlabeled_set=name [learning_steps=integer] [nbr_uncertainty=integer] [diversity_lambda=float] [c_svm=float] [gamma_parameter=float] [search_iter=integer] [update=name] [predictions=name] [training_updated=name] [unlabeled_updated=name] [--overwrite] [--help] [--verbose] [--quiet] [--ui]

Flags:

--overwrite: Allow output files to overwrite existing files
--help: Print usage summary
--verbose: Verbose module output
--quiet: Quiet module output
--ui: Force launching GUI dialog

Parameters:

training_set=name [required]: Training set (csv format)
test_set=name [required]: Test set (csv format)
unlabeled_set=name [required]: Unlabeled samples (csv format)
learning_steps=integer: Number of samples to label at each iteration; Default: 5
nbr_uncertainty=integer: Number of samples to select (based on uncertainty criterion) before applying the diversity criterion.; Default: 15
diversity_lambda=float: Lambda parameter used in the diversity heuristic; Default: 0.25
c_svm=float: Penalty parameter C of the error term
gamma_parameter=float: Kernel coefficient
search_iter=integer: Number of parameter settings that are sampled in the automatic parameter search (C, gamma).; Default: 15
update=name: Training set update file
predictions=name: Output file for class predictions
training_updated=name: Output file for the updated training file
unlabeled_updated=name: Output file for the updated unlabeled file

DESCRIPTION
EXAMPLES
- Simple run without an update file
- With an update file
NOTES
REFERENCES
AUTHOR

DESCRIPTION

This module uses SVM from the scikit-learn python package to perform classification on regions of raster maps. These regions can be the output of i.segment or r.clump.

The module enables learning with only a small initial labeled data set via active learning. This semi-supervised learning algorithm interactively query the user to label the regions that are most useful to improve the overall classification score. With this technique, the number of examples to learn the classification is often much lower than the number of examples needed in normal supervised algorithms. You should start the classification with a small training set and run the module multiple times to label new informative samples to improve the classification score. The score metric is the number of correctly predicted labels over the total number of samples in the test set.

The samples that are chosen to be labeled are the ones where the class prediction is the most uncertain [2]. Moreover, from the more uncertain samples, only the most different samples are kept [1]. This diversity heuristic takes into account for each uncertain sample the distance to its closest neighbour and the average distance to all other samples. This ensures that newly labeled samples are not redundant with each other.

The learning data should be composed of features extracted from the regions, for example with the i.segment.stats module. The features of the training set, the test set and the unlabeled set should be in three different files in csv format. The first line of each file must be a header containing the features' name. Every regions should be uniquely identified by the first attribute. The classes for the training and test examples should be the second attribute.

Example of a training and test files :

			cat,Class_num,attr1,attr2,attr3
			167485,4,3.546,456.76,6.76 
			183234,6,5.76,1285.54,9.45
			173457,2,5.65,468.76,6.78

Example of an unlabeled file :

			cat,attr1,attr2,attr3
			167485,3.546,456.76,6.76 
			183234,5.76,1285.54,9.45
			173457,5.65,468.76,6.78

The training set can be easily updated once you have labeled new samples. Create a file to specify what label you give to which sample. This file in csv format should have a header and two attributes per line : the ID of the sample you have labeled and the label itself. The module will transfer the newly labeled samples from the unlabeled set to the training set, adding the class you have provided. This is done internally and does not modify your original files.

If the user wants to save the changes in new files according to the updates, new files can be created with the new labeled samples added to the training file and removed from the unlabeled file. Just specify the path of those output files in the parameters (training_updated, unlabeled_updated).

Example of an update file :

			cat,Class_num
			194762,2
			153659,6
			178350,2

Here are more details on a few parameters :

learning_steps : This is the number of samples that the module will ask to label at each run.
nbr_uncertainty : Number of uncertain samples to choose before applying the diversity filter. This number should be higher than learning_steps
diversity_lambda : Parameter used in the diversity heuristic. If close to 0 only take into account the average distance to all other samples. If close to 1 only take into account the distance to the closest neighbour
c_SVM : Penalty parameter C of the error term. If it is too large there is a risk of overfitting the training data. If it is too small you may have underfitting.
gamma_SVM : Kernel coefficient. 1/#features is often a good value to start with.
search_iter :Number of parameter settings that are sampled in the automatic parameter search (C, gamma). search_iter trades off runtime vs quality of the solution.

EXAMPLES

The following examples are based on the data files found in this module repository.

Simple run without an update file

		r.object.activelearning training_set=/path/to/training_set.csv \
					test_set=/path/to/test_set.csv \
					unlabeled_set=/path/to/unlabeled_set.csv

		Parameters used : C=146.398423284, gamma=0.0645567086567, lambda=0.25
		12527959
		9892568
		13731120
		15445003
		13767630
		Class predictions written to predictions.csv
		Training set : 70
		Test set : 585
		Unlabeled set : 792
		Score : 0.321367521368

With an update file

The five samples output at the previous example have been labeled and added to the update file.

		r.object.activelearning training_set=/path/to/training_set.csv \
		                        test_set=/path/to/test_set.csv \
					unlabeled_set=/path/to/unlabeled_set.csv \
					update=/path/to/update.csv

		Parameters used : C=101.580687073, gamma=0.00075388337475, lambda=0.25
		Class predictions written to predictions.csv
		Training set : 75
		Test set : 585
		Unlabeled set : 787
		Score : 0.454700854701
		8691475
		9321017
		14254774
		14954255
		15838185

NOTES

This module requires the scikit-learn python package. This module needs to be installed in your GRASS GIS Python environment. Please refer to r.learn.ml's notes on how to install this package.

The memory usage for ~1450 samples of 52 features each is around ~650 kb. This number can vary due to the unpredictablity of the garbage collector's behaviour. Everything is computed in memory; therefore the size of the data is limited by the amount of RAM available.

REFERENCES

[1] Bruzzone, L. and Persello, C. (2009). Active learning for classification of remote sensing images. 2009 IEEE International Geoscience and Remote Sensing Symposium. doi:10.1109/igarss.2009.5417857
[2] Tuia, D. et al (2011). A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification. IEEE Journal of Selected Topics in Signal Processing, 5(3), 606-617. doi:10.1109/jstsp.2011.2139193

AUTHOR

Lucas Lefèvre (ULB, Brussels, Belgium)

SOURCE CODE

Available at: r.object.activelearning source code (history)