/
githubmirror
/
scikit-learn
Обзор
Документация
Войти
/
githubmirror
/
scikit-learn
Код
Запросы
0
Пакеты
0
Релизы
0
Аналитика
Безопасность
main
doc/modules/semi_supervised.rst
155 строк
7 KB
Elham Babaei
DOC improved plot_semi_supervised_newsgroups.py example (#31104)
21 авг 2025, 10:48
Не верифицирован
21 авг 2025, 10:48
6aa5a6f
Код
Авторство
О чём код?
.. _semi_supervised: =================================================== Semi-supervised learning =================================================== .. currentmodule:: sklearn.semi_supervised `Semi-supervised learning <https://en.wikipedia.org/wiki/Semi-supervised_learning>`_ is a situation in which in your training data some of the samples are not labeled. The semi-supervised estimators in :mod:`sklearn.semi_supervised` are able to make use of this additional unlabeled data to better capture the shape of the underlying data distribution and generalize better to new samples. These algorithms can perform well when we have a very small amount of labeled points and a large amount of unlabeled points. .. topic:: Unlabeled entries in `y` It is important to assign an identifier to unlabeled points along with the labeled data when training the model with the ``fit`` method. The identifier that this implementation uses is the integer value :math:`-1`. Note that for string labels, the dtype of `y` should be object so that it can contain both strings and integers. .. note:: Semi-supervised algorithms need to make assumptions about the distribution of the dataset in order to achieve performance gains. See `here <https://en.wikipedia.org/wiki/Semi-supervised_learning#Assumptions>`_ for more details. .. rubric:: Examples * :ref:`sphx_glr_auto_examples_semi_supervised_plot_semi_supervised_newsgroups.py` .. _self_training: Self Training ============= This self-training implementation is based on Yarowsky's [1]_ algorithm. Using this algorithm, a given supervised classifier can function as a semi-supervised classifier, allowing it to learn from unlabeled data. :class:`SelfTrainingClassifier` can be called with any classifier that implements `predict_proba`, passed as the parameter `estimator`. In each iteration, the `estimator` predicts labels for the unlabeled samples and adds a subset of these labels to the labeled dataset. The choice of this subset is determined by the selection criterion. This selection can be done using a `threshold` on the prediction probabilities, or by choosing the `k_best` samples according to the prediction probabilities. The labels used for the final fit as well as the iteration in which each sample was labeled are available as attributes. The optional `max_iter` parameter specifies how many times the loop is executed at most. The `max_iter` parameter may be set to `None`, causing the algorithm to iterate until all samples have labels or no new samples are selected in that iteration. .. note:: When using the self-training classifier, the :ref:`calibration <calibration>` of the classifier is important. .. rubric:: Examples * :ref:`sphx_glr_auto_examples_semi_supervised_plot_self_training_varying_threshold.py` * :ref:`sphx_glr_auto_examples_semi_supervised_plot_semi_supervised_versus_svm_iris.py` .. rubric:: References .. [1] :doi:`"Unsupervised word sense disambiguation rivaling supervised methods" <10.3115/981658.981684>` David Yarowsky, Proceedings of the 33rd annual meeting on Association for Computational Linguistics (ACL '95). Association for Computational Linguistics, Stroudsburg, PA, USA, 189-196. .. _label_propagation: Label Propagation ================= Label propagation denotes a few variations of semi-supervised graph inference algorithms. A few features available in this model: * Used for classification tasks * Kernel methods to project data into alternate dimensional spaces `scikit-learn` provides two label propagation models: :class:`LabelPropagation` and :class:`LabelSpreading`. Both work by constructing a similarity graph over all items in the input dataset. .. figure:: ../auto_examples/semi_supervised/images/sphx_glr_plot_label_propagation_structure_001.png :target: ../auto_examples/semi_supervised/plot_label_propagation_structure.html :align: center :scale: 60% **An illustration of label-propagation:** *the structure of unlabeled observations is consistent with the class structure, and thus the class label can be propagated to the unlabeled observations of the training set.* :class:`LabelPropagation` and :class:`LabelSpreading` differ in modifications to the similarity matrix that graph and the clamping effect on the label distributions. Clamping allows the algorithm to change the weight of the true ground labeled data to some degree. The :class:`LabelPropagation` algorithm performs hard clamping of input labels, which means :math:`\alpha=0`. This clamping factor can be relaxed, to say :math:`\alpha=0.2`, which means that we will always retain 80 percent of our original label distribution, but the algorithm gets to change its confidence of the distribution within 20 percent. :class:`LabelPropagation` uses the raw similarity matrix constructed from the data with no modifications. In contrast, :class:`LabelSpreading` minimizes a loss function that has regularization properties, as such it is often more robust to noise. The algorithm iterates on a modified version of the original graph and normalizes the edge weights by computing the normalized graph Laplacian matrix. This procedure is also used in :ref:`spectral_clustering`. Label propagation models have two built-in kernel methods. Choice of kernel affects both scalability and performance of the algorithms. The following are available: * rbf (:math:`\exp(-\gamma |x-y|^2), \gamma > 0`). :math:`\gamma` is specified by keyword gamma. * knn (:math:`1[x' \in kNN(x)]`). :math:`k` is specified by keyword n_neighbors. The RBF kernel will produce a fully connected graph which is represented in memory by a dense matrix. This matrix may be very large and combined with the cost of performing a full matrix multiplication calculation for each iteration of the algorithm can lead to prohibitively long running times. On the other hand, the KNN kernel will produce a much more memory-friendly sparse matrix which can drastically reduce running times. .. rubric:: Examples * :ref:`sphx_glr_auto_examples_semi_supervised_plot_semi_supervised_versus_svm_iris.py` * :ref:`sphx_glr_auto_examples_semi_supervised_plot_label_propagation_structure.py` * :ref:`sphx_glr_auto_examples_semi_supervised_plot_label_propagation_digits.py` * :ref:`sphx_glr_auto_examples_semi_supervised_plot_label_propagation_digits_active_learning.py` .. rubric:: References [2] Yoshua Bengio, Olivier Delalleau, Nicolas Le Roux. In Semi-Supervised Learning (2006), pp. 193-216 [3] Olivier Delalleau, Yoshua Bengio, Nicolas Le Roux. Efficient Non-Parametric Function Induction in Semi-Supervised Learning. AISTAT 2005 https://www.gatsby.ucl.ac.uk/aistats/fullpapers/204.pdf