6533b7dafe1ef96bd126d851
RESEARCH PRODUCT
Learning by the Process of Elimination
Rolf WiehagenCarl SmithRūsinš FreivaldsMarek Karpinskisubject
Computer Science::Machine LearningProcess of eliminationGeneralization0102 computer and information sciences02 engineering and technology01 natural sciencesNumberingComputer Science ApplicationsTheoretical Computer ScienceDecidabilityAlgebraComputational Theory and Mathematics010201 computation theory & mathematicsPhysics::Plasma Physics0202 electrical engineering electronic engineering information engineeringRecursive functions020201 artificial intelligence & image processingEquivalence (formal languages)Information SystemsMathematicsdescription
AbstractElimination of potential hypotheses is a fundamental component of many learning processes. In order to understand the nature of elimination, herein we study the following model of learning recursive functions from examples. On any target function, the learning machine has to eliminate all, save one, possible hypotheses such that the missing one correctly describes the target function. It turns out that this type of learning by the process of elimination (elm-learning, for short) can be stronger, weaker or of the same power as usual Gold style learning.While for usual learning any r.e. class of recursive functions can be learned in all of its numberings, this is no longer true for elm-learning. For elm-learnability of an r.e. class in a given of its numberings, we derive sufficient conditions of this numbering (decidability of index equivalence and paddability) as well as a condition being both necessary and sufficient. Then we deal with the problem of which r.e. classes are elm-learnable in all of their numberings and which are not.Elm-learning of arbitrary classes of recursive function is shown to be of the same power as usual learning. For elm-learnability of an arbitrary class in an arbitrary numbering, paddability of this numbering remains to be useful, whereas decidability of index equivalence can be “maximally weak” or “extremely useful”. We also give a characterization for elm-learnability of an arbitrary class of recursive functions.Finally, we consider some generalizations of elm-learning. One of them is of the same power as usual learning by teams. A further generalization even allows to learn the class of all recursive functions.
year | journal | country | edition | language |
---|---|---|---|---|
2002-07-01 | Information and Computation |