
Rule induction is an area of
machine learning in which formal rules are extracted from a set of observations. The rules extracted may represent a full
scientific model of the data, or merely represent local
patterns in the data.
Data mining in general and rule induction in detail are trying to create algorithms without human programming but with analyzing existing data structures.
In the easiest case, a rule is expressed with “if-then statements” and was created with the
ID3 algorithm
In decision tree learning, ID3 (Iterative Dichotomiser 3) is an algorithm invented by Ross QuinlanQuinlan, J. R. 1986. Induction of Decision Trees. Mach. Learn. 1, 1 (Mar. 1986), 81–106 used to generate a decision tree from a dataset. ID3 is the ...
for decision tree learning.
Rule learning algorithm are taking training data as input and creating rules by partitioning the table with
cluster analysis
Cluster analysis or clustering is the task of grouping a set of objects in such a way that objects in the same group (called a cluster) are more similar (in some sense) to each other than to those in other groups (clusters). It is a main task of ...
.
A possible alternative over the ID3 algorithm is genetic programming which evolves a program until it fits to the data.
Creating different algorithm and testing them with input data can be realized in the WEKA software.
Additional tools are machine learning libraries for
Python, like
scikit-learn.
Paradigms
Some major rule induction paradigms are:
*
Association rule learning algorithms (e.g., Agrawal)
*
Decision rule algorithms (e.g., Quinlan 1987)
*
Hypothesis testing algorithms (e.g., RULEX)
*
Horn clause induction
*
Version spaces
*
Rough set
In computer science, a rough set, first described by Polish computer scientist Zdzisław I. Pawlak, is a formal approximation of a crisp set (i.e., conventional set) in terms of a pair of sets which give the ''lower'' and the ''upper'' approximati ...
rules
*
Inductive Logic Programming
*Boolean decomposition (Feldman)
Algorithms
Some rule induction algorithms are:
*Charade
[Sahami, Mehran.]
Learning classification rules using lattices
" Machine learning: ECML-95 (1995): 343-346.
*Rulex
*
Progol
*
CN2
References
*
Machine learning
Inductive reasoning
{{Comp-sci-stub