n Machine Learning with WEKA n WEKA A
- Slides: 173
n Machine Learning with WEKA n WEKA: A Machine Learning Toolkit The Explorer • • Eibe Frank • • Department of Computer Science, University of Waikato, New Zealand • n n n Classification and Regression Clustering Association Rules Attribute Selection Data Visualization The Experimenter The Knowledge Flow GUI Conclusions
WEKA: the bird Copyright: Martin Kramer (mkramer@wxs. nl) 11/3/2020 University of Waikato 2
WEKA: the software n n Machine learning/data mining software written in Java (distributed under the GNU Public License) Used for research, education, and applications Complements “Data Mining” by Witten & Frank Main features: Comprehensive set of data pre-processing tools, learning algorithms and evaluation methods u Graphical user interfaces (incl. data visualization) u Environment for comparing learning algorithms u 11/3/2020 University of Waikato 3
WEKA: versions n There are several versions of WEKA: WEKA 3. 0: “book version” compatible with description in data mining book u WEKA 3. 2: “GUI version” adds graphical user interfaces (book version is command-line only) u WEKA 3. 3: “development version” with lots of improvements u n This talk is based on the latest snapshot of WEKA 3. 3 (soon to be WEKA 3. 4) 11/3/2020 University of Waikato 4
WEKA only deals with “flat” files @relation heart-disease-simplified @attribute age numeric @attribute sex { female, male} @attribute chest_pain_type { typ_angina, asympt, non_anginal, atyp_angina} @attribute cholesterol numeric @attribute exercise_induced_angina { no, yes} @attribute class { present, not_present} @data 63, male, typ_angina, 233, not_present 67, male, asympt, 286, yes, present 67, male, asympt, 229, yes, present 38, female, non_anginal, ? , not_present. . . 11/3/2020 University of Waikato 5
WEKA only deals with “flat” files @relation heart-disease-simplified @attribute age numeric @attribute sex { female, male} @attribute chest_pain_type { typ_angina, asympt, non_anginal, atyp_angina} @attribute cholesterol numeric @attribute exercise_induced_angina { no, yes} @attribute class { present, not_present} @data 63, male, typ_angina, 233, not_present 67, male, asympt, 286, yes, present 67, male, asympt, 229, yes, present 38, female, non_anginal, ? , not_present. . . 11/3/2020 University of Waikato 6
11/3/2020 University of Waikato 7
11/3/2020 University of Waikato 8
11/3/2020 University of Waikato 9
Explorer: pre-processing the data n n Data can be imported from a file in various formats: ARFF, CSV, C 4. 5, binary Data can also be read from a URL or from an SQL database (using JDBC) Pre-processing tools in WEKA are called “filters” WEKA contains filters for: u 11/3/2020 Discretization, normalization, resampling, attribute selection, transforming and combining attributes, … University of Waikato 10
11/3/2020 University of Waikato 11
11/3/2020 University of Waikato 12
11/3/2020 University of Waikato 13
11/3/2020 University of Waikato 14
11/3/2020 University of Waikato 15
11/3/2020 University of Waikato 16
11/3/2020 University of Waikato 17
11/3/2020 University of Waikato 18
11/3/2020 University of Waikato 19
11/3/2020 University of Waikato 20
11/3/2020 University of Waikato 21
11/3/2020 University of Waikato 22
11/3/2020 University of Waikato 23
11/3/2020 University of Waikato 24
11/3/2020 University of Waikato 25
11/3/2020 University of Waikato 26
11/3/2020 University of Waikato 27
11/3/2020 University of Waikato 28
11/3/2020 University of Waikato 29
11/3/2020 University of Waikato 30
11/3/2020 University of Waikato 31
Explorer: building “classifiers” n n Classifiers in WEKA are models for predicting nominal or numeric quantities Implemented learning schemes include: u n Decision trees and lists, instance-based classifiers, support vector machines, multi-layer perceptrons, logistic regression, Bayes’ nets, … “Meta”-classifiers include: u 11/3/2020 Bagging, boosting, stacking, error-correcting output codes, locally weighted learning, … University of Waikato 32
11/3/2020 University of Waikato 33
11/3/2020 University of Waikato 34
11/3/2020 University of Waikato 35
11/3/2020 University of Waikato 36
11/3/2020 University of Waikato 37
11/3/2020 University of Waikato 38
11/3/2020 University of Waikato 39
11/3/2020 University of Waikato 40
11/3/2020 University of Waikato 41
11/3/2020 University of Waikato 42
11/3/2020 University of Waikato 43
11/3/2020 University of Waikato 44
11/3/2020 University of Waikato 45
11/3/2020 University of Waikato 46
11/3/2020 University of Waikato 47
11/3/2020 University of Waikato 48
11/3/2020 University of Waikato 49
11/3/2020 University of Waikato 50
11/3/2020 University of Waikato 51
11/3/2020 University of Waikato 52
11/3/2020 University of Waikato 53
11/3/2020 University of Waikato 54
11/3/2020 University of Waikato 55
11/3/2020 University of Waikato 56
11/3/2020 University of Waikato 57
11/3/2020 University of Waikato 58
11/3/2020 University of Waikato 59
11/3/2020 University of Waikato 60
11/3/2020 University of Waikato 61
11/3/2020 University of Waikato 62
11/3/2020 University of Waikato 63
11/3/2020 University of Waikato 64
11/3/2020 University of Waikato 65
11/3/2020 University of Waikato 66
11/3/2020 University of Waikato 67
11/3/2020 University of Waikato 68
11/3/2020 University of Waikato 69
11/3/2020 University of Waikato 70
11/3/2020 University of Waikato 71
11/3/2020 University of Waikato 72
11/3/2020 University of Waikato 73
11/3/2020 University of Waikato 74
11/3/2020 University of Waikato 75
11/3/2020 University of Waikato 76
11/3/2020 University of Waikato 77
11/3/2020 University of Waikato 78
11/3/2020 University of Waikato 79
11/3/2020 University of Waikato 80
11/3/2020 University of Waikato 81
11/3/2020 University of Waikato 82
11/3/2020 University of Waikato 83
11/3/2020 University of Waikato 84
11/3/2020 University of Waikato 85
11/3/2020 University of Waikato 86
11/3/2020 University of Waikato 87
11/3/2020 University of Waikato 88
11/3/2020 University of Waikato 89
11/3/2020 University of Waikato 90
11/3/2020 University of Waikato 91
Explorer: clustering data n n WEKA contains “clusterers” for finding groups of similar instances in a dataset Implemented schemes are: u n n k-Means, EM, Cobweb, X-means, Farthest. First Clusters can be visualized and compared to “true” clusters (if given) Evaluation based on loglikelihood if clustering scheme produces a probability distribution 11/3/2020 University of Waikato 92
11/3/2020 University of Waikato 93
11/3/2020 University of Waikato 94
11/3/2020 University of Waikato 95
11/3/2020 University of Waikato 96
11/3/2020 University of Waikato 97
11/3/2020 University of Waikato 98
11/3/2020 University of Waikato 99
11/3/2020 University of Waikato 100
11/3/2020 University of Waikato 101
11/3/2020 University of Waikato 102
11/3/2020 University of Waikato 103
11/3/2020 University of Waikato 104
11/3/2020 University of Waikato 105
11/3/2020 University of Waikato 106
11/3/2020 University of Waikato 107
Explorer: finding associations n WEKA contains an implementation of the Apriori algorithm for learning association rules u n Can identify statistical dependencies between groups of attributes: u n Works only with discrete data milk, butter bread, eggs (with confidence 0. 9 and support 2000) Apriori can compute all rules that have a given minimum support and exceed a given confidence 11/3/2020 University of Waikato 108
11/3/2020 University of Waikato 109
11/3/2020 University of Waikato 110
11/3/2020 University of Waikato 111
11/3/2020 University of Waikato 112
11/3/2020 University of Waikato 113
11/3/2020 University of Waikato 114
11/3/2020 University of Waikato 115
Explorer: attribute selection n n Panel that can be used to investigate which (subsets of) attributes are the most predictive ones Attribute selection methods contain two parts: A search method: best-first, forward selection, random, exhaustive, genetic algorithm, ranking u An evaluation method: correlation-based, wrapper, information gain, chi-squared, … u n Very flexible: WEKA allows (almost) arbitrary combinations of these two 11/3/2020 University of Waikato 116
11/3/2020 University of Waikato 117
11/3/2020 University of Waikato 118
11/3/2020 University of Waikato 119
11/3/2020 University of Waikato 120
11/3/2020 University of Waikato 121
11/3/2020 University of Waikato 122
11/3/2020 University of Waikato 123
11/3/2020 University of Waikato 124
Explorer: data visualization n n Visualization very useful in practice: e. g. helps to determine difficulty of the learning problem WEKA can visualize single attributes (1 -d) and pairs of attributes (2 -d) u n n n To do: rotating 3 -d visualizations (Xgobi-style) Color-coded class values “Jitter” option to deal with nominal attributes (and to detect “hidden” data points) “Zoom-in” function 11/3/2020 University of Waikato 125
11/3/2020 University of Waikato 126
11/3/2020 University of Waikato 127
11/3/2020 University of Waikato 128
11/3/2020 University of Waikato 129
11/3/2020 University of Waikato 130
11/3/2020 University of Waikato 131
11/3/2020 University of Waikato 132
11/3/2020 University of Waikato 133
11/3/2020 University of Waikato 134
11/3/2020 University of Waikato 135
11/3/2020 University of Waikato 136
11/3/2020 University of Waikato 137
Performing experiments n n n Experimenter makes it easy to compare the performance of different learning schemes For classification and regression problems Results can be written into file or database Evaluation options: cross-validation, learning curve, hold-out Can also iterate over different parameter settings Significance-testing built in! 11/3/2020 University of Waikato 138
11/3/2020 University of Waikato 139
11/3/2020 University of Waikato 140
11/3/2020 University of Waikato 141
11/3/2020 University of Waikato 142
11/3/2020 University of Waikato 143
11/3/2020 University of Waikato 144
11/3/2020 University of Waikato 145
11/3/2020 University of Waikato 146
11/3/2020 University of Waikato 147
11/3/2020 University of Waikato 148
11/3/2020 University of Waikato 149
11/3/2020 University of Waikato 150
11/3/2020 University of Waikato 151
The Knowledge Flow GUI n n n New graphical user interface for WEKA Java-Beans-based interface for setting up and running machine learning experiments Data sources, classifiers, etc. are beans and can be connected graphically Data “flows” through components: e. g. , “data source” -> “filter” -> “classifier” -> “evaluator” Layouts can be saved and loaded again later 11/3/2020 University of Waikato 152
11/3/2020 University of Waikato 153
11/3/2020 University of Waikato 154
11/3/2020 University of Waikato 155
11/3/2020 University of Waikato 156
11/3/2020 University of Waikato 157
11/3/2020 University of Waikato 158
11/3/2020 University of Waikato 159
11/3/2020 University of Waikato 160
11/3/2020 University of Waikato 161
11/3/2020 University of Waikato 162
11/3/2020 University of Waikato 163
11/3/2020 University of Waikato 164
11/3/2020 University of Waikato 165
11/3/2020 University of Waikato 166
11/3/2020 University of Waikato 167
11/3/2020 University of Waikato 168
11/3/2020 University of Waikato 169
11/3/2020 University of Waikato 170
11/3/2020 University of Waikato 171
11/3/2020 University of Waikato 172
Conclusion: try it yourself! n § § WEKA is available at http: //www. cs. waikato. ac. nz/ml/weka Also has a list of projects based on WEKA contributors: Abdelaziz Mahoui, Alexander K. Seewald, Ashraf M. Kibriya, Bernhard Pfahringer , Brent Martin, Peter Flach, Eibe Frank , Gabi Schmidberger , Ian H. Witten , J. Lindgren, Janice Boughton, Jason Wells, Len Trigg, Lucio de Souza Coelho, Malcolm Ware, Mark Hall , Remco Bouckaert , Richard Kirkby, Shane Butler, Shane Legg, Stuart Inglis, Sylvain Roy, Tony Voyle, Xin Xu, Yong Wang, Zhihai Wang 11/3/2020 University of Waikato 173
- Weka machine learning toolkit
- Sugato basu
- Weka machine learning toolkit
- Concept learning task in machine learning
- Analytical learning in machine learning
- Pac learning model in machine learning
- Machine learning t mitchell
- Inductive vs analytical learning
- Inductive and analytical learning in machine learning
- Instance based learning in machine learning
- Inductive learning machine learning
- First order rule learning in machine learning
- Eager learner and lazy learner
- Cmu machine learning
- Cuadro comparativo entre e-learning b-learning y m-learning
- Yapay zeka ve veri madenciliği
- Weka hadoop
- Weka mac
- Percentage split weka
- Weka visualization
- Weka pentaho
- Weka svm
- Weka mooc
- Weka mlp
- Weka nlp
- Weka nlp
- Weka dbscan
- Weka introduction
- Visual level indicator
- Weka knowledge flow
- Aushang brandschutzhelfer vorlage
- Weka bayesian network
- J48 weka
- Weka waikato
- Weka feature selection
- Finite state machine vending machine example
- Mealy moore
- Mealy to moore conversion
- Ma=fr/fe
- The non-iid data quagmire of decentralized machine learning
- Regularized risk minimization
- Sql server machine learning
- Azure machine learning studio
- Octave machine learning
- Jmp neural network
- Machine learning definition tom mitchell
- Machine learning infrastructure monitoring
- Valerie du preez
- Zillow api python
- Tom mitchell machine learning solutions chapter 3
- Introduction to machine learning ethem alpaydin
- Hypothesis space in machine learning
- Machine learning kth
- Machine learning andrew ng
- Andrew ng intro machine learning
- Hypothesis space in machine learning
- Ilp machine learning
- Qradar uba
- Xkcd image recognition
- Demographic parity
- What is model stacking
- Machine learning econometrics
- Feature reduction in machine learning
- What is tensor in machine learning
- Njit machine learning
- Synapse vs databricks
- Hypothesis space in machine learning
- Convex optimization in machine learning javatpoint
- Explain general to specific ordering of hypothesis
- Upenn cis 519
- Aws lambda machine learning
- High bias low variance introduction to machine learning
- Wsbgixdc9g8 -site:youtube.com
- Cisco machine learning security
- Conclusion of machine learning
- Advice for applying machine learning
- 5 tribes of machine learning
- Revenue prediction machine learning
- Coarse coding reinforcement learning
- Axis aligned rectangles vc dimension
- Multivariate methods in machine learning
- Designing machine learning systems
- Gerard schuster
- Machine learning vs traditional programming
- Feature creation machine learning
- Unbiased learner in machine learning
- Cost funtion
- Machine learning ethem
- Introduction to machine learning slides
- Ethem alpaydin
- Unbiased learner in machine learning
- Sequential covering algorithm example
- Introduction to machine learning andrew ng
- Machine learning and data mining
- Hbr machine learning
- Rnts machine learning
- K ramachandra murthy
- A priori algorithm
- Comp 6321 concordia
- Vc dimension in machine learning
- Machine learning
- Machine learning landscape
- Azure machine learning workbench
- Sigmoid function octave
- Machine learning
- Debt collection machine learning
- Cmu machine learning course
- Exploiting machine learning to subvert your spam filter
- Hima lakkaraju
- Biostatistics machine learning
- Conditional independence machine learning
- Databricks auto ml
- Athena artificial intelligence
- Pseudolabeling
- Bert kappen
- Nervana11
- Rage against the machine learning
- Practical machine learning quiz 4
- Tensor flow playground
- History of machine learning
- Stock selection machine learning
- Product classification machine learning
- Linear regression multiple features
- Machine learning lecture notes
- Machine learning lecture notes
- Introduction to machine learning slides
- Azure data mining
- K nearest neighbors python
- Lstm lecture
- Occam rasor
- Aic machine learning
- Machine learning
- Geometric models in machine learning
- Machine learning
- Astronomy active learning
- Inversion attacks
- Machine learning sdn
- Performance measures for machine learning
- Tensor playground
- Spectral clustering
- Training data in machine learning with example
- Machine learning in infrastructure monitoring
- Octave vs r for machine learning
- Machine learning social network analysis
- Confidential machine learning
- Trade promotion machine learning
- Classification machine learning
- Reasoning machine learning
- Prediction of nba games based on machine learning methods
- Stealing machine learning models via prediction apis
- Titanic machine learning from disaster
- Machine learning algoritmi
- Machine learning algoritmi
- Binghui wang
- Machine learning senior project ideas
- Parameter server for distributed machine learning
- How to make money using machine learning
- Practical machine learning quiz 2
- Isb machine learning
- Machine learnin
- Linear regression with multiple variables machine learning
- Lda machine learning python
- Introduction to machine learning ethem alpaydin
- Machine learning ethem alpaydin
- Ethem alpaydin
- Machine learning kth
- Bby learning network
- Cm bishop pattern recognition and machine learning
- 10-601 machine learning
- Supervised learning dan unsupervised learning
- Nonassociative learning definition
- Deductive learning vs inductive learning
- Apprenticeship learning via inverse reinforcement learning
- Apprenticeship learning via inverse reinforcement learning