Using Weka from Java
The power of weka data manipulation can also be exploited directly from Java code This enables the development of data mining applications (for decision support systems) without writing any machine learning code yourself Weka is completely written in Java and it comes with its documentation (javadoc style) Basis classes are: Attribute, Instance, Instances and Classier
Gianluca Moro - DEIS, University of Bologna
27
27
Attribute class
This is the class for handling attributes It is contained on the weka.io package Four types of Attribute are supported: - Numeric - Nominal (a xed set of values) - String - Date A Numeric attribute denition example: A Nominal attribute denition example:
Attribute temperatura = new Attribute("Temperatura"); FastVector tempoValues = new FastVector(3); tempoValues.addElement("sole"); tempoValues.addElement("coperto"); tempoValues.addElement("pioggia"); Attribute tempo = new Attribute("Tempo", tempoValues);
Gianluca Moro - DEIS, University of Bologna
28
28
Instance class
This is the class for handling a single instance It is contained on the weka.io package Creating an instance example:
// Create empty instance with three attribute values Instance inst = new Instance(3); // Set instance's values for the attributes "temperatura" and "tempo" inst.setValue(temperatura, 25); inst.setValue(tempo, "coperto"); // Set instance's dataset to be the dataset "weather" inst.setDataset(weather);
Gianluca Moro - DEIS, University of Bologna
29
29
Instances class
This is the class for handling set of instances It is contained on the weka.io package Could be directly created from an ARFF le:
FileReader reader = new FileReader(myDataset.arff); Instances set = new Instances(reader);
To add a new instances to the set just use:
set.add(inst);
To set the class attribute just use:
//Suppose that the class attribute is the last int classAttributeIndex = set.numAttributes()-1; set.setClassIndex(classAttributeIndex);
Gianluca Moro - DEIS, University of Bologna
30
30
Classier class
Just an abstract class implemented by specic algorithms It is contained in weka.classiers package It is the nal model of the system To build a model from a set of instances:
//For example using a J48-tree algorithm Classifier myClassifier = new J48(); myClassifier.buildClassifier(set);
To classify an instance just:
//For example using a J48-tree algorithm Classifier myClassifier = new J48(); double class = myClassifier.classifyInstance(inst);
Gianluca Moro - DEIS, University of Bologna
31
31
Save and load a model
Classier class is serializable so it is very simple to save and load a model. To save a created model in a le:
m_Classifier.buildClassifier(datas); ObjectOutputStream oos = new ObjectOutputStream( new FileOutputStream(modelFile)); oos.writeObject(classifier); oos.flush(); oos.close();
To load a model from a le:
ObjectInputStream fileIO = new ObjectInputStream(new FileInputStream(modelName)); Classifier model = (Classifier) fileIO.readObject(); fileIO.close();
Gianluca Moro - DEIS, University of Bologna
32
Remember to cast
32
The weather classier ... again
This simple example shows how to use weka from Java code. It is just the weather classier seen in the rst part. We will do basically the same things but from our code, without using weka GUI: 1. Just import some package from weka
import weka.core.*; import weka.classifiers.Classifier; import weka.classifiers.trees.J48;
Gianluca Moro - DEIS, University of Bologna
33
33
2. The constructor: build the data structure (declare the attributes)
! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! public Weather() throws Exception { ! String nameOfDataset = "WeatherSet"; ! /* Attribute's vector: ! * @attribute Tempo {sole, coperto, pioggia} ! * @attribute Temperatura real ! * @attribute Umidita real ! * @attribute Vento {true, false} ! * @attribute Gioca {yes, no} ! */ ! FastVector attributes = new FastVector(5); ! //Tempo ! FastVector tempoValues = new FastVector(3); ! tempoValues.addElement("sole"); ! tempoValues.addElement("coperto"); ! tempoValues.addElement("pioggia"); ! //Vento ! FastVector ventoValues = new FastVector(2); ! ventoValues.addElement("true");ventoValues.addElement("false"); ! //Gioca ! FastVector giocaValues = new FastVector(2); ! giocaValues.addElement("si");giocaValues.addElement("no"); ! ! attributes.addElement(new Attribute("Tempo", tempoValues)); ! attributes.addElement(new Attribute("Temperatura")); ! attributes.addElement(new Attribute("Umidita'")); ! attributes.addElement(new Attribute("Vento", ventoValues)); ! attributes.addElement(new Attribute("Gioca", giocaValues)); ! // Create a new dataset ! m_Data = new Instances(nameOfDataset, attributes, 100); ! // Set the last attribute as class ! m_Data.setClassIndex(m_Data.numAttributes() - 1); }
Gianluca Moro - DEIS, University of Bologna
34
34
3. Classify a message
public String classifyMessage(String message) throws Exception { ! ! // Check whether a classifier has been built. ! ! //if (m_Data.numInstances() == 0) { ! ! //! throw new Exception("No classifier available."); ! ! //} ! ! // Make separate little test set so that message ! ! // does not get added to string attribute in m_Data. ! ! Instances testset = m_Data.stringFreeStructure(); ! ! // Make message into test instance. ! ! Instance instance = makeInstance(message, testset); ! ! // Get index of predicted class value. ! ! double predicted = m_Classifier.classifyInstance(instance); ! ! // Output class value: value(..) Returns an instance's attribute value in internal format ! ! /* Class for handling an instance. All values (numeric, nominal, or string) are internally stored as floating-point numbers. If an attribute is nominal (or a string), the stored value is the index of the corresponding nominal (or string) value in the attribute's definition. We have chosen this approach in favor of a more elegant object-oriented approach because it is much faster. */ String msg ="Weather classified as: " ! ! + m_Data.classAttribute().value((int) predicted); return msg;
! ! !
! ! }
Gianluca Moro - DEIS, University of Bologna
35
35
Gianluca Moro - DEIS, University of Bologna
/** * Programma per classificare una giornata: a seconda delle caratteristiche meteorologichche * il sistema deve scegliere se giocare oppure no * * @author gm * */ import java.io.*; import weka.core.*; import weka.classifiers.Classifier; import weka.classifiers.trees.J48; public class Weather implements Serializable { ! // Training set ! private Instances m_Data = null; ! // Classificatore scelto ! private Classifier m_Classifier = new J48(); ! /** ! * Costruttore: crea un nuovo dataset di training inizialmente vuoto ! * ! * @throws Exception ! */ ! public Weather() throws Exception { ! ! String nameOfDataset = "WeatherSet"; ! ! ! ! /* Attribute's vector: ! ! * @attribute Tempo {sole, coperto, pioggia} ! ! * @attribute Temperatura real ! ! * @attribute Umidit real ! ! * @attribute Vento {true, false} ! ! * @attribute Gioca {yes, no} ! ! */ ! ! FastVector attributes = new FastVector(5); ! ! ! ! //Tempo ! ! FastVector tempoValues = new FastVector(3); ! ! tempoValues.addElement("sole"); ! ! tempoValues.addElement("coperto"); ! ! tempoValues.addElement("pioggia"); ! ! ! ! //Vento ! ! FastVector ventoValues = new FastVector(2); ! ! ventoValues.addElement("true"); ! ! ventoValues.addElement("false");
The entire code
36
36
! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! !
! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! }
//Gioca FastVector giocaValues = new FastVector(2); giocaValues.addElement("si"); giocaValues.addElement("no");
attributes.addElement(new attributes.addElement(new attributes.addElement(new attributes.addElement(new attributes.addElement(new
Attribute("Tempo", tempoValues)); Attribute("Temperatura")); Attribute("Umidita'")); Attribute("Vento", ventoValues)); Attribute("Gioca", giocaValues));
// Create a new dataset m_Data = new Instances(nameOfDataset, attributes, 100); // Set the last attribute as class m_Data.setClassIndex(m_Data.numAttributes() - 1);
! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! !
/** * Metodo che configura il classificatore a partire dal nome del file che lo contiene * * @param modelName Nome del file che contiene il modello */ public void setClassifier(String modelName){ ! try { ! ! Classifier model; ! ! //Load the model ! ! ! ObjectInputStream modelInObjectFile = new ObjectInputStream( ! ! ! ! ! new FileInputStream(modelName)); ! ! ! model = (Classifier) modelInObjectFile.readObject(); ! ! ! modelInObjectFile.close(); ! ! ! ! ! this.m_Classifier = model; ! ! System.out.println("Model "+modelName+" lodaded.");! ! } catch (Exception e) { ! ! // TODO Auto-generated catch block ! ! e.printStackTrace(); ! } ! }
Gianluca Moro - DEIS, University of Bologna
37
37
! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! !
Gianluca Moro - DEIS, University of Bologna
/** * Metodo che converte una stringa in una istanza (record) * * @param data La stringa nel formato Tempo,Temperatura,Umidita',Vento, [Gioca] * @param dataSet Il dataset a cui verr aggiunta * @return L'istanza creata */ private Instance makeInstance(String data, Instances dataSet) { ! Instance instance = new Instance(5); ! String[] values = data.split(","); ! Attribute tempo = dataSet.attribute("Tempo"); ! Attribute temperatura = dataSet.attribute("Temperatura"); ! Attribute umidita = dataSet.attribute("Umidita'"); ! Attribute vento = dataSet.attribute("Vento"); ! Attribute gioca = dataSet.attribute("Gioca"); ! instance.setValue(tempo, values[0]); ! instance.setValue(temperatura, Integer.parseInt(values[1])); ! instance.setValue(umidita,Integer.parseInt(values[2])); ! instance.setValue(vento, values[3]); ! if(values.length > 4){ ! ! instance.setValue(gioca, values[4]); ! } ! // Give instance access to attribute information from the dataset. ! instance.setDataset(dataSet); ! return instance; } /** * Classifica un messaggio passato in ingresso * * @return Una rappresentazione testuale della classe del messaggio */ public String classifyMessage(String message) throws Exception { ! // Check whether classifier has been built. ! if (m_Data.numInstances() == 0) { ! ! throw new Exception("No classifier available."); ! } ! // Make separate little test set so that message ! // does not get added to string attribute in m_Data. ! Instances testset = m_Data.stringFreeStructure(); ! // Make message into test instance. ! Instance instance = makeInstance(message, testset); ! // Get index of predicted class value. ! double predicted = m_Classifier.classifyInstance(instance); ! // Output class value. ! String msg ="Weather classified as: " ! ! ! + m_Data.classAttribute().value((int) predicted); ! return msg; }
38
38
Gianluca Moro - DEIS, University of Bologna
! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! }
/** * Main method. * * @option -m Model file's name * @option -classify Classifies an istance with model provided * @option -create Create a model from an arff data file, and output it in a model file */ public static void main(String[] options) { ! try { ! ! Classifier tree; ! ! if(options.length != 2){ ! ! ! String modelFile = Utils.getOption("m", options); ! ! ! String dataFile = Utils.getOption("create", options); ! ! ! if(dataFile.length() != 0){ ! ! ! ! // Load data from file ! ! ! ! Instances datas = new Instances(new BufferedReader(new FileReader(dataFile))); ! ! ! ! datas.setClassIndex(datas.numAttributes() - 1); ! ! ! ! //Build classifier ! ! ! ! tree = new J48(); ! ! ! ! tree.buildClassifier(datas); ! ! ! ! try { ! ! ! ! ! // serialize model ! ! ! ! ! ObjectOutputStream oos = new ObjectOutputStream(new FileOutputStream(modelFile)); ! ! ! ! ! oos.writeObject(tree); ! ! ! ! ! oos.flush();oos.close(); ! ! ! ! ! System.out.println("Model saved on: "+modelFile); ! ! ! ! } catch (Exception e) { ! ! ! ! ! // TODO Auto-generated catch block ! ! ! ! ! e.printStackTrace(); ! ! ! ! } ! ! ! }else{ ! ! ! ! Weather w = new Weather(); ! ! ! ! w.setClassifier(modelFile); ! ! ! ! String unclassified = Utils.getOption("classify", options); ! ! ! ! if(unclassified.length() != 0){ ! ! ! ! ! //Classify the provided instance! ! ! ! ! ! ! ! ! ! ! ! System.out.println(w.classifyMessage(unclassified)); ! ! ! ! }! ! ! ! ! }! ! ! }else{ ! ! ! System.out.println("Parametri non corretti"); ! ! }//else! ! ! } catch (Exception e) { ! ! // TODO Auto-generated catch block ! ! e.printStackTrace(); ! } }
39
39
How to use the program
! To create a new model from a le just launch with -m and -create options:
java Weather.class -m myModel.model -create Weather.arff
Gianluca Moro - DEIS, University of Bologna
40
40
! To classify a message just launch with -m and -classify options:
java Weather.class -m myModel.model -classify coperto,83,86,false
Gianluca Moro - DEIS, University of Bologna
41
41
