Scribd Logo
Upload

Welcome to Scribd!

  • 458 views

    Regression, Classification and Clustering

    Uploaded by

    Mahrukh Fida
    This document discusses several data mining techniques including regression, classification, and clustering. It provides definitions and examples for each technique. Regression involves predicting numeric values and finding relationships between variables. Classification predicts class membership for predefined classes. Clustering groups similar data points without predefined classes. The document outlines basic steps for each technique such as feature selection, similarity measures, algorithms, and result validation.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PPTX, PDF, TXT or read online from Scribd

    Regression, Classification and Clustering

    Uploaded by

    Mahrukh Fida
    458 views23 pages
    This document discusses several data mining techniques including regression, classification, and clustering. It provides definitions and examples for each technique. Regression involves predicting numeric values and finding relationships between variables. Classification predicts class membership for predefined classes. Clustering groups similar data points without predefined classes. The document outlines basic steps for each technique such as feature selection, similarity measures, algorithms, and result validation.

    Original Description:

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    PPTX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This document discusses several data mining techniques including regression, classification, and clustering. It provides definitions and examples for each technique. Regression involves predicting numeric values and finding relationships between variables. Classification predicts class membership for predefined classes. Clustering groups similar data points without predefined classes. The document outlines basic steps for each technique such as feature selection, similarity measures, algorithms, and result validation.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PPTX, PDF, TXT or read online from Scribd
    Download as pptx, pdf, or txt
    458 views23 pages

    Regression, Classification and Clustering

    Uploaded by

    Mahrukh Fida
    This document discusses several data mining techniques including regression, classification, and clustering. It provides definitions and examples for each technique. Regression involves predicting numeric values and finding relationships between variables. Classification predicts class membership for predefined classes. Clustering groups similar data points without predefined classes. The document outlines basic steps for each technique such as feature selection, similarity measures, algorithms, and result validation.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PPTX, PDF, TXT or read online from Scribd
    Download as pptx, pdf, or txt
    of 23

    Mah-Rukh Fida June 2012

    Topics to be discussed
    DATA MINING
    REGRESSION CLASSIFICATION

    CLUSTERING

    DATA MINING

    Definition
    Definition : Exploring hidden information
    Models of data mining

    Two categories of data mining models


    Prediction Model

    Makes prediction using known results found from different data objects.

    Descriptive Model

    Identifies patterns or relationships in data. Explores properties of the data examined Does not predict new properties.

    REGRESSION

    Definition
    Numeric prediction of the value of dependent variable.
    Relationship

    between dependent and independent variable(s) are expressible through mathematical equation.

    Types of regression

    Types of Regression
    Linear regression y=c+mx, where c and m are regression coefficients. Multi-Linear regression y=c0+c1x1+c2x2++cnxn where c0,c1,cn are regression coefficients and x1, x2,,xn are independent variables.

    Basic Steps of Prediction


    m= (270,000-180,000) / (33,000-17,000) = 90/16 =5.6 Now y = 100,000 + 5.6 x, put x=30,000, then y=100,000+ (5.6) (30,000) =268,000

    Regression Continued
    Regression model is selected when Prediction of a continuous or numerical value is needed The relationship of predictor and response can be expressed in the form of a curve or a mathematical equation Regression is not suitable when Data may not fit in linear model Linear data may be poor due to noise or outliers. Data is non-numeric

    CLASSIFICATION

    Definition
    Predicts class membership of data instances Classes are non-overlapping

    Classes are already defined

    Basic Steps for Prediction


    Model Construction Model Usage Example :

    Height based Output follows the below given division criteria: 2m Height 1.7m < Height < 2m Height 1.7m Classify :<Pat, F, 1.6> using KNN with K=5. Tall Medium Short

    - {<Kristina, F, 1.6>, <Kathy, F, 1.6>, < Stephanie, F, 1.7>, <Dave, M, 1.7>, <Wynette, F, 1.75>}. - Pat is Short.

    Validation Criteria

    Validation Criteria

    CLUSTERING

    Definition
    Grouping of like terms
    Groups are not predefined

    Four Clusters

    Clustering Algorithms

    Four Basic Steps in Clustering Feature Selection

    E.g. We have to make groups of students in a class, let the grouping is done on the basis of intelligence level of students

    Similarity Measure
    The intelligence level of students can be found by

    taking a quiz. Marks obtained by students in the quiz are as follows Marks obtained by nine students: {2, 4, 10, 12, 3, 20, 30, 11, 25} The students who have little differences in the marks obtained should be grouped together.

    Clustering Algorithm

    Result Validation

    If clusters do not make sense, go back to prior stage Check for tendency of clusters in the data set

    Selection Criteria
    Simplification
    Useful in data concept construction Unsupervised learning

    Validation Criteria
    External criteria Entropy, F-Measure, NMI-Measure, Purity Internal criteria Sum of Squared Error, BIC, CH, DB, SIL, DUNN Relative criteria Entropy, SSE

    END

    You might also like