Notice: This page requires JavaScript to function properly.
Please enable JavaScript in your browser settings or update your browser.
Quality Evaluation | How to choose the best model?
Cluster Analysis
course content

Course Content

Cluster Analysis

Cluster Analysis

1. What is Clustering?
2. Basic Clustering Algorithms
3. How to choose the best model?

bookQuality Evaluation

In real-life tasks with real data, it can be difficult to understand which algorithm to use and whether the results are good enough. To determine this, several techniques are used:

  1. Relative cluster validation, which evaluates the clustering structure by varying different parameter values for the same algorithm (e.g.,: varying the number of clusters k for K-means, linkage for agglomerative, eps and min_samples for DBSCAN etc.);
  2. Internal and external cluster validation means that we use internal and external metrics to estimate clustering quality;
  3. Rule of thumb: a stable group should be preserved when changing the clustering method. For example, if the results obtained using the agglomerative method and the K-means method coincide by more than 70%, then the assumption of stability is accepted;
  4. Using resampling methods to evaluate the stability of clustering split:
    • whether the split is stable across different subsamples of the original dataset;
    • whether the split is stable after some samples were deleted from original the dataset;
    • whether the split is stable after changing the order of the elements.
  5. Try to interpret the clustering results in terms of the domain area: is it possible to explain the results of clustering and is there any logic in them.

Note

In the context of data analysis, the domain area refers to the specific field or industry that the data belongs to or is being used for. Examples of domain areas include healthcare, finance, marketing, transportation, and many others.

Can we consider the results of clustering to be stable if different algorithms produce completely different clusters?

Can we consider the results of clustering to be stable if different algorithms produce completely different clusters?

Select the correct answer

Everything was clear?

How can we improve it?

Thanks for your feedback!

Section 3. Chapter 3
We're sorry to hear that something went wrong. What happened?
some-alt