Kurdistan Region Government Ministry of Higher Edu. & Sci.

Research Sulaimani Polytechnic University

Technical college of Informatics
Database Technology Department
2022-2023

Clustering algorithm

Prepared by:
Basta soran
Dedar Idres
Nazyar pshtiwan
Supervisor:
Mr.Tahsin Ali
 Table of Contents
Introduction.................................................................................................................................................3
What are the Data Mining Algorithms Techniques?....................................................................................3
1. Regression (predictive):.......................................................................................................................3
2. Association Rule Discovery (descriptive):............................................................................................3
3. Classification (predictive):....................................................................................................................4
4. clustering (descriptive):.......................................................................................................................4
What is Clustering in Data Mining?.............................................................................................................4
What is Cluster Analysis in Data Mining?....................................................................................................5
Applications of cluster analysis in data mining:...........................................................................................5
What are the Requirements of Clustering Data Mining Techniques?..........................................................5
Methods of Clustering in Data Mining:........................................................................................................7
1. Partitioning Clustering Method...........................................................................................................7
2. Hierarchical Clustering Methods.........................................................................................................8
1. Divisive Approach............................................................................................................................8
2. Agglomerative Approach.................................................................................................................8
3. Density-Based Clustering Method.......................................................................................................9
4. Grid-Based Clustering Method............................................................................................................9
5. Model-Based Clustering Methods.....................................................................................................10
6. Constraint-Based Clustering Method.................................................................................................10
What kinds of classification is not considered a cluster analysis?.............................................................10
Advantages of Clustering Algorithms in Data Mining................................................................................10
1. Helps companies make operational changes –..................................................................................11
2. Will help make educated choices –....................................................................................................11
Disadvantages of Clustering Algorithms in Data Mining............................................................................11
1. Clustering Algorithms in Data Mining Instruments are Complicated and Need Training-.................12
2. Clustering Algorithms in Data mining strategies aren’t infallible –....................................................12
3. Soaring privacy worries –...................................................................................................................12
Conclusion.................................................................................................................................................13
References.................................................................................................................................................13

2
 Introduction
Clustering Algorithms in Data Mining is a progressively important branch of computer science
that examines data to find and describe patterns. Because we live in a world where we can be
overwhelmed with data, data mining algorithms are imperative that we find ways to classify
this input, find the data we need, illuminate structures, and be able to conclude. A team creates
abstract objects in classes of quite similar items. We treat a bunch of data items as one team.
While carrying out cluster analysis, our first partition is based on data similarity and then
assigns the product labels to the organizations. The primary benefit of over-classification is its
adaptability to improvements. And it helps single out valuable features which distinguish
various organizations. Data Mining Algorithms started in the 1990s, and it is the procedure of
discovering patterns inside big data sets. Analyzing data in non-traditional methods supplied
scans that were both beneficial and surprising. The use of data mining algorithms came around
straight from the evolution of database and data warehouse technologies.

What are the Data Mining Algorithms Techniques?

Data mining is a procedure of extraction which help data and patterns from great details. It’s
additionally called an expertise discovery process, knowledge mining from data, knowledge
extraction, or data /pattern analysis. Let’s discuss the primary four techniques of data mining:

1. Regression (predictive):

Regression describes a data mining method used to foresee the numeric values in a particular
data set. For instance, repetition may be used to predict the product or other variables or
service price. It’s also used in numerous industries for business and marketing conduct, trend
analysis, and monetary forecasting.

2. Association Rule Discovery (descriptive):

Among the primary data mining methods, connection rule mining seeks to extract exciting
correlations, causal structures, or regular patterns amid sets of things in data. Association
Discovery is a rule-based unsupervised Machine Learning means for discovering relations
between variables in high dimensional datasets. The primary inspiration behind the strategy is
arriving at statistically major rules located as per a certain degree of interestingness.

3
3. Classification (predictive):

The different determines which classify a brand new observation belongs according to the
program data set containing statements whose classify membership is famous. Predication is
selecting the missing or perhaps unavailable numerical details for a brand new observation.

4. clustering (descriptive):

Clustering is a method helpful for exploring data. It’s constructive when there are many causes
and no clear all-natural groupings. At this point, clustering data mining algorithms can be used
to locate whatever organic collections might exist.

What is Clustering in Data Mining?

In clustering, a group of different data objects is classified as similar objects. One group means a
cluster of data. Data sets are divided into different groups in the cluster analysis, which is based
on the similarity of the data. After the classification of data into various groups, a label is
assigned to the group. It helps in adapting to the changes by doing the classification. So if we
were to define clustering in data mining, then we can say that the process of cluster in data
mining is basically comprising a set of abstract objects into groups of similar objects. The
process of dividing and storing them in these groups is known as cluster analysis.

Figure 1

4
What is Cluster Analysis in Data Mining?
Cluster Analysis in Data Mining means that to find out the group of objects which are similar to
each other in the group but are different from the object in other groups. In the process of
clustering in data analytics, the sets of data are divided into groups or classes based on data
similarity. Then each of these classes is labelled according to their data types. Going through
clustering in data mining example can help you understand the analysis more extensively.

Applications of cluster analysis in data mining:

 In many applications, clustering analysis is widely used, such as data analysis, market
research, pattern recognition, and image processing.
 It assists marketers to find different groups in their client base and based on the
purchasing patterns. They can characterize their customer groups.
 It helps in allocating documents on the internet for data discovery.
 Clustering is also used in tracking applications such as detection of credit card fraud.
 As a data mining function, cluster analysis serves as a tool to gain insight into the
distribution of data to analyze the characteristics of each cluster.
 In terms of biology, it can be used to determine plant and animal taxonomies,
categorization of genes with the same functionalities and gain insight into structure
inherent to populations.
 It helps in the identification of areas of similar land that are used in an earth observation
database and the identification of house groups in a city according to house type, value,
and geographical location.

What are the Requirements of Clustering Data Mining Techniques?

 Scalability: Many clustering techniques work well on small data sets with less than 200
data objects, however, a huge database might include millions of objects. Clustering on
a subset of a big dataset might result in skewed findings. Clustering methods that are
highly scalable are required.

5
 Usability and interpretability: Users anticipate interpretable, thorough, and usable
clustering findings. As a result, clustering may require unique semantic interpretations
and applications. It’s crucial to investigate how the application aim influences Clustering
Data Mining technique selection.

 High dimensionality: A database or a data warehouse can have several dimensions or

properties. Many clustering algorithms excel at dealing with low-dimensional data (two
or three dimensions). Human eyes are capable of assessing clustering quality in up to
three dimensions. Clustering data items in a high-dimensional space may be difficult,
especially when the data is sparse and heavily skewed (misleading data).
 Constraint-based clustering: Clustering may be required in real-world applications due
to a variety of restrictions. Assume you’re in charge of selecting locations for a certain
number of new automatic cash dispensing machines (ATMs) in a city. You may decide
this by clustering households while taking into account limits such as the city’s
waterways, highway networks, and client needs per area. Finding groupings of data with
appropriate clustering behavior that fulfill stated requirements is a difficult issue.

Figure 2

6
Methods of Clustering in Data Mining:
The different methods of clustering in data mining are as explained below:

Figure 3

1. Partitioning Clustering Method

In this method, let us say that “m” partition is done on the “p” objects of the database. A
cluster will be represented by each partition and m < p. K is the number of groups after the
classification of objects. There are some requirements which need to be satisfied with this
Partitioning Clustering Method and they are: –
1. One objective should only belong to only one group.
2. There should be no group without even a single purpose.
There are some points which should be remembered in this type of Partitioning Clustering
Method which are:
1. There will be an initial partitioning if we already give no. of a partition (say m).
2. There is one technique called iterative relocation, which means the object will be moved
from one group to another to improve the partitioning.

7
2. Hierarchical Clustering Methods

Among the many different types of clustering in data mining, In this hierarchical clustering
method, the given set of an object of data is created into a kind of hierarchical decomposition.
The formation of hierarchical decomposition will decide the purposes of classification. There
are two types of approaches for the creation of hierarchical decomposition, which are: –

1. Divisive Approach

Another name for the Divisive approach is a top-down approach. At the beginning of this
method, all the data objects are kept in the same cluster. Smaller clusters are created by
splitting the group by using the continuous iteration. The constant iteration method will keep
on going until the condition of termination is met. One cannot undo after the group is split or
merged, and that is why this method is not so flexible.

2. Agglomerative Approach

Another name for this approach is the bottom-up approach. All the groups are separated in the
beginning. Then it keeps on merging until all the groups are merged, or condition of
termination is met.
There are two approaches which can be used to improve the Hierarchical Clustering Quality in
Data Mining which are: –
1. One should carefully analyze the linkages of the object at every partitioning of
hierarchical clustering.
2. One can use a hierarchical agglomerative algorithm for the integration of hierarchical
agglomeration. In this approach, first, the objects are grouped into micro-clusters. After
grouping data objects into micro clusters, macro clustering is performed on the micro
cluster.

8
 Figure 4

3. Density-Based Clustering Method

In this method of clustering in Data Mining, density is the main focus. The notion of mass is
used as the basis for this clustering method. In this clustering method, the cluster will keep on
growing continuously. At least one number of points should be there in the radius of the group
for each point of data.

4. Grid-Based Clustering Method

In this type of Grid-Based Clustering Method, a grid is formed using the object together. A Grid
Structure is formed by quantifying the object space into a finite number of cells.
Advantage of Grid-based clustering method: –

1. Faster time of processing: The processing time of this method is much quicker than
another way, and thus it can save time.
2. This method depends on the no. of cells in the space of quantized each dimension.

9
5. Model-Based Clustering Methods

In this type of clustering method, every cluster is hypothesized so that it can find the data which
is best suited for the model. The density function is clustered to locate the group in this
method.

6. Constraint-Based Clustering Method

Application or user-oriented constraints are incorporated to perform the clustering. The

expectation of the user is referred to as the constraint. In this process of grouping,
communication is very interactive, which is provided by the restrictions.

What kinds of classification is not considered a cluster analysis?

1. Graph Partitioning – The type of classification where areas are not the same and are
only classified based on mutual synergy and relevance is not cluster analysis.
2. Results of a query – In this type of classification, the groups are created based on the
specification given from external sources. It is not counted as a Cluster Analysis.
3. Simple Segmentation – Division of names into separate groups of registration based on
the last name does not qualify as Cluster Analysis.
4. Supervised Classification – Those type of classification which is classified using label
information cannot be said as Cluster Analysis because cluster analysis involves group
based on the pattern.

Advantages of Clustering Algorithms in Data Mining

As we now explored, clustering algorithms in data mining are the procedure of removing trends
and patterns from a lot of data. It is used to enhance the consumer experience, profitability,
and lower chances. Data mining programs may also analyze data from customers’ email
messages and a company’s Internet tasks and offer helpful insights. Some other benefits of data
mining are as follows:

10
  It can help collect reliable data-
Clustering Algorithms in Data mining algorithms enable governments, organizations, and
companies to manage reliable data. It may be used in marketing research to figure out what
products buyers may like and next make those available products to them. Data mining
algorithms likewise help organizations assess their policies of theirs and procedures for success.

1. Helps companies make operational changes –

Clustering Algorithms in Data mining help businesses make operational adjustments and
lucrative generation. Data mining algorithms could find correlations between items, customers,
other facts, and company suppliers. This could assist a firm in determining trends that could not
have been identified before, or perhaps at the very least help they create much more accurate
predictions. So long as an enterprise finds out its being offered much less of a solution than
expected, it may find out what caused this and alter its design of theirs to improve efficiency.
The Clustering Algorithms in the data mining method also operate in reverse – if a business
understands who its customers are currently, it will be able to produce advertising promotions,
mainly targeting these groups to make sales over time.

2. Will help make educated choices –

It’s commonly used for business reasons to enhance decision-making. As more data is
collected, the accuracy of clustering algorithms in data mining becomes higher. This method
can offer insights that could be impossible or difficult to locate only from reviewing other
sources or data. For instance, it can assist in identifying a variety of kinds of clients and their
purchase behavior of theirs.

Disadvantages of Clustering Algorithms in Data Mining

As explored previously, clustering algorithms in data mining are a helpful tool. Nevertheless, it’s
not without its drawbacks of its. The disadvantages of clustering algorithms in data mining are
as follows:

11
1. Clustering Algorithms in Data Mining Instruments are Complicated and Need Training-

Data analytics is a complex process and sometimes demands people who have instruction to
use the resources. The barrier to entry for data analytics can discourage companies that are
small from using this technology. Likewise, it can be tough to find pertinent data that is not
currently private and proprietary.

2. Clustering Algorithms in Data mining strategies aren’t infallible –

Clustering Algorithms in Data mining do not constantly give accurate data. You will find a
variety of means to analyze data, and even several of them tend to be more authentic than
others. For instance, predictive errors depend on the assumptions that specific detail patterns
will likely be found. This could result in overconfidence in the accuracy of a prediction when all
available evidence does not support it. An additional problem happens when there is lack of
data in a database that must be accounted for to produce a fundamental analysis.

3. Soaring privacy worries –

One of the leading disadvantages of clustering algorithms in data mining is data and privacy
concerns. Traditionally, businesses would share private data along with other companies to be
able to do a service. Nowadays, numerous individuals are concerned that their data is for sale
to third parties without their consent. Many people may not feel at ease realizing that the
federal government can monitor detailed data about them and how they work with their
products.

12
Conclusion
Clustering algorithms in Data mining is a selection of predictive modeling methods, and also you
can use a range of data mining software. Learning how to use these methods with Python is
tough – it is going to take diligence and practice to apply these to your data set of yours. You
will run into numerous bugs, error messages, and roadblocks early on. – But remain diligent and
persistent in your data mining attempts.

References
 https://www.analytixlabs.co.in/blog/types-of-clustering-algorithms/
 https://byjus.com/maths/cluster-analysis/
 https://jpt.spe.org/what-is-clustering-and-how-does-it-work
 https://www.datanovia.com/en/blog/types-of-clustering-methods-overview-and-quick-
start-r-code/
 https://www.wikitechy.com/tutorial/data-mining/data-mining-different-types-of-
clustering
 https://www.datatrained.com/post/best-clustering-algorithms-in-data-mining/
#:~:text=within%20Integration%20Services.-,What%20are%20Clustering%20Algorithms
%20in%20Data%20Mining%3F,split%20data%20into%20several%20subsets.
 https://www.javatpoint.com/data-mining-cluster-analysis
 https://www.educba.com/what-is-clustering-in-data-mining/
 https://hevodata.com/learn/clustering-data-mining-techniques/
 https://neptune.ai/blog/clustering-algorithms

13