Data and Dataset

With Introduction to Python Programming

Catherine Olivia Sereati

Tepercaya Kualitas Lulusannya

 Review : Machine Learning Process

Feature Model
Data Model Model
Data cleansing extraction and deployment and
collection training evaluation
selection integration

Feedback and iteration

Tepercaya Kualitas Lulusannya

 What is data:
information such as facts and numbers used to analyze something or
make decisions

data can come in many forms, such as text, images, audio, or video, and is
processed by AI algorithms to identify patterns and relationships that can
be used to make predictions, categorize information, or solve problems.

Data is essential to the development of AI, as it allows machines to learn

from experience and improve their performance over time.

Data is the first element for AI. There’s no AI without data

Tepercaya Kualitas Lulusannya

 Example data in Machine Learning :

Tepercaya Kualitas Lulusannya

 What is Dataset?
• A dataset is a collection of data that is organized in a
specific way for a specific purpose.
• It can be in the form of a spreadsheet, a table, a
database or any other structured format.
• Datasets can be used for a variety of purposes,
including statistical analysis, research, machine
learning, and more.
• They can be small or large, and can contain many types
of data, such as numerical, categorical, or textual data.
• Examples of datasets include weather data, census
data, customer data, and scientific research data.
Datasets are an essential tool for analyzing and
understanding complex information.

Tepercaya Kualitas Lulusannya

 Data in Artificial Intelligence :
• Data Training
• enable machine learning algorithms to learn patterns, correlations, and
relationships within the data
• improving their ability to make accurate predictions or classifications when
presented with new, unseen data.
• Data Testing
• Evaluate the performance of Machine Learning
• Error analysis

Tepercaya Kualitas Lulusannya

 Example of dataset

Tepercaya Kualitas Lulusannya

 How to Acquiring data (1) :
Manual Labeling :

CAT Not CAT CAT Not CAT

Observing Behaviour (Phenomenon)

Tepercaya Kualitas Lulusannya

 How to Acquiring data (2) :
• Download from website / partnership : example : kaggle.com

Tepercaya Kualitas Lulusannya

 Popular Data set
• Iris Data set : flower recognition
• MNIST Data set : Hand writing recognition
• CIFAR 10 data set : colour and image recognition

(https://medium.com/analytics-vidhya/exploration-of-iris-dataset-using-scikit-learn-part-1-8ac5604937f8)
Source : wikipedia

Tepercaya Kualitas Lulusannya

 Introduction to Python
Programming

Tepercaya Kualitas Lulusannya

 History of Python

Founder Guido van Rossum

Master of Mathematics、Master of Computer Science

Degree

When and Where Created in Amsterdam during Christmas in 1989.

Meaning of Name A big fan of Monty Python's Flying Circus

Influenced by Modula-3, Python is a descendant of ABC

Origin that would appeal to Unix/C hackers.

Tepercaya Kualitas Lulusannya

 What is Python?
• Python is a programming language.
• Python is a general-purpose and advanced programming language.
• Python applies to programming in many fields:
• web development (server-side),
• software development,
• mathematics,
• system scripting.

Tepercaya Kualitas Lulusannya

 Python Application Domains

Python has rich third-party libraries and advantages. Therefore, Python

can be used in many fields as follows:
 AI : libraries for Machine Learning : TensorFlow, Pytorch, Scikit-Learn
 Data science : Numpy, Pandas, Matplot-lib
 Software Programming : General Purposes Language Programming
 Web Development : web application framework : ex Django,
TurboGears, CherryPy, tec
 Web Crawling : gather data from website ; scrappy : python
framework for large scale web-craws
 Cloud Computing : Openstack : free and open source for cloud
operating system

Tepercaya Kualitas Lulusannya

 Python compares with other language programming
• Python is simpler than Java and C
• Python has much bigger standard
library (and free), while Java and C
have limited access to library
(some of them are paid)

Tepercaya Kualitas Lulusannya

 IDE’s
• IDE : Integrated Development Environment
• Increase programmer productivity by integrating common
programming activities into a single software
This Photo by Unknown Author is licensed under CC BY-SA

• We can edit source code, run the program, Debug

Common Python IDE’s :
• Pycharm
• Jupyter Notebook
• Spyder
• Google Colab No need to download

Tepercaya Kualitas Lulusannya

 Python Common
data types
• Number
• String
• List
• Tuple
• Dictionary
• set

Tepercaya Kualitas Lulusannya

 Python data types are
classified into the following
types:
• Sequential: Subscripts (indexes) can be used to access
elements. You can access elements in slice mode such
as [start:stop:step].
• Nonsequential: Subscripts (indexes) cannot be used to
access elements.
• Changeable: Values can be modified.
• Unchangeable:Values cannot be modified.

Tepercaya Kualitas Lulusannya

 Number, basic operation
Addition (+)
Subtraction (-)
Multiplication (x)
Division (/)
Modulo/Rounding (%, //)
Power (**)

If the operation is performed on numbers of different

types (such as int and float), the result type is the type
with higher precision.
Tepercaya Kualitas Lulusannya
 Math operation

Tepercaya Kualitas Lulusannya

 STRING
• In Python, a string is a sequence with multiple characters.
• The number of characters indicates the length of the string.
• Python does not have a character data type. A single character is
considered as a string with length 1.
• To declare a string, you only need to
• use single quotation marks ('...') or
• double quotation marks ("...") to enclose the content, or
• three consecutive quotation marks ('''...''' or """...""").

Tepercaya Kualitas Lulusannya

 String Operator (1)
• : Two strings are concatenated.
• Example: a="hello";b="world" =>a+b= 'helloworld'.
• *: A new string is obtained by multiplying a string by a number.
• Example: "a"*2=>"aa"

Tepercaya Kualitas Lulusannya

 String Operator (2)

Tepercaya Kualitas Lulusannya

 String Operator (3)

Tepercaya Kualitas Lulusannya

 String Operator (4)

Tepercaya Kualitas Lulusannya

 List
• A list is a sequence in which elements can be of any data type and
elements can be added or deleted at any time.
• In a list, elements are enclosed by a pair of square brackets and are
separated by commas (,). You can create a list in either of the
following ways:
• List = list(obj1, obj2,…)
• List = [obj1, obj2, ….]
• Operator:
• +: Combines lists, for example, the result of [1,2]+[2,3] is [1, 2, 2, 3].
• x: Multiplies a list by a number to obtain a new list, for example, the result of [1,2] x 2 is [1, 2,
1, 2].

Tepercaya Kualitas Lulusannya

 List Operator (1)

Tepercaya Kualitas Lulusannya

 List Operator (2)

Tepercaya Kualitas Lulusannya

 Example Operator List
animals = ['cat', 'dog', 'monkey']
# list.append(obj): Add a new object to the end of the list.
animals.append ('fish') # Append an element.
print(animals) # Output: ['cat', 'dog', 'monkey', ‘fish’]
# list.remove(obj): Remove the first match for a value in the list.
animals.remove ('fish') # Delete element fish.
print(animals) # Output: ['cat', 'dog', 'monkey']
# list.insert(index, obj): Insert a specified object to a specified position in the list. The index indicates
the position.
animals.insert (1, 'fish') # Insert element fish at subscript 1.
print(animals) # Output: ['cat', ‘fish’, 'dog', 'monkey']

Tepercaya Kualitas Lulusannya

 Next
• Conditioning and looping statement
• Python’s Machine Learning Library

Tepercaya Kualitas Lulusannya

 Thank you

Tepercaya Kualitas Lulusannya