Scribd
Upload
39 views

#1 - Skill Builds - Data Analysis With Python

The document discusses how to analyze and summarize a dataset containing automobile data. It reads the data from an online CSV file and stores it in a dataframe. It then previews the data, sets column headers, drops missing values, and checks the data types and distributions of columns. Functions like .head(), .tail(), .dtypes, .describe() and .info() are used to analyze various properties of the dataframe. The document also discusses how to save the dataframe to other file formats like JSON, Excel etc.

Uploaded by

Gregory
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
39 views

#1 - Skill Builds - Data Analysis With Python

The document discusses how to analyze and summarize a dataset containing automobile data. It reads the data from an online CSV file and stores it in a dataframe. It then previews the data, sets column headers, drops missing values, and checks the data types and distributions of columns. Functions like .head(), .tail(), .dtypes, .describe() and .info() are used to analyze various properties of the dataframe. The document also discusses how to save the dataframe to other file formats like JSON, Excel etc.

Uploaded by

Gregory
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 3

# 

Import pandas library
import pandas as pd

# Read the online file by the URL provides above, and assign it to variab
"df"
other_path = "https://s3-api.us-geo.objectstorage.softlayer.net/cf-
courses-data/CognitiveClass/DA0101EN/auto.csv"
df = pd.read_csv(other_path, header=None)

# show the first 5 rows using dataframe.head() method
print("The first 5 rows of the dataframe") 
df.head(5)

# print("The last 10 rows of the dataframe\n")
df.tail(10)

# create headers list
headers = ["symboling","normalized-losses","make","fuel-
type","aspiration", "num-of-doors","body-style",
         "drive-wheels","engine-location","wheel-base", "length","width","
height","curb-weight","engine-type",
         "num-of-cylinders", "engine-size","fuel-
system","bore","stroke","compression-ratio","horsepower",
         "peak-rpm","city-mpg","highway-mpg","price"]
print("headers\n", headers)

#We replace headers and recheck our data frame


df.columns = headers
df.head(10)

#we can drop missing values along the column "price" as follows
df.dropna(subset=["price"], axis=0)

# Write your code below and press Shift+Enter to execute 
print(df.columns)

# if you would save the dataframe df as automobile.csv to your local


machine, you may use the syntax below:
df.to_csv("automobile.csv", index=False)
We can also read and save other file formats, we can use similar functions to pd.read_csv() and
df.to_csv() for other data formats, the functions are listed in the following table:

Data Formate Read Save


csv pd.read_csv() df.to_csv()
json pd.read_json() df.to_json()
excel pd.read_excel() df.to_excel()
hdf pd.read_hdf() df.to_hdf()
sql pd.read_sql() df.to_sql()
... ... ...

Data Types
Data has a variety of types.
The main types stored in Pandas dataframes are object, float, int, bool and datetime64. In order
to better learn about each attribute, it is always good for us to know the data type of each
column. In Pandas:

df.dtypes

returns a Series with the data type of each column.

# check the data type of data frame "df" by .dtypes
print(df.dtypes)

# If we would like to get a statistical summary of each column, such as


count, column mean value, column standard deviation, etc. We use the
describe method:
df.describe()

You can add an argument include = "all" inside the bracket. Let's try it again.

# describe all the columns in "df" 
df.describe(include = "all")

You can select the columns of a data frame by indicating the name of each column, for example,
you can select the three columns as follows:

dataframe[[' column 1 ',column 2', 'column 3']]


Where "column" is the name of the column, you can apply the method ".describe()" to get the
statistics of those columns as follows:

dataframe[[' column 1 ',column 2', 'column 3'] ].describe()

df[['length', 'compression-ratio']].describe()

Another method you can use to check your dataset is:

# look at the info of "df"
df.info

You might also like