Weather Dataset Analysis
Weather Dataset Analysis
data = pd.read_csv(r"file.csv")
Data Exploration
data.head()
data.index
data.columns
Index(['Date/Time', 'Temp_C', 'Dew Point Temp_C', 'Rel Hum_%',
'Wind Speed_km/h', 'Visibility_km', 'Press_kPa', 'Weather'],
dtype='object')
data.dtypes
Date/Time object
Temp_C float64
Dew Point Temp_C float64
Rel Hum_% int64
Wind Speed_km/h int64
Visibility_km float64
Press_kPa float64
Weather object
dtype: object
data.nunique()
Date/Time 8784
Temp_C 533
Dew Point Temp_C 489
Rel Hum_% 83
Wind Speed_km/h 34
Visibility_km 24
Press_kPa 518
Weather 50
dtype: int64
data.count()
Date/Time 8784
Temp_C 8784
Dew Point Temp_C 8784
Rel Hum_% 8784
Wind Speed_km/h 8784
Visibility_km 8784
Press_kPa 8784
Weather 8784
dtype: int64
data["Weather"].value_counts()
data.info()
<class 'pandas.core.frame.DataFrame'>
RangeIndex: 8784 entries, 0 to 8783
Data columns (total 8 columns):
# Column Non-Null Count Dtype
--- ------ -------------- -----
0 Date/Time 8784 non-null object
1 Temp_C 8784 non-null float64
2 Dew Point Temp_C 8784 non-null float64
3 Rel Hum_% 8784 non-null int64
4 Wind Speed_km/h 8784 non-null int64
5 Visibility_km 8784 non-null float64
6 Press_kPa 8784 non-null float64
7 Weather 8784 non-null object
dtypes: float64(4), int64(2), object(2)
memory usage: 549.1+ KB
Data Analysis
data['Wind Speed_km/h'].unique()
array([ 4, 7, 6, 9, 15, 13, 20, 22, 19, 24, 30, 35, 39, 32, 33, 26, 44,
43, 48, 37, 28, 17, 11, 0, 83, 70, 57, 46, 41, 52, 50, 63, 54, 2],
dtype=int64)
Que.2. Find the number of times when the "Weather is exactly clear".
data[data.Weather == 'Clear']
data.groupby('Weather').get_group('Clear')
Que.3. number of times when the "wind speed was exactly 4km/h"
data[data['Wind Speed_km/h'] == 4]
data.isnull().sum()
Date/Time 0
Temp_C 0
Dew Point Temp_C 0
Rel Hum_% 0
Wind Speed_km/h 0
Visibility_km 0
Press_kPa 0
Weather 0
dtype: int64
data.Visibility_km.mean()
27.664446721311478
0.8440047459486483
data['Rel Hum_%'].var()
286.24855019850196
data[data['Weather condition'].str.contains('Snow')]
#Que : Find all instances when 'Wind speed was above 24' nd 'visibility is 25'
Que.9. What is the mean value of each column against each 'Weather condition' ?
data.groupby('Weather condition').mean()
Visibility_km Press_kPa
Weather condition
Clear 30.153243 101.587443
Cloudy 26.625752 100.911441
Drizzle 17.931707 100.435366
Drizzle,Fog 5.257500 100.786625
Drizzle,Ice Pellets,Fog 4.000000 100.790000
Drizzle,Snow 10.500000 100.890000
Drizzle,Snow,Fog 5.513333 99.281333
Fog 6.248000 101.184067
Freezing Drizzle 9.200000 100.202857
Freezing Drizzle,Fog 5.266667 100.441667
Freezing Drizzle,Haze 2.666667 100.316667
Freezing Drizzle,Snow 5.872727 100.520909
Freezing Fog 0.650000 102.320000
Freezing Rain 8.242857 99.647143
Freezing Rain,Fog 7.550000 99.945000
Freezing Rain,Haze 2.400000 100.375000
Freezing Rain,Ice Pellets,Fog 8.000000 100.950000
Freezing Rain,Snow Grains 4.800000 98.560000
Haze 7.831250 101.482500
Mainly Clear 34.264862 101.248832
Moderate Rain,Fog 6.400000 99.980000
Moderate Snow 0.750000 100.275000
Moderate Snow,Blowing Snow 0.600000 100.570000
Mostly Cloudy 31.253842 101.025288
Rain 18.856536 100.233333
Rain Showers 22.816489 100.404043
Rain Showers,Fog 6.400000 99.830000
Rain Showers,Snow Showers 21.700000 101.100000
Rain,Fog 6.873276 100.500862
Rain,Haze 6.700000 100.540000
Rain,Ice Pellets 9.700000 100.120000
Rain,Snow 11.672222 99.951111
Rain,Snow Grains 25.000000 100.600000
Rain,Snow,Fog 6.400000 100.730000
Rain,Snow,Ice Pellets 6.000000 100.105000
Snow 11.171795 100.536103
Snow Pellets 2.400000 99.700000
Snow Showers 20.158333 100.963500
Snow Showers,Fog 7.025000 101.292500
Snow,Blowing Snow 4.105263 99.704737
Snow,Fog 4.537838 100.688649
Snow,Haze 4.640000 100.782000
Snow,Ice Pellets 7.416667 100.548333
Thunderstorms 24.550000 100.230000
Thunderstorms,Heavy Rain Showers 2.400000 100.260000
Thunderstorms,Moderate Rain Showers,Fog 3.200000 100.010000
Thunderstorms,Rain 19.833333 100.420000
Thunderstorms,Rain Showers 15.893750 100.233750
Thunderstorms,Rain Showers,Fog 9.700000 100.063333
Thunderstorms,Rain,Fog 4.800000 100.080000
Que.10. What is the minimum & maximum value of each column against each 'Weather condition' ?
data.groupby('Weather condition').min()
Date/Time Temp_C \
Weather condition
Clear 1/11/2012 1:00 -23.3
Cloudy 1/1/2012 17:00 -21.4
Drizzle 1/23/2012 21:00 1.1
Drizzle,Fog 1/23/2012 20:00 0.0
Drizzle,Ice Pellets,Fog 12/17/2012 9:00 0.4
Drizzle,Snow 12/17/2012 15:00 0.9
Drizzle,Snow,Fog 12/18/2012 21:00 0.3
Fog 1/1/2012 0:00 -16.0
Freezing Drizzle 1/13/2012 10:00 -9.0
Freezing Drizzle,Fog 1/1/2012 2:00 -6.4
Freezing Drizzle,Haze 2/1/2012 11:00 -5.8
Freezing Drizzle,Snow 1/13/2012 3:00 -8.3
Freezing Fog 1/22/2012 6:00 -19.0
Freezing Rain 1/13/2012 11:00 -6.5
Freezing Rain,Fog 1/17/2012 23:00 -6.1
Freezing Rain,Haze 2/1/2012 14:00 -4.9
Freezing Rain,Ice Pellets,Fog 12/17/2012 3:00 -2.6
Freezing Rain,Snow Grains 1/13/2012 9:00 -5.0
Haze 1/22/2012 12:00 -11.5
Mainly Clear 1/10/2012 11:00 -22.8
Moderate Rain,Fog 12/10/2012 8:00 1.7
Moderate Snow 1/12/2012 15:00 -6.3
Moderate Snow,Blowing Snow 12/27/2012 10:00 -5.5
Mostly Cloudy 1/1/2012 16:00 -23.2
Rain 1/1/2012 18:00 0.3
Rain Showers 1/1/2012 22:00 1.6
Rain Showers,Fog 10/20/2012 3:00 12.8
Rain Showers,Snow Showers 11/4/2012 8:00 2.1
Rain,Fog 1/23/2012 18:00 0.0
Rain,Haze 3/13/2012 7:00 4.0
Rain,Ice Pellets 12/18/2012 5:00 0.6
Rain,Snow 1/10/2012 5:00 0.6
Rain,Snow Grains 12/21/2012 0:00 1.9
Rain,Snow,Fog 12/8/2012 21:00 0.8
Rain,Snow,Ice Pellets 12/21/2012 1:00 0.9
Snow 1/10/2012 1:00 -16.7
Snow Pellets 11/24/2012 15:00 0.7
Snow Showers 1/12/2012 7:00 -13.3
Snow Showers,Fog 12/26/2012 9:00 -11.3
Snow,Blowing Snow 1/13/2012 21:00 -12.0
Snow,Fog 12/16/2012 15:00 -10.1
Snow,Haze 2/1/2012 17:00 -4.3
Snow,Ice Pellets 12/10/2012 3:00 -4.3
Thunderstorms 7/16/2012 1:00 21.6
Thunderstorms,Heavy Rain Showers 5/29/2012 6:00 10.9
Thunderstorms,Moderate Rain Showers,Fog 7/17/2012 6:00 19.6
Thunderstorms,Rain 5/25/2012 20:00 19.4
Thunderstorms,Rain Showers 5/29/2012 16:00 11.0
Thunderstorms,Rain Showers,Fog 6/29/2012 3:00 19.5
Thunderstorms,Rain,Fog 7/17/2012 5:00 20.6
Press_kPa
Weather condition
Clear 99.52
Cloudy 98.39
Drizzle 97.84
Drizzle,Fog 98.65
Drizzle,Ice Pellets,Fog 100.79
Drizzle,Snow 100.63
Drizzle,Snow,Fog 97.79
Fog 98.31
Freezing Drizzle 98.44
Freezing Drizzle,Fog 98.74
Freezing Drizzle,Haze 100.28
Freezing Drizzle,Snow 99.19
Freezing Fog 101.97
Freezing Rain 98.22
Freezing Rain,Fog 98.32
Freezing Rain,Haze 100.34
Freezing Rain,Ice Pellets,Fog 100.95
Freezing Rain,Snow Grains 98.56
Haze 100.35
Mainly Clear 98.67
Moderate Rain,Fog 99.98
Moderate Snow 99.88
Moderate Snow,Blowing Snow 100.50
Mostly Cloudy 98.36
Rain 97.52
Rain Showers 98.51
Rain Showers,Fog 99.83
Rain Showers,Snow Showers 101.09
Rain,Fog 98.61
Rain,Haze 100.50
Rain,Ice Pellets 100.12
Rain,Snow 98.18
Rain,Snow Grains 100.60
Rain,Snow,Fog 100.73
Rain,Snow,Ice Pellets 99.85
Snow 97.75
Snow Pellets 99.70
Snow Showers 99.49
Snow Showers,Fog 100.63
Snow,Blowing Snow 98.11
Snow,Fog 99.38
Snow,Haze 100.61
Snow,Ice Pellets 99.40
Thunderstorms 99.84
Thunderstorms,Heavy Rain Showers 100.26
Thunderstorms,Moderate Rain Showers,Fog 100.01
Thunderstorms,Rain 100.19
Thunderstorms,Rain Showers 99.65
Thunderstorms,Rain Showers,Fog 99.71
Thunderstorms,Rain,Fog 100.08
data.groupby('Weather condition').max()
Date/Time Temp_C \
Weather condition
Clear 9/9/2012 5:00 32.8
Cloudy 9/9/2012 23:00 30.5
Drizzle 9/30/2012 3:00 18.8
Drizzle,Fog 9/30/2012 2:00 19.9
Drizzle,Ice Pellets,Fog 12/17/2012 9:00 0.4
Drizzle,Snow 12/19/2012 18:00 1.2
Drizzle,Snow,Fog 12/22/2012 3:00 1.1
Fog 9/22/2012 0:00 20.8
Freezing Drizzle 2/1/2012 5:00 -2.3
Freezing Drizzle,Fog 12/10/2012 5:00 -0.3
Freezing Drizzle,Haze 2/1/2012 13:00 -5.0
Freezing Drizzle,Snow 3/2/2012 12:00 -3.3
Freezing Fog 3/17/2012 6:00 -0.1
Freezing Rain 2/1/2012 7:00 0.3
Freezing Rain,Fog 12/17/2012 1:00 0.1
Freezing Rain,Haze 2/1/2012 15:00 -4.9
Freezing Rain,Ice Pellets,Fog 12/17/2012 3:00 -2.6
Freezing Rain,Snow Grains 1/13/2012 9:00 -5.0
Haze 3/13/2012 23:00 14.1
Mainly Clear 9/9/2012 9:00 33.0
Moderate Rain,Fog 12/10/2012 8:00 1.7
Moderate Snow 12/27/2012 9:00 -4.9
Moderate Snow,Blowing Snow 12/27/2012 12:00 -5.4
Mostly Cloudy 9/9/2012 2:00 32.4
Rain 9/5/2012 2:00 22.8
Rain Showers 9/8/2012 16:00 26.4
Rain Showers,Fog 10/20/2012 3:00 12.8
Rain Showers,Snow Showers 12/5/2012 10:00 2.2
Rain,Fog 9/30/2012 23:00 21.7
Rain,Haze 3/13/2012 9:00 5.5
Rain,Ice Pellets 12/18/2012 5:00 0.6
Rain,Snow 4/23/2012 3:00 1.7
Rain,Snow Grains 12/21/2012 0:00 1.9
Rain,Snow,Fog 12/8/2012 21:00 0.8
Rain,Snow,Ice Pellets 12/21/2012 5:00 1.3
Snow 4/27/2012 9:00 3.7
Snow Pellets 11/24/2012 15:00 0.7
Snow Showers 3/4/2012 21:00 2.9
Snow Showers,Fog 12/29/2012 13:00 -10.0
Snow,Blowing Snow 2/25/2012 9:00 -1.4
Snow,Fog 3/14/2012 19:00 1.1
Snow,Haze 2/1/2012 21:00 -3.6
Snow,Ice Pellets 3/3/2012 4:00 0.8
Thunderstorms 7/4/2012 16:00 26.7
Thunderstorms,Heavy Rain Showers 5/29/2012 6:00 10.9
Thunderstorms,Moderate Rain Showers,Fog 7/17/2012 6:00 19.6
Thunderstorms,Rain 7/23/2012 18:00 21.3
Thunderstorms,Rain Showers 9/8/2012 4:00 25.5
Thunderstorms,Rain Showers,Fog 7/31/2012 20:00 22.9
Thunderstorms,Rain,Fog 7/17/2012 5:00 20.6
Press_kPa
Weather condition
Clear 103.63
Cloudy 103.65
Drizzle 101.56
Drizzle,Fog 102.07
Drizzle,Ice Pellets,Fog 100.79
Drizzle,Snow 101.15
Drizzle,Snow,Fog 100.15
Fog 103.04
Freezing Drizzle 101.02
Freezing Drizzle,Fog 101.27
Freezing Drizzle,Haze 100.36
Freezing Drizzle,Snow 101.18
Freezing Fog 102.85
Freezing Rain 101.00
Freezing Rain,Fog 101.01
Freezing Rain,Haze 100.41
Freezing Rain,Ice Pellets,Fog 100.95
Freezing Rain,Snow Grains 98.56
Haze 102.97
Mainly Clear 103.59
Moderate Rain,Fog 99.98
Moderate Snow 100.67
Moderate Snow,Blowing Snow 100.64
Mostly Cloudy 103.65
Rain 102.26
Rain Showers 102.31
Rain Showers,Fog 99.83
Rain Showers,Snow Showers 101.11
Rain,Fog 101.77
Rain,Haze 100.61
Rain,Ice Pellets 100.12
Rain,Snow 101.07
Rain,Snow Grains 100.60
Rain,Snow,Fog 100.73
Rain,Snow,Ice Pellets 100.47
Snow 102.73
Snow Pellets 99.70
Snow Showers 102.50
Snow Showers,Fog 102.52
Snow,Blowing Snow 100.62
Snow,Fog 102.07
Snow,Haze 100.99
Snow,Ice Pellets 100.96
Thunderstorms 100.62
Thunderstorms,Heavy Rain Showers 100.26
Thunderstorms,Moderate Rain Showers,Fog 100.01
Thunderstorms,Rain 100.83
Thunderstorms,Rain Showers 101.06
Thunderstorms,Rain Showers,Fog 100.64
Thunderstorms,Rain,Fog 100.08
Que.12. Find all instances where 'weather is clear' or 'visibility is above 40'
Que.13. Find all the instances: A.'Weather is clear' and 'Relative humidity is greater than 50' B. 'Visibility is
above 40'