Scribd
Upload
4 views

map_reduce_filter_lambda_generator

Map filter and reduce

Uploaded by

adarsh.pathak.ug24
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
4 views

map_reduce_filter_lambda_generator

Map filter and reduce

Uploaded by

adarsh.pathak.ug24
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 27

MAP, REDUCE ,FILTER

Lambda, Generator
Lambda Function or Anonymous Function
● Function that is created using lambda keyword not using def keyword.
● Lambda function are just needed where they have been created and
can be used anywhere a function required.
● Lambda function contains only a single line .

● Example : sum=lambda x, y : x+y


print(“Sum=”, sum(3,5))
Lambda Functions : Key points
● Lambda function have no name
● Lambda function can take any number of arguments
● Lambda function just return one value
● Lambda function definition does not have any explicit return statement but it
always contains an expression which is returned
● They are a one-line version of a function and hence cannot contain multiple
expression
● Lambda function can not access global variable
● You can use Lambda function in normal function
Lambda Syntax
lambda.py
1 #Example 1
2 square_func = lambda x : x**2
3 square_func(4) #return: 16
4
5 #Example 2
6 close_enough = lambda x, y : abs(x – y) < 3
7 close_enough(2, 4) #return: True
8
9 #Example 3
0 def get_func(n) :
1 return lambda x : x * n + x % n
2 my_func = get_func(13)
3 my_func(4) #return: 56
GENERATORS
• Are special functions that help to define user defined iterators
• The generator is a construct that generates a dynamic sequence
and it generates an iterator
• They are Functions that return a sequence of values
• It is written like an ordinary function but it uses ‘yield’
statement
● The generated object is remembered by the Generator.
● These Generators do not compute untill they are
needed. This is called lazy evaluation i.e. only on
request computation is done
● Generators can be used to generate values infinitely .
● Therefore they can be used to model an infinite data
sequence with no end. These are stream data
Example - Odd number Generator
def generate_odd(m,n):
while(m < n):
if m% 2 != 0:
yield m
m = m+1

for odd in generate_odd(0,100):


print(odd, end = ‘,’)
print()
OUTPUT
1,3,5,7,9......99,
Example FibonacciGenerator
def fib(n):
x=1
y=1
for i in range(n):
yield(x)
x,y = y, x+y

fib(10)
• Sometimes we want to pass an entire
function as a parameter
• Python has functions as first-class citizens,
so you can do this
• You simply pass the functions by name
Higher-Order Functions

• A higher-order function is a function that takes another


function as a parameter
• They are “higher-order” because it’s a function of a function
• Examples
–Map
–Reduce
–Filter
• Lambda works great as a parameter to higher-order
functions if you can deal with its limitations
Map
map(function, iterable, ...)

• Map applies function to each element of iterable and


creates a list of the results
• You can optionally provide more iterables as parameters
to map and it will place tuples in the result list
• Map returns an iterator which can be cast to list
Map Example
Example

1 nums = [0, 4, 7, 2, 1, 0 , 9 , 3, 5, 6, 8, 0, 3]
2
3 nums = list(map(lambda x : x % 5, nums))
4
5
print(nums)
6
7 #[0, 4, 2, 2, 1, 0, 4, 3, 0, 1, 3, 0, 3]
Example
items = [ “copper”, “Zinc”, “Nickel”]
items_new = list(map(str.upper, items))
print(items_new)

OUTPUT

[‘COPPER’, ‘ZINC’, ‘NICKEL’]


Map Problem
Goal: given a list of three dimensional points in the
form of tuples, create a new list consisting of the
distances of each point from the origin

Loop Method:
- distance(x, y, z) = sqrt(x**2 + y**2 + z**2)
- loop through the list and add results to a new list
Solution
1 from math import sqrt
2
3 points = [(2, 1, 3), (5, 7, -3), (2, 4, 0), (9, 6, 8)]
4
5 def distance(point) :
6 x, y, z = point
7 return sqrt(x**2 + y**2 + z**2)
8
9 distances = list(map(distance, points))
Filter iterable)
filter(function,
• The filter runs through each element of iterable (any
iterable object such as a List or another collection)
• It applies function to each element of iterable
• If function returns True for that element then the
element is put into a List
• This list is returned from filter in versions of python under
3
• In python 3, filter returns an iterator which must be cast
to type list with list()
Filter Example

Example

1 nums = [0, 4, 7, 2, 1, 0 , 9 , 3, 5, 6, 8, 0, 3]
2
3 nums = list(filter(lambda x : x != 0, nums))
4
5 print(nums) #[4, 7, 2, 1, 9, 3, 5, 6, 8, 3]
6
Example - to find Palindromes in a list of strings
palindrome_list = [“Top”, “nun”, “tattarrattat”, “advice”, “noon”]
print(palindrome_list)

result = list(filter(lambda a: (a ==””.join(reversed(a))), palindrome_list)

print(result)
Ex: to generate Even numbers
def even(n):
if(n % 2 == 0)
return TRUE
else:
return FALSE

lst = [2,10,14,9,50]

even_lst = filter(even, lst)


print(list(even_lst))
Reduce
reduce(function, iterable[,initializer])

• Reduce will apply function to each element in iterable along with


the sum so far and create a cumulative sum of the results
• In short reduces a set of values to single number
• function must take two parameters
• If initializer is provided, initializer will stand as the first argument in
the sum
• Unfortunately in python 3 reduce() requires an import statement
• from functools import reduce
Reduce Example

Example

1 nums = [1, 2, 3, 4, 5]
2
3 sum = reduce(lambda x, y : x+y, nums,10)
4
5 Print(sum)
6
7 >> 25
Reduce Example

Example

1 nums = [9, 20, 40,60,3]


2
3 min_element = reduce(min,list_numbers)
4
5 Print(min_element)
6
7 >> 3
Reduce Problem
Goal: given a list of numbers I want to find the
average of those numbers in a few lines using
reduce()

For Loop Method:


- sum up every element of the list
- divide the sum by the length of the list
Reduce Problem

Solution

1 nums = [92, 27, 63, 43, 88, 8, 38, 91, 47, 74, 18, 16,
29, 21, 60, 27, 62, 59, 86, 56]
2
3 sum = reduce(lambda x, y : x + y, nums) / len(nums)
4
MapReduce

Problem: Given an email how do you tell if it is spam?

- Count occurrences of certain words. If they


occur too frequently the email is spam.
MapReduce
map_reduce.py

1 email = ['the', 'this', 'annoy', 'the', 'the', 'annoy']


2
3 def inEmail (x):
if (x == "the"):
4 return 1;
5 else:
return 0;
6
spam_val = list(map(inEmail, email)) #[1, 0, 0, 1, 1, 0]
7
8 reduce((lambda x, xs: x + xs), spam_val) #3
9
1
0

You might also like