Scribd
Upload
0 views2 pages

Hadoop Questions

The document outlines various data processing tasks including finding maximum temperatures from a dataset, writing a MapReduce program to filter employee records, and creating different types of tables in Hive and HCatalog. It also includes operations for exporting and importing data between HDFS and MySQL, as well as managing an HBase table for products. Each task is aimed at handling and manipulating data in a big data environment.

Uploaded by

pranathiponnam
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
0 views2 pages

Hadoop Questions

The document outlines various data processing tasks including finding maximum temperatures from a dataset, writing a MapReduce program to filter employee records, and creating different types of tables in Hive and HCatalog. It also includes operations for exporting and importing data between HDFS and MySQL, as well as managing an HBase table for products. Each task is aimed at handling and manipulating data in a big data environment.

Uploaded by

pranathiponnam
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 2

1 Problem Explanation: In this data set, the first field represents the year and the second field

represents
the temperature in that year. As the temperature will not be constant throughout the year, each year
has multiple temperatures listed in the dataset. You need to process the dataset and find the maximum
temperature during a year. Here is the sample output:

Sample Output

Year Maximum Temperature

1900 36

1901 48

1902 49

2 Write a mapreduce program to filter employee_id < 100

note: generate 200 records

sample data

1,parmamnd,10-02-1994

2,Rahul,10-02-1994

3,Shyam,10-02-1994

3 Create manage table in hive for employees

4 Create exernal table in hive for employees

5 Create Hive Partition Table for student and load into partined table
7 Create an HCatalog table and write to it using Pig

8 Export data from HDFS to MySQL Employees table

9 Import data from mysql to hdfs

10 Create Product Hbase table ,add data to hbase table, retrive data from hbase table, delete hbase
table

You might also like