[Solved-1 Solution] Where to see the mapreduce code generated from hadoop pig statements ?
What is mapreduce ?
- MapReduce is a core component of the Apache Hadoop software framework.
- MapReduce serves two essential functions: It parcels out work to various nodes within the cluster or map, and it organizes and reduces the results from each node into a unified answer to a query.
Problem :
We all know that the Hadoop pig statements are converted into java mapreduce code. Is there is any way to see the mapreduce code generated from pig statements ?
Solution 1:
We all know that hadoop pig statements are converted into java mapreduce code
- This is not the case. Hadoop Pig statements are not translated into Java MapReduce code.
- A better way of thinking about it is Pig code is "interpreted" in an Pig interpreter that runs in Java MapReduce.
We can also plan for this way:
- Python and Perl do not "generate" C code, they run through a C program (interpreter) that executes the instructions. Basically, Pig provides a framework for a query plan to be executed.
- The Pig code gets interpreted and a prebuilt interpreter MapReduce job executes it. For this reason, this is impossible to do.