HIVEeeeeeeeeeeee this time !!!

Apache Hadoop Pig

My first program in hadoop !!!

My First Hadoop Program !!! from Ayapparaj Karmeham

SAS Blog 2 - Answers - Even number problems from chapter 16 to 20 for Learning SAS by Example Programmer's Guide-Ron Cody

In this blog i have added answers to exercise sums (chapters 16 to 20 - even number problems) for Ron Cody's Learning SAS by Example Programmer's Guide.


                    

SAS Blog 1 - Answers - Even number problems from chapter 7 to 15 for Learning SAS by Example Programmer's Guide-Ron Cody

In this blog i have added answers to exercise sums (chapters 7 to 15 - even number problems) for Ron Cody's Learning SAS by Example Programmer's Guide.

I have done this as part of my academics.What did i learn while doing this assignment....

In seventh chapter i gathered knowledge about using conditional statements such as IF, ELSE IF, WHERE, SELECT , sub-setting with the help of the above statements and using Boolean operators. In eighth chapter i gathered knowledge about using DO, DO WHILE, DO UNTIL along with LEAVE and CONTINUE statements and also to make a simple gplot. Ninth chapter talks about dealing with dates, finding the difference with respect to day, weekday, month, year and also computing difference quarterly, imputing missing values etc., using various functions and also to make qplot.Tenth chapter talks mainly about merging two datasets and subsetting using IN= function, updating a master table using another table and much more.Eleventh chapter talks about Functions to round and truncate numerical values, missing values, computing constant values, generating random values, to fetch values from previous observations etc.

Chapter twelve talks about  functions dealing with manipulating characters. Chapter thirteen talks about array functions. Chapter Fourteen mainly deals with presenting the data. Fifteen is about generating reports. 

I have added all the datasets and the codes in Dropbox. You can download them from the following link.

https://www.dropbox.com/sh/yl5fmjxg9aadxwd/AAAJUHtvEAJR2-rsUjUFQ8WBa?dl=0

SAS Ron Cody Solutions for even Number problems from Chapter 7 to 15 from Ayapparaj Karmeham

Python-CSV Data

Reading and writing comma-separated data

We are going to do some analysis on real life data.

Reading Airport data

Data is present in the below link :

http://openflights.org/data.html and save it as “airports.dat”

Following code will show you the Names of all routes in that file

Airline Route Histogram

Tasks to be completed with the above data :

(I) AIRPORT DATA

Using the "airports.dat" data use the unique ID and map it to the respective geographical coordinates (latitudes and longitudes). With this you can find the location of  the airports.

Reading the data from airports.dat file

Latitudes 

Longitudes

(II)ROUTES AND DISTANCES

 https://raw.githubusercontent.com/jpatokal/openflights/master/data/routes.dat

Go to the above link and download the “Routes.dat” file.

With the help of the ID of source and destination airport ,look up the coordinates of the airports and calculate the route distances. Based on the latitudes and longitudes we would be able to know the length of the route and append it to the list of all route length.

Geodistance calculation

http://opentechschool.github.io/python-data-intro/files/geo_distance.py

Download the program from the above link and save it to your local.

Load and run the program.

Now you can import it and fine the geodistance between two airports.

(III)    HISTOGRAM

Plot a histogram based on the route lengths to show the distribution of different flight distances.

                
 Source: http://opentechschool.github.io/python-data-intro/core/csv.html