Data Exploring and Data Wrangling - NYCFlights13 Dataset

1 data Exploring and data Wrangling - NYCF lights13 DatasetVaibhav Walvekar# Load standard librarieslibrary(tidyverse)library(nycfl ights13)## Warning: package' NYCFlights13 'was built under R version and Inspecting data :# Get detials about NYCFlights13 Dataset ?nycflights13ls("package:nycfligh ts13")?flights# Load different data points from the NYCFlights13 libraryairlines_data <- airlinesairports_data <- airportsflights_data <- flightsplanes_data <- planesweather_data <- weather The NYCFlights13 Dataset is a collection of data pertaining to different airlines flying from differentairports in NYC, also capturing flight, plane and weather specific details during the year of data was collected into these five different branches.

2 This method of collecting data helps usto work on individual aspects of the whole large Dataset and also we can combine together multipleaspects to do some complex data analysis. There are also 3-4 database versions of NYCFlights13 datasetwhich cache the data from NYCFlights13 database in a local database, helping in joining tables onnatural keys efficient. The source of flights Dataset is RITA, Bureau of transportation statistics, variables in flights Dataset represent as below:# Variables in flights Dataset ?flightsyear,month,day - Date of departuredep_time,arr_time - Actual departure and arrival times, local ,sched_arr_time - Scheduled departure and arrival times, local ,arr_delay - Departure and arrival delays, in minutes.

3 Negative times represent early depar- ,minute - Time of scheduled departure broken into hour and - Two letter carrier abbreviation. See airlines to get name1tailnum - Plane tail numberflight - Flight numberorigin,dest - Origin and destination. See airports for additional - Amount of time spent in the airdistance - Distance flowntime_hour - Scheduled date and hour of the flight as a POSIXct date. Along with origin, can be used to joinflights data to weather data .# Inspecting flights datasetsapply(flights_data, class)## $year## [1] "integer"#### $month## [1] "integer"#### $day## [1] "integer"#### $dep_time## [1] "integer"#### $sched_dep_time## [1] "integer"#### $dep_delay## [1] "numeric"#### $arr_time## [1] "integer"#### $sched_arr_time## [1] "integer"#### $arr_delay## [1] "numeric"#### $carrier## [1] "character"#### $flight## [1] "integer"#### $tailnum## [1] "character"#### $origin## [1] "character"#### $dest2## [1] "character"#### $air_time## [1] "numeric"#### $distance## [1] "numeric"#### $hour## [1] "numeric"#### $minute## [1] "numeric"#### $time_hour## [1] "POSIXct" "POSIXt"head(flights_data)## # A tibble.

4 6 19## year month day dep_time sched_dep_time dep_delay arr_time## <int> <int> <int> <int> <int> <dbl> <int>## 1 2013 1 1 517 515 2 830## 2 2013 1 1 533 529 4 850## 3 2013 1 1 542 540 2 923## 4 2013 1 1 544 545 -1 1004## 5 2013 1 1 554 600 -6 812## 6 2013 1 1 554 558 -4 740## # .. with 12 more variables: sched_arr_time <int>, arr_delay <dbl>,## # carrier <chr>, flight <int>, tailnum <chr>, origin <chr>, dest <chr>,## # air_time <dbl>, distance <dbl>, hour <dbl>, minute <dbl>,## # time_hour <dttm>tail(flights_data,5)## # A tibble.

5 5 19## year month day dep_time sched_dep_time dep_delay arr_time## <int> <int> <int> <int> <int> <dbl> <int>## 1 2013 9 30 NA 1455 NA NA## 2 2013 9 30 NA 2200 NA NA## 3 2013 9 30 NA 1210 NA NA## 4 2013 9 30 NA 1159 NA NA## 5 2013 9 30 NA 840 NA NA## # .. with 12 more variables: sched_arr_time <int>, arr_delay <dbl>,## # carrier <chr>, flight <int>, tailnum <chr>, origin <chr>, dest <chr>,## # air_time <dbl>, distance <dbl>, hour <dbl>, minute <dbl>,## # time_hour <dttm>flights_newdata <- flights_data[order(flights_data$month,fl ights_data$day),]tail(flights_newdata,5) ## # A tibble.

6 5 193## year month day dep_time sched_dep_time dep_delay arr_time## <int> <int> <int> <int> <int> <dbl> <int>## 1 2013 12 31 NA 705 NA NA## 2 2013 12 31 NA 825 NA NA## 3 2013 12 31 NA 1615 NA NA## 4 2013 12 31 NA 600 NA NA## 5 2013 12 31 NA 830 NA NA## # .. with 12 more variables: sched_arr_time <int>, arr_delay <dbl>,## # carrier <chr>, flight <int>, tailnum <chr>, origin <chr>, dest <chr>,## # air_time <dbl>, distance <dbl>, hour <dbl>, minute <dbl>,## # time_hour <dttm>dim(flights_data)## [1] 336776 19summary(flights_data)## year month day dep_time## Min.

7 :2013 Min. : Min. : Min. : 1## 1st Qu.:2013 1st Qu.: 1st Qu.: 1st Qu.: 907## Median :2013 Median : Median Median :1401## Mean :2013 Mean : Mean Mean :1349## 3rd Qu.:2013 3rd Qu. 3rd Qu. 3rd Qu.:1744## Max. :2013 Max. Max. Max. :2400## NA's :8255## sched_dep_time dep_delay arr_time sched_arr_time## Min. : 106 Min. : Min. : 1 Min. : 1## 1st Qu.: 906 1st Qu.: 1st Qu.:1104 1st Qu.:1124## Median :1359 Median : Median :1535 Median :1556## Mean :1344 Mean : Mean :1502 Mean :1536## 3rd Qu.

8 :1729 3rd Qu.: 3rd Qu.:1940 3rd Qu.:1945## Max. :2359 Max. Max. :2400 Max. :2359## NA's :8255 NA's :8713## arr_delay carrier flight tailnum## Min. : Length:336776 Min. : 1 Length:336776## 1st Qu.: Class :character 1st Qu.: 553 Class :character## Median : Mode :character Median :1496 Mode :character## Mean : Mean :1972## 3rd Qu.: 3rd Qu.:3465## Max. Max. :8500## NA's :9430## origin dest air_time distance## Length:336776 Length:336776 Min.

9 : Min. : 17## Class :character Class :character 1st Qu.: 1st Qu.: 502## Mode :character Mode :character Median Median : 872## Mean Mean :1040## 3rd Qu. 3rd Qu.:1389## Max. Max. :4983## NA's :9430## hour minute time_hour## Min. : Min. : Min. :2013-01-01 05:00:00## 1st Qu.: 1st Qu.: 1st Qu.:2013-04-04 13:00:004## Median Median Median :2013-07-03 10:00:00## Mean Mean Mean :2013-07-03 05:02:36## 3rd Qu.

10 3rd Qu. 3rd Qu.:2013-10-01 07:00:00## Max. Max. Max. :2013-12-31 23:00:00##str(flights_data)## Classes'tbl_df','tbl'and' ': 336776 obs. of 19 variables:## $ year : int 2013 2013 2013 2013 2013 2013 2013 2013 2013 2013 ..## $ month : int 1 1 1 1 1 1 1 1 1 1 ..## $ day : int 1 1 1 1 1 1 1 1 1 1 ..## $ dep_time : int 517 533 542 544 554 554 555 557 557 558 ..## $ sched_dep_time: int 515 529 540 545 600 558 600 600 600 600 ..## $ dep_delay : num 2 4 2 -1 -6 -4 -5 -3 -3 -2 ..## $ arr_time : int 830 850 923 1004 812 740 913 709 838 753 ..## $ sched_arr_time: int 819 830 850 1022 837 728 854 723 846 745.