{"id":6744,"date":"2017-06-19T12:00:04","date_gmt":"2017-06-19T16:00:04","guid":{"rendered":"http:\/\/research.prattsils.org\/?p=6744"},"modified":"2017-06-19T12:00:04","modified_gmt":"2017-06-19T16:00:04","slug":"gephi-lab","status":"publish","type":"post","link":"https:\/\/studentwork.prattsi.org\/infovis\/visualization\/gephi-lab\/","title":{"rendered":"Visualizing Good Flight Paths"},"content":{"rendered":"<p><strong>Introduction <\/strong><\/p>\n<p><span style=\"font-weight: 400\">Networks help to explain our complex world by presenting insights into the relationships of elements (people, events, bacteria) revealing extent of connections between them. \u00a0For the network visualization lab I set out to create a graph of an airline transportation system in order to understand its underlying structure. \u00a0\u00a0I am curious to learn what attributes become evident in a graph and how easy is it to recognize new information.<\/span><\/p>\n<p><strong>Inspiration <\/strong><\/p>\n<p><span style=\"font-weight: 400\">Transportation systems are already \u201cmapped\u201d and provide a familiar, real world application on which to embark on network visualization. The following visualizations illustrate varying viewpoints in the mapping of air travel.<\/span><\/p>\n<div id=\"attachment_6832\" style=\"width: 506px\" class=\"wp-caption alignleft\"><a href=\"http:\/\/research.prattsils.org\/blog\/coursework\/information-visualization\/gephi-lab\/attachment\/airports-world-network\/\" rel=\"attachment wp-att-6832\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-6832\" class=\" wp-image-6832\" src=\"https:\/\/i0.wp.com\/studentwork.prattsi.org\/infoshow\/wp-content\/uploads\/sites\/2\/2017\/06\/airports-world-network-620x413.png?resize=506%2C337\" alt=\"airports-world-network\" width=\"506\" height=\"337\" \/><\/a><p id=\"caption-attachment-6832\" class=\"wp-caption-text\"><strong>Fig 1<\/strong> Air transportation network visualization from <a href=\"http:\/\/www.martingrandjean.ch\/connected-world-air-traffic-network\/\" target=\"_blank\" rel=\"noopener noreferrer\">Martin Grandjean<\/a><\/p><\/div>\n<p><span style=\"font-weight: 400\">Based on <\/span><a href=\"https:\/\/openflights.org\/\"><span style=\"font-weight: 400\">Openflight.org<\/span><\/a><span style=\"font-weight: 400\"> data, <\/span><a href=\"http:\/\/www.martingrandjean.ch\/connected-world-air-traffic-network\/\"><span style=\"font-weight: 400\">Martin Grandjean\u2019s<\/span><\/a><span style=\"font-weight: 400\"> map (<strong>Fig 1<\/strong>) focuses on the quantity and connections of world-wide air transport. \u00a0Continents are represented by colors, nodes represent airports and node size the number of routes. \u00a0The map reveals connectedness, ie: Latin American clusters are very connected to the U.S.; India is more connected to the Middle East than to Southeast Asia. \u00a0I appreciate the strong aesthetic quality used to convey voluminous and complex information.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<div id=\"attachment_6836\" style=\"width: 720px\" class=\"wp-caption alignnone\"><a href=\"http:\/\/research.prattsils.org\/blog\/coursework\/information-visualization\/gephi-lab\/attachment\/thanksgiving-flight-patterns-by-new-york-times\/\" rel=\"attachment wp-att-6836\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-6836\" class=\"size-full wp-image-6836\" src=\"https:\/\/i0.wp.com\/studentwork.prattsi.org\/infoshow\/wp-content\/uploads\/sites\/2\/2017\/06\/Thanksgiving-Flight-Patterns-by-New-York-Times.png?resize=720%2C507\" alt=\"Thanksgiving-Flight-Patterns-by-New-York-Times\" width=\"720\" height=\"507\" \/><\/a><p id=\"caption-attachment-6836\" class=\"wp-caption-text\"><strong>Fig 2<\/strong> Thanksgiving Flight Patterns from <a href=\"https:\/\/nyti.ms\/2lgdRRN\" target=\"_blank\" rel=\"noopener noreferrer\">The New York Times<\/a><\/p><\/div>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400\">The New York Times included a visualization of Thanksgiving flight patterns (<strong>Fig 2<\/strong>) in a holiday <\/span><a href=\"https:\/\/www.nytimes.com\/interactive\/2015\/11\/24\/upshot\/thanksgiving-flight-patterns.html?_r=0\"><span style=\"font-weight: 400\">blog post<\/span><\/a><span style=\"font-weight: 400\">. Its creators mapped the difference in flight patterns for the holiday weekend versus the norm using Google Flights search data. The map clearly conveys discernible insights to a general audience. \u00a0Color provides direction from origin to destination and the thickness of the lines represents the change in volume.<\/span><\/p>\n<p>&nbsp;<\/p>\n<div id=\"attachment_6837\" style=\"width: 620px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/research.prattsils.org\/blog\/coursework\/information-visualization\/gephi-lab\/attachment\/united\/\" rel=\"attachment wp-att-6837\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-6837\" class=\"size-medium wp-image-6837\" src=\"https:\/\/i0.wp.com\/studentwork.prattsi.org\/infoshow\/wp-content\/uploads\/sites\/2\/2017\/06\/united-e1498435349483-620x541.png?resize=620%2C541\" alt=\"US Transportation (United)\" width=\"620\" height=\"541\" \/><\/a><p id=\"caption-attachment-6837\" class=\"wp-caption-text\"><strong>Fig 3<\/strong> US Transportation Analysis by <a href=\"https:\/\/matinehshaker.github.io\/\" target=\"_blank\" rel=\"noopener noreferrer\">Matine Shaker for HedgeClone<\/a><\/p><\/div>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Another interesting airport\/flight path visualization comes from the <\/span><a href=\"https:\/\/matinehshaker.github.io\/\"><span style=\"font-weight: 400\">HedgeClone<\/span><\/a><span style=\"font-weight: 400\"> blog (<strong>Fig 3<\/strong>). \u00a0Using data from <\/span><a href=\"https:\/\/www.transtats.bts.gov\/DL_SelectFields.asp?Table_ID=236&amp;DB_Short_Name=On-Time\"><span style=\"font-weight: 400\">Bureau of Transportation Statistics<\/span><\/a><span style=\"font-weight: 400\">, its designer sought learn if air traffic in corresponding airports factored in delayed takeoffs. In this map, the thickness of edges is proportional to the number of trips in the route. Larger nodes represent the hubs in the network. \u00a0Here, I like the simplicity of mono-colored nodes and edges.<\/span><\/li>\n<\/ul>\n<p><strong>Materials<\/strong><\/p>\n<p><a href=\"https:\/\/gephi.org\/\"><span style=\"font-weight: 400\">Gephi<\/span><\/a><span style=\"font-weight: 400\"> is an open source visualization platform for \u201cnetworks, complex systems, dynamic and hierarchical graphs, layout and metrics\u201d. \u00a0The flight path dataset, retrieved from <\/span><a href=\"http:\/\/www.casos.cs.cmu.edu\/tools\/datasets\/internal\/index.php\"><span style=\"font-weight: 400\">CASOS Network Science Data<\/span><\/a><span style=\"font-weight: 400\">, comprises multiple airline networks and their system flight paths. United\u2019s network was used for the lab. It contains 81 nodes and 370 weighted, directed edges and is described as \u201cgood flight paths\u201d.<\/span><\/p>\n<p><strong>Methods<\/strong><\/p>\n<p><span style=\"font-weight: 400\">The dataset was converted from xml to csv using TextWrangler and OpenRefine, then imported as undirected into Gephi application with valid source, target, and weight attributes. \u00a0I selected a <\/span><a href=\"https:\/\/en.wikipedia.org\/wiki\/Force-directed_graph_drawing\"><span style=\"font-weight: 400\">force-directed<\/span><\/a><span style=\"font-weight: 400\"> layout algorithm (Force Atlas2) to generate the graph. \u00a0The initial layout was further refined by running an expansion algorithm and removing overlap to improve legibility (<strong>Fig 4<\/strong>). \u00a0Next, I opened the statistics panel to run metrics on the graph, Average Degree, Network Diameter, Graph Density, and Modularity. \u00a0The average degree distribution followed the expected Power Law distribution. \u00a0The Network Diameter generated betweeness and closeness centralities.<\/span><\/p>\n<div id=\"attachment_6874\" style=\"width: 887px\" class=\"wp-caption alignnone\"><a href=\"http:\/\/research.prattsils.org\/blog\/coursework\/information-visualization\/gephi-lab\/attachment\/gephi-images\/\" rel=\"attachment wp-att-6874\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-6874\" class=\"size-full wp-image-6874\" src=\"https:\/\/i0.wp.com\/studentwork.prattsi.org\/infoshow\/wp-content\/uploads\/sites\/2\/2017\/06\/gephi-images.jpg?resize=840%2C331\" alt=\"\" width=\"840\" height=\"331\" \/><\/a><p id=\"caption-attachment-6874\" class=\"wp-caption-text\"><strong>Fig 4<\/strong> Tranformations<\/p><\/div>\n<p><span style=\"font-weight: 400\">\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">I next used some of the metrics to modify the appearance of the graph. \u00a0First I changed the node size based on closeness centrality using a range of 5 min &#8211; 25 max which identified the significant hubs. \u00a0I then added color to the graph first by closeness centrality then by degree with similar results. \u00a0Ultimately, I colored the graph based on the modularity class to highlight the clusters. \u00a0Once the nodes were labeled the graph needed to be rotated to approximate the hubs\u2019 geographical location. \u00a0I ran the Preview alternating between curved and straight edges and labeled or unlabeled nodes. \u00a0<\/span><\/p>\n<p><strong>Results<\/strong><\/p>\n<p><span style=\"font-weight: 400\">The most significant features of the final graph (<strong>Fig 5<\/strong>) are the hubs in United\u2019s network. \u00a0The average degree of 4.5 reflects the majority of the small nodes have a degree of 1 where the major hubs and mid sized hubs are between 25-63. The modularity metric identified three clusters likely reflecting frequency and proximity. \u00a0Adjusting the resolution down added a fourth insignificant cluster. \u00a0The graph density (5.7%) and diameter (3) as well as the high closeness and betweeness centralities, reflect the connectedness of a regional air transportation network. \u00a0Some of the small airports in this network are isolates but perhaps not given a broader network representation. \u00a0Getting out of Missoula, Montana takes some planning. \u00a0<\/span><\/p>\n<div id=\"attachment_6873\" style=\"width: 998px\" class=\"wp-caption alignnone\"><a href=\"http:\/\/research.prattsils.org\/blog\/coursework\/information-visualization\/gephi-lab\/attachment\/final-final-gephi\/\" rel=\"attachment wp-att-6873\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-6873\" class=\"size-full wp-image-6873\" src=\"https:\/\/i0.wp.com\/studentwork.prattsi.org\/infoshow\/wp-content\/uploads\/sites\/2\/2017\/06\/FINAL-final-gephi.png?resize=840%2C481\" alt=\"\" width=\"840\" height=\"481\" \/><\/a><p id=\"caption-attachment-6873\" class=\"wp-caption-text\"><strong>Fig 5<\/strong> Final Gephi Graph<\/p><\/div>\n<p><strong>Future Directions<\/strong><\/p>\n<p><span style=\"font-weight: 400\">The dataset adequately represented the relationships between airports and good flight paths for United\u2019s network, clearly identifying the airline\u2019s hubs. \u00a0The visualization could be more effective\/interesting by including multiple airline networks (airlines share airports\/some flight paths). \u00a0Also, Including a second visualization for the \u201cnot good flight paths\u201d dataset would give context to the graph and make the attributes of good versus bad flight paths apparent. \u00a0Finally, to make the graph more dynamic, using the <\/span><a href=\"http:\/\/sigmajs.org\/\"><span style=\"font-weight: 400\">SigmaJS<\/span><\/a><span style=\"font-weight: 400\"> plugin to layer a geographical map (Fig 2) and add interactively if \u00a0web published. <\/span><\/p>\n<p><span style=\"font-weight: 400\">The main challenge which occurred with Gephi during the lab was that it is not able to show what interactions have been done to a graph. \u00a0Ie: it was difficult to recall which attributes used for size and color, needing to start from beginning.<\/span><\/p>\n<p><strong>References:<\/strong><\/p>\n<p><a href=\"https:\/\/flowingdata.com\/\"><span style=\"font-weight: 400\">https:\/\/flowingdata.com\/<\/span><\/a><\/p>\n<p><span style=\"font-weight: 400\">Storrick, Jon. Good flightpaths [dataset]. Available from: <\/span><a href=\"http:\/\/www.casos.cs.cmu.edu\/tools\/datasets\/internal\/index.php\"><span style=\"font-weight: 400\">http:\/\/www.casos.cs.cmu.edu\/tools\/datasets\/internal\/index.php<\/span><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Introduction Networks help to explain our complex world by presenting insights into the relationships of elements (people, events, bacteria) revealing extent of connections between them. \u00a0For the network visualization lab I set out to create a graph of an airline transportation system in order to understand its underlying structure. \u00a0\u00a0I am curious to learn what&hellip;<\/p>\n","protected":false},"author":210,"featured_media":6873,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"coauthors":[],"class_list":["post-6744","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-visualization"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/paBdcV-1KM","_links":{"self":[{"href":"https:\/\/studentwork.prattsi.org\/infovis\/wp-json\/wp\/v2\/posts\/6744","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/studentwork.prattsi.org\/infovis\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/studentwork.prattsi.org\/infovis\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/studentwork.prattsi.org\/infovis\/wp-json\/wp\/v2\/users\/210"}],"replies":[{"embeddable":true,"href":"https:\/\/studentwork.prattsi.org\/infovis\/wp-json\/wp\/v2\/comments?post=6744"}],"version-history":[{"count":0,"href":"https:\/\/studentwork.prattsi.org\/infovis\/wp-json\/wp\/v2\/posts\/6744\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/studentwork.prattsi.org\/infovis\/wp-json\/"}],"wp:attachment":[{"href":"https:\/\/studentwork.prattsi.org\/infovis\/wp-json\/wp\/v2\/media?parent=6744"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/studentwork.prattsi.org\/infovis\/wp-json\/wp\/v2\/categories?post=6744"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/studentwork.prattsi.org\/infovis\/wp-json\/wp\/v2\/tags?post=6744"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/studentwork.prattsi.org\/infovis\/wp-json\/wp\/v2\/coauthors?post=6744"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}