Posts

Showing posts from 2017

Basic Statistics in R

My latest publicly available R notebook created in IBM's Data Science Experience is here!  This notebook provides a tutorial on:

This notebook covers:
Descriptive statisticsFrequency and contingency tablesCorrelations and covariancest-tests; andNonparametric statistics.I hope you enjoy this notebook.  Please feel free to share and let me know your thoughts.


My latest R notebook: Basic #Statistics in R https://t.co/b3NmhNXI5X#DataScience#dsx#IBM#Bluemix#ibmaot#rstats h/t @kabacoffpic.twitter.com/AsIhr51Q5l — Venky Rao (@VRaoRao) September 13, 2017

Adding a .RData file to DSX in 5 easy steps

I created a tutorial to show how users can add a .RData file to an R Jupyter Notebook in IBM's Data Science Experience (DSX) in 5 easy steps.


My latest #R#notebook: Add a .RData file to a DSX R Notebook in 5 steps https://t.co/uznXwZWKSv#dsx#IBM#DataScience#rstats#ibmaotpic.twitter.com/plKuTwYDwt— Venky Rao (@VRaoRao) September 13, 2017



Basic graphs in R

My latest publicly available R notebook created in IBM's Data Science Experience is here!  This notebook provides a tutorial on:

Bar, box and dot plotsPie and fan chartsHistograms and kernel density plots.I hope you enjoy this notebook.  Please feel free to share and let me know your thoughts.


My latest #R#notebook: Basic Graphs in R https://t.co/o7j97GwEUL#DataScience#dsx#IBM#ibmaot h/t @kabacoffpic.twitter.com/MBfZQgg4Y0— Venky Rao (@VRaoRao) September 4, 2017

Advanced Data Preparation in R

My latest publicly available R notebook created in IBM's Data Science Experience is here!  This notebook addresses some advanced features available in R focusing on Data Preparation.

I hope you enjoy this notebook.  Please feel free to share and let me know your thoughts.

My latest #R#notebook: Advanced Data Preparation in R https://t.co/7Dvc9nCPK0#DataScience#dsx#ibmaot#IBM h/t @kabacoffpic.twitter.com/cNpP45vpoR — Venky Rao (@VRaoRao) September 2, 2017

Engine bleed air: a primer

Image
Use of Bleed Air in Aircraft Pneumatic Systems: A Primer (taken from Chapter 6 on Pneumatic Systems from the 3rd Edition of the book “Aircraft Systems” by Ian Moir and Allan Seabridge)
The use of aircraft engines as a source of high pressure, high temperature air can be understood by examining the characteristics of the turbofan engine.Modern engines “bypass” a significant portion of the mass flow past the engine and increasingly a small portion of the mass flow passes through the engine core or gas generation section.The ratio of bypass air to engine core air is called the bypass ratio and this can easily exceed 10:1 for the very latest civil engines; much higher than the 4 or 5:1 ratio for the previous generation.
The characteristics of a modern turbofan engine are shown in figure 6.1.This shows the pressure (in psi) and the temperature (in degree centigrade) at various points throughout the engine for three conditions: ground idle, take off power and in the cruise condition.


It can…

Data Preparation in R

My latest publicly available R notebook created in IBM's Data Science Experience is here!  This notebook focuses on the basics of one of the most important aspects of Data Science: Data Preparation!

I hope you enjoy this notebook.  Please feel free to share and let me know your thoughts.


My latest #R#notebook: Data Preparation in R https://t.co/5yXpG5DHFY#DataScience#dsx#ibmaot#IBM h/t @kabacoffpic.twitter.com/42j6hMRFaF — Venky Rao (@VRaoRao) August 24, 2017

Getting started with graphs in R

My next publicly available R notebook created in IBM's Data Science Experience is here!  This notebook helps users get started with basic graphs in R and contains general techniques that apply to all graphs in R except those created using the "ggplot2" library.

While only a few lines of code are needed to create graphs in R, I have provided extensive comments for each line of code so first-time R-users can also follow along.  I hope you enjoy this notebook.  Please feel free to share and let me know your thoughts.


My latest #R#notebook: Basics of #graphs in #rstatshttps://t.co/2CU6uGJGOF#DataScience#dataviz#dsx#ibmaot#IBM h/t @kabacoffpic.twitter.com/HdCCRxP8FG — Venky Rao (@VRaoRao) August 21, 2017

Data Structures in R

In order to help users to get started with IBM's Data Science Experience, I have started developing tutorials / cookbooks.  My preferred language for Data Science is R so all my Jupyter notebooks will use that language.

My very first tutorial is on Data Structures in R.  I recently acquired the second edition of Dr. Robert Kabacoff's excellent book titled "R In Action" and have decided to create a Jupyter notebook for (almost) every chapter in the book.  Here is the first one.  I hope you enjoy it.  Please feel free to comment and let me know your thoughts.


Click on this link for a quick tutorial on #Data Structures in #R: https://t.co/EsalloitG5#rstats#ibm#dsx#ibmaot hat tip to @kabacoffpic.twitter.com/m9kDINC9CX — Venky Rao (@VRaoRao) August 11, 2017

SPSS Modeler - R Integration

Image

Earthquakes Visualized

Image
Using data from USGS (https://earthquake.usgs.gov/earthquakes/feed/v1.0/csv.php), I created a 3D web map of all earthquakes that occurred on 3 May 2017 with a magnitude > 1.0 on the Richter scale.  Here's a screenshot of my 3D web map:


If you want to experience the app in all its glory, click on this link: http://arcg.is/e19b4

If you want to stay on my awesome blog and experience the web app right here, you can do that here:



I would love to hear what you think!





Time enabled web app

Image
Working with a collaborator who published a map service that showed the growth of US cities through time (from the year 1790 through 2000), I created an interactive time enabled web app. Here's a screenshot:


You can explore the app right here:



If however, you want to access the web app in it's own web page, go here: http://arcg.is/2oRpgMH

The web app includes widgets that let you enable time scaling as well as changing the underlying basemap.  Feel free to explore the web app and let me know what you think.

Restaurant Location Selector

Image

3D Web Scene of Earthquakes, Tornadoes, Typhoons and Cities

Image
Here's my very first 3D Web Scene that visualizes natural disasters and two cities (Portland and Montreal): http://arcg.is/01jbSq

A 3D Web Scene is Esri-speak for a 3D web map.  You can zoom and pan, re-orient, change basemaps, change the daylight settings, explore different views and do lots more.  Here's a screen shot of all typhoons represented on the 3D Web Scene:


In this screenshot, typhoons are represented as cylinder symbols, with greater heights representing higher wind speeds and darker colors representing lower barometric pressures.

If you don't want to leave my beautiful blog (I don't blame you), you can check out the embedded version of the 3D Web Scene right here:



Check it out.  I'd love to know what you think!

IBM PMQ Manufacturing Demo

Image

Web app for selecting restaurant locations

Image
Using ArcGIS online and some simple instructions from Dr. Pinde Fu of Esri, I re-created a simple web app for selecting restaurant locations in USA.  This web app allows users to choose between two competing locations for opening a full service restaurant based on some interesting analytics capabilities like driving distance in time based on historical traffic patterns, the latest demographic information of the locations including population, disposable income, etc.

Here is a screenshot of the results of analysis done on service area of one of the locations based on a 15-minute drive time distance if usual traffic at 6pm on a Friday is taken into account:


You can access the web app in all its glory here: http://tinyurl.com/l6y53jo

Give it a try and let me know what you think.

IBM Predictive Maintenance & Quality Solution

Image

A simple survey using Survey123 for ArcGIS

I created a simple survey for collecting Volunteered Geographic Information (VGI) using Survey123 for ArcGIS.  I found this this tool intuitive and easy to use.  It still has some restrictions (I am sure there are better survey tools out there) but I was able to get up and running very quickly.  Of course, I love the mapping option that makes this survey tool unique - it instantly maps the location of the VGI.

I have not yet tried the Analyze and Data capabilities of this tool but in order to give it a serious test, I need lots of people to complete my survey.  Here is a link to the survey:

Link to my survey

When you click on the link (assuming you are using a mobile device), you will be asked to open the survey in the Survey123 for ArcGIS app.  Please download this app from your neighborhood app store (it's free and took me less than 30 seconds to download).  Once you download the app, filling out the survey will take you less than 60 seconds.

Thanks in advance for filling out my…

Deadliest Airplane Disasters

I created a web app on the deadliest airplane disasters (fatalities >= 200) in recorded history (upto 25 Feb 2017).  I created the dataset based on the information contained in this wikipedia page.

Here is the web app in all it's glory:




If you want to explore the web app on a separate web page, please click here.

I have built in various charting and querying options to help you explore the data.  Additionally, you can search the map by the name of the airline.

I have also configured this web app to work on various IO/S and Android devices so feel free to check it out on a mobile device of your choice.

I'd love to hear what you think of my web app so please let me know by leaving a comment below.

Historic Earthquakes and Hurricanes in the US

Image
Here's a web app I designed showcasing historic earthquakes and hurricanes in the US from 2000 to 2008:

Click here!

Here is what an image of the app looks like with a Dark Gray Canvas base map:


I used a map created by Dr. Pinde Fu of Esri to design this app.  It has been designed to work on many IO/S and Android devices so when you are ready, take it for a test drive!


ICC Cricket World Cup (1975 - 2015): a visual history

Being the cricket obsessed fan that I am (my obsession has gotten worse since I moved away from India and Australia to the US where I am starved of watching live cricket - distance does make the heart grow fonder!), I worked on a fun project this weekend.  I first started with a story map tour of all the cities that have hosted the finals of the various ICC Cricket World Cup tournaments from inception (1975) until the last edition (2015).

You can access the story map tour web app here: http://arcg.is/2l6QaOM

Next, I created a map of all the countries that have ever participated in the World Cup.  Here is what the map looks like:




The size of the flag indicates the number of times that a country has been the world champion (min value = 0; max value = 5).

Then I focused on the two World Cups (held in 1987 and 2011) that were hosted by Asian countries.  For each of these editions, I created a map that marked the various venues where the cricket matches were played.  Here is what the map …

A simple app to collect Volunteered Geographic Information (VGI)

Per Wikipedia, Volunteered Geographic Information (VGI) is the harnessing of tools to create, assemble, and disseminate geographic data provided voluntarily by individuals.  VGI is a special case of the larger Web phenomenon known as user-generated content.  While there is concern over the authority of the data, research has shown that VGI may provide benefits to the end user above and beyond that of traditional data sources, in part due to its ability to collect and present data not collected or curated by traditional/ professional sources.  Additionally, VGI has been shown to provide positive emotional value to users, not only in functionality, but also in satisfaction, social connection, and ethics.

I created a simple (and fun!) app to collect VGI on most wanted Police suspects.  I used four famous James Bond villains as my suspects (Dr. No, Goldfinger, Jaws and Oddjob) and created a form for any user to record any sightings of these murderous hoodlums.

Here is where I spotted the…

Recent Earthquakes

I created a web app the mapped recent earthquakes in the world based on data from the US Geological Survey (http://earthquake.usgs.gov/earthquakes/feed/v1.0/summary/2.5_week.csv).  To understand the potential impact of these earthquakes, I added a layer that showed the population of the world's major cities (Esri's World's Cities layer).  Some countries with large populations (China, India, Indonesia) lie in areas that are prone to earthquakes.  Some less populated countries (eg New Zealand) are also in earthquake prone areas.  The other observation is that there is significant and regular seismic activity in the Indian and Pacific Oceans especially when compared to the Atlantic Ocean.  Here is the web map that I created:



I also created an interactive web app based on this data.  To view the web app in all its glory, go here: http://arcg.is/2llj9Qd

What conclusions can you draw from this data?

US City-wise Population Growth and Unemployment

I conducted some basic analysis of US population growth in the 50 most populated US cities since 2010 and compared that with the unemployment rate in these cities.  Not surprisingly, there were some clear correlations: cities with high unemployment rates saw low population growth and vice versa.  Some highlights from the analysis:

The four cities with the most population growth since 2010 are Austin, Denver, New Orleans and CharlotteThe two cities with negative population growth since 2010 are Detroit and Cleveland. Here is the web map that I created:



I also created an interactive web app based on this data.  To view the web app in all its glory, go here: https://tinyurl.com/hzp4flj
What conclusions can you draw from this data?

A tour of Melbourne's sporting arens

I have recently started using Esri's Web GIS called ArcGIS Online.  As my first attempt at putting together a "story map", I decided to showcase some of Melbourne's main sporting arenas.  For those of you that have not been there, Melbourne is not only the world's most beautiful city (IMHO) but is also the world's undisputed sporting capital (IMHO again).

So picking just a few of the many (many!) sporting arenas in Melbourne to showcase in my story map was relatively easy.  I didn't need to do any research - they were all top of mind for me.

Here's a link to my story map tour of Melbourne's sporting arenas.  I hope you enjoy the tour!