Using R with data sets from data.world

Recently I found out about a wonderful website, data.world, which is kind of like a social/collaboration site for data sets. I highly recommend checking it out. If nothing else, it has numerous data sets for you to learn and build from.

I found a data set that contains NCAA March Madness results dating back to 1985. One of the things that I really like about data.world are its built in features. For one, you can explore data sets right within the website and run SQL queries to return views of the data that are of interest to you.

If you are not familiar with SQL, it is worth exploring, but I won’t go into it here. Instead, I’ll show you the simple queries I made to return appearances made in the tournament by Creighton and Nebraska:

SELECT * FROM `Big_Dance_CSV` where Big_Dance_CSV.Team="Creighton" or Big_Dance_CSV.`Team(2)`="Creighton"
SELECT * FROM `Big_Dance_CSV` where Big_Dance_CSV.Team="Nebraska" or Big_Dance_CSV.`Team(2)`="Nebraska"

For these queries to really make sense, you need to be familiar with the columns that exist in the data set. With this particular data set, there are columns for Home and Away teams (Team and Team(2)) so I asked for any results where one of the team was Creighton or Nebraska.

Another feature that I absolutely love about data.world is how is easy it is to take the data and place it into R Studio. By selecting Export > Copy R Code, you add the R code necessary to create a data frame in R of the SQL query you created. So simple. Here is what it gave me for my Creighton query:

df <- read.csv("https://query.data.world/s/dnhmq1rfdbdw18tg7jkfl0dmt",header=T);

That created this data frame in R for me to work with:

Year

Round

Region

Seed

Score

Team

Team.2.

Score.2.

Seed.2.

1

2001

1

3

7

69

Iowa

Creighton

56

10

2

2002

1

4

5

82

Florida

Creighton

83

12

3

2002

2

4

4

72

Illinois

Creighton

60

12

4

2003

1

2

6

73

Creighton

Central Michigan

79

11

5

2005

1

2

7

63

West Virginia

Creighton

61

10

6

2007

1

4

7

77

Nevada

Creighton

71

10

7

2012

1

4

8

58

Creighton

Alabama

57

9

8

2012

2

4

1

87

North Carolina

Creighton

73

8

9

2013

1

1

7

67

Creighton

Cincinnati

63

10

10

2013

2

1

2

66

Duke

Creighton

50

7

11

2014

1

3

3

76

Creighton

Louisiana Lafayette

66

14

12

2014

2

3

3

55

Creighton

Baylor

85

6

13

1989

1

1

3

85

Missouri

Creighton

69

14

14

1991

1

1

6

56

New Mexico St

Creighton

64

11

15

1991

2

1

3

81

Seton Hall

Creighton

69

11

16

1999

1

3

7

58

Louisville

Creighton

62

10

17

1999

2

3

2

75

Maryland

Creighton

62

10

18

2000

1

2

7

72

Auburn

Creighton

69

10

From there, I created this pretty simple bar graph with ggplot that displays when the Jays appeared in the tournament and what round they made it to. All in all it took me well under an hour.

And for the Huskers as well:

Hope this example shows how easy it is to take data.world data and create something in R. You could, of course, pull the entire data set into R as well to do data analysis, build models, etc. but this is a good start.

The Pros and Cons of Learning R for Digital Marketers

For me, it is worth the time I have spent (and will continue spending) to learn the R programming language. I work in the digital marketing space and while I do not believe it is necessary for everyone to learn R, I would recommend giving it a go if you are already interested.

Here are some of the pros and cons as I see them:

PROS

  • It’s difficult to deal with very large data sets in Excel, so R is a language and environment where you can analyze large data sets in a relatively fast and powerful way
  • There’s so much you can do — from connecting to APIs to statistical analysis to forecasting to word clouds to modeling to clustering to creating interesting visuals (I could go on)
  • It’s not THAT difficult to learn and there is a tremendous community of people just like you and me who are contributing daily so that we can more or less copy and paste their work in order to apply it to our data

CONS

  • It does take some time and dedication to learn what you need to know in R
  • Excel is pretty great. It works well for most things like reporting and data analysis. It’s only when we are talking about using extremely large data sets or doing analysis outside of Excel’s capabilities where R is necessarily needed.
  • Even if you figure out how to use R, you should still practice responsibility when it comes to forecasting, regression, etc. In other words, you really should learn the nuances of those disciplines as well in order to make sure your analysis is accurate.

Anything I am missing? Please feel free to leave your thoughts below and continue the conversation!

Some Basic Thoughts on Data Visualization

Data visualization is the art and science of clearly communicating data in a way that is easily digestible to the end user. It goes without saying that there is so much data available now. But effectively making sense of that data is critically important. That’s when data really becomes useful information.

Excel can do some things. You are all likely familiar with their built-in line graphs, pie charts and other visualizations. But it is limited in the amount of data you can work with and the customization of visuals. For many scenarios it just fine.

But there are times when one might have more data to work with or perhaps does not have a great way to get data to Excel in the first place. There are tools out there like Tableau that can connect to APIs (or you can import the data) and have a rich library of visualizations and ways to customize them. Tableau in particular has a free “Public” version available however the output will be placed on their website for anyone to see. If you are a business or agency that wants to keep your data private, a paid version is out there as well.

Recently Google announced their version of Tableau — Data Studio. There is a free version here as well and I think you can choose to keep your data private. However, at least as of June 2016, it only connects to other Google platforms. If you want to pull other data into the user interface, it is possible, but you first need to get it into Google Sheets or Big Query, which is a Google SQL database more or less. Big Query is its own topic for another day.

I have only scratched the surface on what is out there. For R users, you can download and work with libraries like ggplot2; QlikView is another Tableau-esque tool; and on and on. Check out this website for a few more examples, which are cleverly broken out tools for developers and non-developers: http://thenextweb.com/dd/2015/04/21/the-14-best-data-visualization-tools/#gref.

How to Pull API Data Into Excel

Pulling API data into Excel is quite a bit easier than what I expected. The most difficult part is understanding how to build the URL you will use to request the data.

In my case, I have been working with the Sportradar API to analyze Husker football data. The first step for me was to get an API key that allows me to get back data from Sportsradar.  Once I had that, it was simply a matter of taking these simple steps:

  1. Open a new Excel workbook
  2. Click on the Data tab in Excel
  3. Click From the Web
  4. Enter the API URL

It’s as easy as that. Unless you have come across an error you should have your data tables listed in Excel.

If you are interested in using the Sportsradar API, checkout http://developer.sportradar.us/

Hello world!

In August of 2015 I created Four Zero Two, a Husker data blog. The site was created as somewhat of a playground for me to explore a number of things related to data analytics including creating and manipulating a database, pulling information from the database, analyzing data and data visualization.

This is done through a number of languages, tools and software including (but not limited to) SQL, WordPress plugins, cPanel, R, R Studio, Excel and Tableau.

Throughout this journey, I will do my best to identify and share which of these tools are most useful and their best applications.