SportCon

Analyzing data can sometimes be just the last step in a long road of gathering, transforming, and manipulating. Until recently, enterprise-level tools or complex custom-coded systems have been the only options to get the data where you want it to be in any ongoing, manageable way. The new world of 'the cloud', however, has made it possible for anyone to easily build a lightweight, cheap system for automated collection and management of their data. See this in action, with a walk-though of a working open-source 'datalake' system in Microsoft Azure, where NFL 'Game center' JSON data is pulled from the web, transformed, and loaded to database tables, all in an automated updating process, for just a few dollars a month, without any dedicated computer, server or virtual machine.