Tuesday, 11 November 2014

a day in the life - test

The intro blog post outlined this comprehensive yet fundamental data management process:
  1. pull 50K lines of flat ASCII well data from the US BOEM (MMS in 2008)
  2. extract to a readable spreadsheet using the source government metadata
  3. transform that using free Talend Open Studio with data QC check tools
  4. load it into PPDM WELL table in SQL Server Express also a free tool
  5. post the data to MSFT Access or in QGIS, ArcMap and ArcGIS Online 
The result is a complete map of all the data in their geographic and economic context of Gulf of Maxico platforms, shipping lanes, leases and seismic anomalies (as in geologic types... not as in earthquakes!). please be patient - there are 50k wells to load - it may be small data but it's still a lot over the web!
..............

No comments:

Post a Comment