MPC IT Blog The team and tech behind the world's largest demographic databases. http://tech.popdata.org Open Sourcing Code with Intention A quick guide to what you need to think about before you open source your code. Fri, 17 Feb 2017 00:00:00 +0000 http://tech.popdata.org/open-sourcing-code-with-intention/ http://tech.popdata.org/open-sourcing-code-with-intention/ Slurping Up Excel Data on the Quick: Python, Pandas, and Pickle If you have very large tables of data imprisoned in a vendor-locked Excel jail, consider setting them free by caching worksheets using Python+Pandas+Pickle. Tue, 14 Feb 2017 00:00:00 +0000 http://tech.popdata.org/Fast-Excel-Slurping-With-Pandas-And-Pickle/ http://tech.popdata.org/Fast-Excel-Slurping-With-Pandas-And-Pickle/ Towards a Sustainable Excel Building Excel Macros With Python, part 3 of a series on reinventing our metadata management environment. Fri, 03 Feb 2017 00:00:00 +0000 http://tech.popdata.org/Python-Powered-Excel-Macros/ http://tech.popdata.org/Python-Powered-Excel-Macros/ MPC IT Shark Tank - Cycles 4 & 5 Results! We closed out 2016 with two more rounds of Shark Tank! Read on for details. Tue, 03 Jan 2017 09:00:00 +0000 http://tech.popdata.org/Shark-Tank-Cycle-4-and-5-Results/ http://tech.popdata.org/Shark-Tank-Cycle-4-and-5-Results/ Automated Analysis of a Data Workflow - Part 2 The conclusion of the story of how we created DCP Analytics - our in-house automated, web-based analysis tool using Pandas, Bokeh, Jupyter and Conda to help our researchers quickly find data anomalies and processing errors in our data production pipelines.. Wed, 14 Sep 2016 00:00:00 +0000 http://tech.popdata.org/Jupyter-and-Bokeh-reports-part2/ http://tech.popdata.org/Jupyter-and-Bokeh-reports-part2/ Automated Analysis of a Data Workflow - Part 1 The story of how we created DCP Analytics - our in-house automated, web-based analysis tool using Pandas, Bokeh, Jupyter and Conda to help our researchers quickly find data anomalies and processing errors in our data production pipelines. Wed, 24 Aug 2016 00:00:00 +0000 http://tech.popdata.org/Jupyter-and-Bokeh-reports-part1/ http://tech.popdata.org/Jupyter-and-Bokeh-reports-part1/ MPC IT Shark Tank - Cycle 3 Results Cycle 3 of MPC IT Shark Tank wrapped up last month. Here's the scoop! Thu, 14 Jul 2016 09:00:00 +0000 http://tech.popdata.org/Shark-Tank-Cycle-3-Results/ http://tech.popdata.org/Shark-Tank-Cycle-3-Results/ Excel VBA and Version Control The second post in the series about Team Unicorn Rainbows' work in the first round of MPC IT Shark Tank. Thu, 19 May 2016 00:00:00 +0000 http://tech.popdata.org/unicorn-2-version-control/ http://tech.popdata.org/unicorn-2-version-control/ MPC IT Shark Tank - Cycle 2 Results Cycle 2 of MPC IT Shark Tank has concluded, and once again we have some fantastic results! Tue, 15 Mar 2016 09:00:00 +0000 http://tech.popdata.org/Shark-Tank-Cycle-2-Results/ http://tech.popdata.org/Shark-Tank-Cycle-2-Results/ Embracing the Uncertainty of Software Development Thoughts on how to avoid being fooled by the false certainty of deadlines and estimates and approach our work more honestly. Mon, 29 Feb 2016 00:00:00 +0000 http://tech.popdata.org/embrace-the-uncertainty/ http://tech.popdata.org/embrace-the-uncertainty/