Software Engineer @ Architect and develop core parts of a storm-based rules-system including designing and implementing algorithms for mapping of entities across multiple connection channels. Driving efforts on significant performance improvement, robustness, flexibility, and testability From April 2014 to Present (1 year 9 months) Greater Seattle AreaSenior Software Development Engineer @ Enabling near real time analytics on data warehouse data, using Hadoop, HBase, Storm, and generic APIs. Strong experience with scalability and performance measurement. From May 2012 to April 2014 (2 years) Software Development Lead @ Lead developer of team responsible for large-scale distributed platform enabling near-real-time search and analytics of social media content. Built on technologies including Hadoop, MapReduce, HBase, Lucene, Katta, Memcached, ZooKeeper, Linux, and Java.
Optimized Map Reduce jobs through improved algorithms and scalability, reducing memory consumption, and better utilization of cluster resources.
Designed and architected REST APIs for external consumption of enriched social media content and trends.
Independently prototyped, developed, and released a statistical n-gram language detection service for use with short and specialized social media content, such as Twitter feeds.
Improved throughput of content ingestion pipeline by 35x through new algorithms, data parallelism, reduced shared data contention, and architectural scalability.
Developed content enrichment services for classifying tone and relevance of social media content, based on an open-source adaptive boosting classifier. From February 2010 to May 2012 (2 years 4 months) Software Design Engineer @ Developer responsible for the following namespaces over the course of three release cycles (Orcas, Silverlight 2+, .NET 4): System.Collections, System.Collections.Generic, System.IO, and System.Resources. This involved setting technical direction, as well as design and implementation of features in these namespaces. Developed in C# and C++. From May 2006 to November 2009 (3 years 7 months) Software Engineer @ Researched and developed prototypes for the Global Positioning System (GPS) proposal demonstration, focusing on errors due to atmospheric conditions, correction techniques, and simulation of results in a web portal.
Created and implemented algorithms to acquire moving targets in the Automated Mission Planner (AMP). Added maritime sensor modeling, including sensor pointing capabilities. Added cross-cueing sensors (sensors that can refine a target’s position) into the mission planning strategy.
Designed satellite scheduling algorithms and implemented in C++ (STL). From June 2002 to May 2006 (4 years)
M.S., Applied Math/C.S. @ Cornell UniversityB.S., Mathematics @ The University of Texas at Austin Kim Duffy is skilled in: Algorithms, Scalability, Data Science, Big Data, Java, Software Development, HBase, Artificial Intelligence, Apache Spark, Statistics, Data Mining, Applied Mathematics, Numerical Analysis, Machine Learning, MapReduce