Apache Hive Committer @ The Apache Software Foundation
Principal Engineer, Hadoop @ Yahoo
Firmware Engineer @ Hewlett-Packard
Education:
No education info found.
About:
I'm a Hadoop Engineer at Yahoo, working on Apache Hive (and other generally Hadoop-ish tomfoolery) at Yahoo-scale. In a past life, I worked at Hewlett-Packard, writing firmware for HP big-iron boxen (for detection of hardware faults, diagnosis and self-healing).
I am prone to violent flare-ups on account of C++ withdrawal.
Apache Hive Committer @ I work on Apache
I'm a Hadoop Engineer at Yahoo, working on Apache Hive (and other generally Hadoop-ish tomfoolery) at Yahoo-scale. In a past life, I worked at Hewlett-Packard, writing firmware for HP big-iron boxen (for detection of hardware faults, diagnosis and self-healing).
I am prone to violent flare-ups on account of C++ withdrawal.
Apache Hive Committer @ I work on Apache Hive, at Yahoo. My focus thus far has been metastore-scalability, system integration with Apache Pig/Oozie/data-loading and query performance for large partition-counts.
Prior to this, I was an Apache HCatalog committer.
I have some experience with tuning Hive/HCatalog for performance, some of which I have shared through presentations at the Hadoop Summit (San Jose) and the Strata+Hadoop World conference in New York, as well as Apachecon. From April 2015 to Present (9 months) Principal Engineer, Hadoop @ I'm an Apache HCatalog committer and longtime Hive contributor. I work on scaling Apache Hive to Yahoo's definition of "Internet Scale". I've worked in the past on benchmarking Hive 0.13+ at scale, identifying performance bottlenecks and fixing them. I've primarily focused on improving Hive metastore performance, and on improving execution-times for queries that span hundreds of thousands of partitions.
I've also worked on system integration, so that Apache Pig/Oozie, data-loading applications like (Yahoo internal) Grid Data Management and Apache Falcon can interact with Hive efficiently. From August 2009 to Present (6 years 5 months) Firmware Engineer @ From October 2001 to August 2009 (7 years 11 months)