Shanlin Liu's Email Addresses & Phone Numbers

Staff Data Platform Engineer @ Broadcom Inc. Technical Lead @ Fox Technologies Design and Implemented FoxT Compliance Management System. From August 2006 to March 2007 (8 months) San Francisco Bay AreaPrincipal Data Platform Engineer @ Symantec . Designed and implemented Symantec Data Platform Provisioning Automation System (ODIN). Configured and deployed data platform clusters with ODIN on Amazon...

Staff Data Platform Engineer @ Broadcom Inc. Technical Lead @ Fox Technologies Design and Implemented FoxT Compliance Management System. From August 2006 to March 2007 (8 months) San Francisco Bay AreaPrincipal Data Platform Engineer @ Symantec . Designed and implemented Symantec Data Platform Provisioning Automation System (ODIN). Configured and deployed data platform clusters with ODIN on Amazon web services (AWS) - HDP Hadoop Stack, Kerberos Server, Kafka, Storm, Spark, and ElasticSearch. Developed Streaming data ingestion pipelines with Kafka-Spark, Kafka-Storm, and Kafka. Developed REST API for DPE cluster services including Storm, Kafka, HDFS, and Oozie. Secured Hadoop HDFS/YARN, HBase, Phoenix, Kafka with Kerberos. Administer and troubleshoot critical clusters for all environments (Prod, Stage, Dev). Act on-call support . Received Symantec CPE(Cloud Platform Engineering) Smooth Operator Award From January 2016 to November 2019 (3 years 11 months) Senior Big Data Engineer @ Apollo Education Group Designed and Implemented Apollo data pipelines from various data sources to HDFS/HIVE and HBase. Using Technologies: Java, Map/Reduce, Web Services, Amazon S3, FTP, Multithreading, , HDFS, HBase, Hive, Oozie, Avro, MRUnit and Cloudera Manager.Ingesting real time data into Hadoop HDFS with Flume.Using Sqoop to import data from Oracle tables to HDFS/Hive, and export data from HDFS to MySQL for data ingestion and reporting.Wrote Oozie workflow and coordinator for scheduling hadoop jobs.Performed complex queries on the tables in Hive for reporting and analysis.Monitoring more than 50 Hadoop jobs on Prod cluster, and troubleshooting failed actions and tasks.Provided assistance, code review and solution related to Hadoop technologies to other teams.Migration of many more than 50 existing Hadoop Oozie jobs and data to CDH4 cluster with Kerberos authentication from CDH3. From October 2011 to December 2015 (4 years 3 months) San Francisco Bay AreaSenior Software Engineer @ Casabi(Acquired by BroadSoft) Designed and implemented SMS(Short Message Service) using standardized communications protocols (SMPP) to route text messages among home phone and mobile devices over different carriers.Developed Data Aggregator to periodically pull data from resource companies into casabi repository.Implemented Infophone Web Portal for home cordless handset. From April 2007 to October 2010 (3 years 7 months) San Francisco Bay AreaSenior Software Engineer @ Serus Resigned Sales Order Management and Purchase Order Management with Web 2.0 UI infrastructure and the look & feel of user interface.Enhanced ReOrder Point Sizing (ROP) application used for helping the planner determine what the best ROP number is to meet future demand. Designed and developed Approval Process Management Configuration.Developed Order Consolidation project. From August 2005 to August 2006 (1 year 1 month) San Francisco Bay AreaSenior Software Engineer @ Skire(Acquired by Oracle) Architected and implemented Cost Manager System of Skire Unifier. The system provides unparalleled visibility into the financial health of a project or portfolio of projects, with the ability to drill down multiple levels to the underlying data or document. Architected and developed Funding Source Manager System of Skire Unifier. The system enables users to track and control how various sources of project funding are being consumed. Designed and implemented Core Modules of Skire Unifier, such as: System Admin (User, Group, Address, Company, Product, Role and Permission), Customizing Business Process (workflow), and shared components (User picker, Group picker, Company picker, Project picker).Designed and developed Web 2.0 User Interface Library written in JavaScript for building richly interactive web applications Responsible for database design and administration to support Skire web applications (Oracle and MS SQL server) From January 2000 to August 2005 (5 years 8 months) San Francisco Bay Area