Lead Data Engineer
Dublin, California
Groupon
Senior Data Engineer
June 2017 to February 2019
Palo alto
PayPal
Lead Data Engineer
January 2016 to May 2017
San Jose CA
RS Software
Data Architect
June 2013 to December 2015
Pleasanton, California, United States
CSC
Programmer Analyst Leader
February 2011 to May 2013
Pleasanton CA
Signature Consultants
ETL Developer
May 2009 to January 2011
Tampa/St. Petersburg, Florida Area
Tata Consultancy Services
Technical Consultant
May 2005 to April 2009
Chennai, Tamil Nadu
Edelman Financial Engines
Staff Data Engineer
Sunnyvale,CA
Hi Cap
Senior Application Programmer
November 2002 to April 2005
Chennai, Tamil Nadu
• Led a team of engineers and build and design the Mobile Events Platform• Collect and consolidate the large datasets from Marketing, Sales and Finance and provide meaningful analytics • Develop the near real time process on click stream events from App, touch and web through Kafka streams.• Design and Development of batch and streaming data pipeline... • Led a team of engineers and build and design the Mobile Events Platform• Collect and consolidate the large datasets from Marketing, Sales and Finance and provide meaningful analytics • Develop the near real time process on click stream events from App, touch and web through Kafka streams.• Design and Development of batch and streaming data pipeline using AWS,Spark, Scala and Python framework• Troubleshooting and Performance on complex big data pipelinesSpark, Scala, Java, Python, Hive, Kafka, Splunk, Cassandra, Elastic Search, Teradata,AWS, Opswise,Git, Docker
📖 Summary
Senior Data Engineer @ Groupon • Led a team of engineers and build and design the Mobile Events Platform• Collect and consolidate the large datasets from Marketing, Sales and Finance and provide meaningful analytics • Develop the near real time process on click stream events from App, touch and web through Kafka streams.• Design and Development of batch and streaming data pipeline using AWS,Spark, Scala and Python framework• Troubleshooting and Performance on complex big data pipelinesSpark, Scala, Java, Python, Hive, Kafka, Splunk, Cassandra, Elastic Search, Teradata,AWS, Opswise,Git, Docker From June 2017 to February 2019 (1 year 9 months) Palo altoLead Data Engineer @ PayPal Worked in Merchant Analytics Platform• Architect and Build Merchant Big Data Platform as single source of truth for internal and external use cases• Data Ingestion and transformation from Oracle, Teradata and third party platform into Hadoop through Kafka• Developed end to end pipeline for Aggregates and Snapshot on consumer and payments datasets us-ing Spark Scala framework and Kafka • Data persistence in Elastic Search Data store for faster query processing from Serving Layer. Build Lambda architecture on spark framework and Hbase for Webpage click stream datasets on con-version and fallouts• Developed Monitoring/alerting Platform using Grafana, OpenTSDB on message events on Kafka and Elastic Search clusters• Developed Disaster recovery plan and storage estimates on each stage on pipeline.Spark, Scala, Java,Python, Hive, Yarn, Kafka, Elastic Search, Grafana, OpenTsDB, Teradata and Oracle, Tab-leau, UC4 From January 2016 to May 2017 (1 year 5 months) San Jose CAData Architect @ RS Software Bank of the West and Ellie Mae Projects • Implemented Reference Data Hub, MDM customer Master for BOW, collecting code value pair data sets and external systems like securities data as well in ODS• Worked on establishing the Big Data standards, software architecture and functional specifications for development, Data quality, Retention, tuning and implementations• Responsible for Analysis, Design, Data modeling and BI report solutions using Spark, Erwin, Oracle, In-formatica, Microsoft and OBIEE• Work closely with the product management and development teams to rapidly translate the under-standing of customer data and requirements to product and solutions.Oracle, Spark, Hadoop, Erwin, Informatica, Microsoft MDS, SSIS, OBIEE From June 2013 to December 2015 (2 years 7 months) Pleasanton, California, United StatesProgrammer Analyst Leader @ CSC Visa CMLS store centrally Global Visa data and develops a single version of truth with Global BI Data Model to streamline and enhance key data for Clearing & settlement areas.• Worked on Visa Enterprise Data Warehouse system project, responsible for design, modeling and BI reporting solutions using Ab Initio 3.2.5, Hive, Pig, Hadoop streaming, Sqoop, Impala, Hbase, Flume• Analyze multiple sources of structured and unstructured data to propose and design data architecture solutions for scalability, high availability, fault tolerance, and elasticity.• Architect, Design and implement High performance large volume data processing using Ab Initio, Hive, Pig, Sqoop, Impala and Hbase• Developed Map Reduce programs to parse the raw data, populate staging tables and store the refined data in partitioned tables in the EDWMap reduce, Hive, Pig, Sqoop, Impala, Hbase, Python, Java, Ab Initio, Tableau, DB2 Oracle Exadata From February 2011 to May 2013 (2 years 4 months) Pleasanton CAETL Developer @ Signature Consultants Bank of America and Verizon’s projects. GDPP will central-ize feed control, feed data quality and SLA guidelines as defined by data customers.• Worked in Merrill lynch Data Conversion and Data Management Team on Data Extraction, Fictionaliza-tion, Subset, Data Cleansing, and Data Validation• Involved in all the stages of SDLC during the projects. Analyzed, designed and tested the new system for performance, efficiency and maintainability using ETL tool AB INITIO andDataStage• Responsible for requirement gathering, analysis and development for data synchronization with Bro-kerage, Annuity and Sales NFS Trades data.Oracle 11g, Ab Initio, Java, DataStage 8.1, UNIX, Oracle 11g, Teradata 6.0, Autosys From May 2009 to January 2011 (1 year 9 months) Tampa/St. Petersburg, Florida AreaTechnical Consultant @ Tata Consultancy Services Qwest MSO is the Data warehouse system and a part of the larger MDSS (Marketing Decision Support Systems) program of Qwest, a telecom service provider.• Involved in ETL design, coding using Ab Initio ETL tool in order to meet requirements for ex-tract, trans-formation, cleansing, and loading of data from source to target data structures• Prepared the estimation, design effort and SDLC documents for the enhancements and lead a team and responsible for on-time delivery of allocated DW project/project modules.• Created complex transformations and multifile system in using aggregate, scan, normalize, parallelism, rollup, de-normalize, conditional dml, sequence generator, lookup, joiner and stored procedure trans-formationsOracle 10g/11g, SQL*Loader, PL/SQL, SQL Server 2005, Teradata, DB2, Ab Initio Co>Op 2.14 GDE 1.14, UNIX, Auto-sys, XML, Informatica 7.1, Erwin, Trillium 7.6, Caliber, Dimensions, CONTROL-M From May 2005 to April 2009 (4 years) Chennai, Tamil NaduStaff Data Engineer @ Edelman Financial Engines • Design & build and collaborate with Product, marketing and sales team on define the growth strategy• Develop the data processing architecture and framework for processing the data from AWS Data lake S3, Lambda, Glue and persisting data in Redshift using Spark, Python, Airflow• Build the Data Quality and Data Governance framework on Data Lake S3 using Data Catalog and Crawler • Improve the SLA and maintain the Production strategy to convert the batch processing jobs into near real time • Implement Infrastructure as code(Iac) and CICD pipeline using Terraform and AnsibleSpark, Python, AWS, Redshift, Airflow,Tableau, Splunk, Gitlab,Terraform, Ansible Sunnyvale,CASenior Application Programmer @ Hi Cap KLSB’s mission is to become one of the worldwide leading container shipping groups offering its customers top quality, door-to-door solutions and increasingly comprehensive global coverage. Created Ab Initio graph for extracting the records from various sources like DB2 and SQL server environment. Oracle 8i/9i, Autosys, PL/SQL Developer, COBOL, SQL*Loader, TOAD 7.6, Oracle 6i Forms & Reports, Sybase, UNIX From November 2002 to April 2005 (2 years 6 months) Chennai, Tamil Nadu
What company does Murugesan Alagusundaram work for?
Murugesan Alagusundaram works for Groupon
What is Murugesan Alagusundaram's role at Groupon?
Murugesan Alagusundaram is Senior Data Engineer
What industry does Murugesan Alagusundaram work in?
Murugesan Alagusundaram works in the Information Technology and Services industry.
Who are Murugesan Alagusundaram's colleagues?
Murugesan Alagusundaram's colleagues are Elizabeth Linares, Erin Gates, Supriya Pangala, Ivonne Roberts, Adam Jurevicius, Christine CRPS®, Craig J. Engel, Alexander Yavorskiy, Renee Sitnik, and Sugey Vaca
Extraversion (E), Intuition (N), Feeling (F), Judging (J)
2 year(s), 4 month(s)
Unlikely
Likely
There's 85% chance that Murugesan Alagusundaram is seeking for new opportunities
Enjoy unlimited access and discover candidates outside of LinkedIn
One billion email addresses and counting
Everything you need to engage with more prospects.
ContactOut is used by
76% of Fortune 500 companies
Murugesan Alagusundaram's Social Media Links
/school/ni... /company/e...