Senior Software Engineer - Data Engineering

Overview

This is a remote role that may only be hired in the following locations: NC, NJ, FL, AZ This position is responsible for development/support of Enterprise data processing systems through enhancement of related software and processes. Develops software and procedures that improve processing capabilities. Analyzes, codes, tests, and implements in coordination with management, associates, and end users. Serves as production system support by resolving issues and ensuring ongoing functionality. May oversee the work of less experienced analysts or assist in special projects as needed. Responsibilities • Data Integration - Provide data integration services for all batch/ real-time data Movement in data warehouse, data platforms (data lake) and dependent data marts (Cloud/OnPrem) • Data Analysis - Sources, compiles, and interprets data. Performs analysis for accuracy and efficiencies, effectively communicates analysis output. • Technical Proficiency - Provides technical support by performing coding, ensuring processes run smoothly, and working to continuously improve processing capabilities. Works closely with technical and operation teams to support their business objectives. • System Testing - Thoroughly tests data integration, data warehouse, data marts to ensure accuracy, completeness, and overall efficiency. Evaluates and conveys testing results. Performs coding and assists in implementing system modifications and enhancements. • Ensure that new solutions meet defined technical, functional, and service level requirements and standards and manage the end-to-end lifecycle for new data migration, data integration, and data services-oriented solutions. • Additionally, the Senior Data Software Engineer will engage with partners in testing, release management, and operations to ensure quality of code development, deployment, and post-production support.

Qualifications

Bachelor's Degree and 4 years of experience in Software application development and maintenance OR High School Diploma or GED and 8 years of experience in Software application development and maintenance Preferred area of experience: • 5+ Years of Experience in designing & building data pipeline/ETL Frameworks with cloud-based data technologies (Preferred AWS Cloud Services Skills) • 8+ years of experience in creating and maintaining ETL processes and architecting complex data pipelines - knowledge of data modeling techniques and high-volume ETL/ELT design. • 3+ years of Experience with data warehousing/Data Lake solutions using Snowflake, AWS- Redshift. • 5+ years of Experience with ETL and Data Ingestion tools such as (Informatica IICS, AWS Glue, SAP BODS) • Experience in programming languages such as ANSI-SQL, Python, Scala, and/or Java • Extensive knowledge of data warehouse principles, design, and data modeling concepts. • 1+ years of experience in designing data privacy related constructs to enable data tokenization, encryption & data access controls on a public cloud data lake • 3+ years of experience in Data Engineering related AWS services like Lake formation, Glue, S3, Lambda, DynamoDB and other AWS accelerators • 3+ years of experience in Bigdata technologies like Hadoop, Hive, SPARK, No-SQL DB, Kafka and API • Experience in leading team of engineers across geography • Use agile engineering practices and various data development technologies to rapidly develop creative and efficient data products • Identify inefficiencies, optimize processes and data flows, and make recommendations for improvements • Communicate with other developers across teams, both for ad hoc problem solving, and check-ins/discussions with other initiatives Technical Skills : Snowflake, AWS Services like S3, Glue, Lambda, DynamoDB, Redshift, Redshift spectrum, Lake formation, Sagemaker, Quicksight, Athena Scripting and languages: Python, SQL , PySpark, Hive ETL tools like Informatica IICS, SAPBODS, Datastage #LI-XG1 Apply Job!