Lead Data Engineer

Overview

We are seeking a highly skilled and experienced Azure Data Engineer to join our dynamic team. In this critical role, you will be responsible for designing, developing, and maintaining robust and scalable data solutions on the Microsoft Azure platform. You will work closely with data scientists, analysts, and business stakeholders to translate business requirements into effective data pipelines and data models. Responsibilities • Design, develop, and implement data pipelines and ETL/ELT processes using Azure Data Factory, Azure Databricks, and other relevant Azure services. • Develop and maintain data lakes and data warehouses on Azure, including Azure Data Lake Storage Gen2 and Azure Synapse Analytics. • Build and optimize data models for data warehousing, data marts, and data lakes. • Develop and implement data quality checks and data governance processes. • Troubleshoot and resolve data-related issues. • Collaborate with data scientists and analysts to support data exploration and analysis. • Stay current with the latest advancements in cloud computing and data engineering technologies. • Mentor junior data engineers and contribute to the development of best practices. • Participate in all phases of the software development lifecycle, from requirements gathering to deployment and maintenance. Compensation and Benefits: • The expected compensation range for this position is between $89,000 - $149,000. • Location, confirmed job-related skills, experience, and education will be considered in setting actual starting salary. Your recruiter can share more about the specific salary range during the hiring process. • Bonus based on performance and eligibility target payout is 10% of annual salary paid out annually. • Paid time off subject to eligibility, including paid parental leave, vacation, sick, and bereavement. • In addition to salary, PepsiCo offers a comprehensive benefits package to support our employees and their families, subject to elections and eligibility: Medical, Dental, Vision, Disability, Health, and Dependent Care Reimbursement Accounts, Employee Assistance Program (EAP), Insurance (Accident, Group Legal, Life), Defined Contribution Retirement Plan. Qualifications • 10+ years of experience in data engineering, with at least 5 years of experience working with Azure data services. • Strong proficiency in SQL, Python, and other relevant programming languages. • Experience with data warehousing and data lake architectures. • Experience with ETL/ELT tools and technologies, such as Azure Data Factory, Azure Databricks, and Apache Spark. • Experience with data modeling and data warehousing concepts. • Experience with data quality and data governance best practices. • Strong analytical and problem-solving skills. • Excellent communication and collaboration skills. • Experience with Agile development methodologies. • Bachelor's degree in Computer Science, Engineering, or a related field required (Master's degree preferred). • Relevant Azure certifications (e.g., Azure Data Engineer Associate) are a plus. Bonus Points: • Experience with machine learning and artificial intelligence. • Experience with containerization technologies (e.g., Docker, Kubernetes). • Experience with DevOps practices and tools. > Our Company will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of the Fair Credit Reporting Act, and all other applicable laws, including but not limited to, San Francisco Police Code Sections 4901-4919, commonly referred to as the San Francisco Fair Chance Ordinance; and Chapter XVII, Article 9 of the Los Angeles Municipal Code, commonly referred to as the Fair Chance Initiative for Hiring Ordinance. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, or disability status. PepsiCo is an Equal Opportunity Employer: Female / Minority / Disability / Protected Veteran / Sexual Orientation / Gender Identity If you'd like more information about your EEO rights as an applicant under the law, please download the available EEO is the Law & EEO is the Law Supplement documents. View PepsiCo EEO Policy. Please view our Pay Transparency Statement Apply Job!