Lead Data Engineer - Data Reliability

Description:

• The Data Reliability Engineering team for Disney’s Product and Data Engineering team is responsible for maintaining and improving the reliability of Disney Entertainment’s big data platform, which processes hundreds of terabytes of data and billions of events daily.
• The Lead Data Engineer will help us in the ongoing mission of delivering outstanding services to our users allowing Disney Entertainment to be more data-driven.
• You will work closely with our partner teams to monitor and drive improvements for reliability and observability of their critical data pipelines and deliverables.
• This is a high-impact role where your work informs decisions affecting millions of consumers, with a direct tie to The Walt Disney Company’s revenue.
• You will be making an outsized impact in an organization that values data as its top priority.
• We are a tight and driven team with big goals, so we seek people who are passionate about solving the toughest challenges and working at scale, using, supporting, and building distributed systems in a fast-paced collaborative team environment.
• We also support a healthy work-life-balance.

Requirements:

• 7+ years experience working on mission critical data pipelines and ETL systems, hands-on experience with big data technology, systems and tools such as AWS, Hadoop, Hive, and Snowflake
• Detailed problem-solving approach, coupled with a strong sense of ownership and drive
• A passionate bias to action and passion for delivering high-quality data solutions
• Expertise with common Data Engineering languages such as Python, Scala, Java, SQL and a proven ability to learn new programming languages
• Experience with workflow orchestration tools such as Airflow
• Deep understanding of end-to-end pipeline design and implementation.
• Attention to detail and quality with excellent problem solving and interpersonal skills
• Advanced degrees are a plus.
• Strong data visualizations skills to convey information and results clearly
• Ability to work independently and drive your own projects.
• Exceptional interpersonal and communication skills.
• Impactful presentation skills in front of a large and diverse audience.
• Experience with DevOps tools such as Docker, Kubernetes, Jenkins, etc.
• Innate curiosity about consumer behavior and technology
• Experience with event messaging frameworks like Apache Kafka
• A fan of movies and television is a strong plus.

Benefits:

• A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.