Senior Data Engineer – Cloud-Based Data Pipeline Development
Are you a detail-oriented and passionate individual with a knack for data management? Do you want to contribute to the enchanting universe of Disney while working flexibly from the comfort of your home? Look no further! arenaflex is seeking a highly skilled Senior Data Engineer to join our team as a remote worker. As a Senior Data Engineer, you will play a crucial role in planning and executing ETL/ELT data pipelines, designing and implementing data set mapping/tables/perspectives, and building batch processes using Apache Wind current for various projects.
About arenaflex
arenaflex is a leading entertainment and media conglomerate that has been a part of our lives for generations. With a rich legacy of creating magic through storytelling, music, and film, we are committed to innovation and excellence in all aspects of our business. Our Data Management team is at the forefront of this innovation, using cutting-edge technologies to drive business growth and customer satisfaction.
Job Summary
As a Senior Data Engineer, you will be responsible for collaborating with our Studios or Project Innovation colleagues in various exercises around data requirements gathering, data approval prearranging and survey, creating and checking ETL/ELT data pipelines, designing and implementing data set mapping/tables/perspectives, and arrangement across multiple environments like DEV, QA/UAT and Prod. You will use a wide range of innovations to satisfy the work, including but not limited to SQL, Python, Docker, Gitlab, Wind current, Snowflake, Looker, and PostgreSQL.
Key Responsibilities
* Collaborate with cross-functional teams to design and implement data pipelines, data set mapping/tables/perspectives, and batch processes using Apache Wind current
- Plan and execute ETL/ELT data pipelines, ensuring data quality, accuracy, and timeliness
- Design and implement data set mapping/tables/perspectives, ensuring data consistency and integrity
- Build and maintain data pipelines using SQL, Python, Docker, Gitlab, and other relevant technologies
- Work with cloud-based technologies, including AWS and S3, to design and implement scalable and secure data solutions
- Participate in driving best practices around data engineering software development processes
- Collaborate with data scientists and analysts to design and implement data visualizations and reporting tools
- Stay up-to-date with emerging trends and technologies in data engineering and apply them to improve data management processes
Essential Qualifications
* 2+ years of experience with SQL
- 2+ years of experience planning, building, and maintaining ETL/ELT data pipelines
- 2+ years of experience with cloud-based technologies, ideally AWS and S3
- 3+ years of experience in a Data Engineering role
- Strong understanding of data engineering principles and practices
- Experience with Apache Wind current, Databricks, and other big data technologies
- Experience working with large datasets and big data technologies, ideally cloud-based, like Snowflake, Databricks, or similar
- Strong problem-solving skills and attention to detail
Preferred Qualifications
* Experience with Wind current, Gitlab, Snowflake, and other relevant technologies
- Graduate degree in Computer Science, Science, Engineering, or a related field
- Experience in streaming, media, or digital marketing industries
- Strong understanding of data visualization and reporting tools, such as Looker and Tableau
Least Capabilities and Training
* Four-year degree in Computer Science, Science, Engineering, or a related field
- 2+ years of experience in a Data Engineering role
- Strong understanding of data engineering principles and practices
- Experience with SQL, Python, Gitlab, Wind current, AWS S3, and social data sets
- 2+ years of experience working with a cloud stage
- 2+ years of experience working with data lakes, data warehouses, and application data sets
What will separate you
* Experience with Wind current, Gitlab, Snowflake, and other relevant technologies
- Strong understanding of data engineering principles and practices
- Experience working with large datasets and big data technologies, ideally cloud-based, like Snowflake, Databricks, or similar
- Strong problem-solving skills and attention to detail
- Ability to work collaboratively with cross-functional teams
Why work at arenaflex?
* Opportunity to work with a leading entertainment and media conglomerate
- Flexible remote work arrangement
- Collaborative and dynamic work environment
- Opportunities for career growth and professional development
- Competitive compensation and benefits package
- Access to cutting-edge technologies and tools
- Recognition and rewards for outstanding performance
How to apply
If you are a motivated and detail-oriented individual with a passion for data management, we encourage you to apply for this exciting opportunity. Please submit your resume and a cover letter explaining why you are the ideal candidate for this role. We look forward to hearing from you! Apply Job! For more such jobs please click here! Apply for this job