Experienced Full Stack Data Engineer – Cloud and Big Data Application Development at arenaflex
About arenaflex
At arenaflex, we're on a mission to revolutionize the way we interact with data, leveraging cutting-edge technologies to drive innovation and growth. As a leading player in the entertainment and media industry, we're constantly pushing the boundaries of what's possible, and we're looking for talented individuals to join our team. Our Information and Investigation group for arenaflex Web-based features (DSS) is a key part of our Disney Diversion and ESPN Innovation (DE&ET) division, and we're seeking a highly skilled Lead Data Engineer to help us take our data capabilities to the next level.Job Summary
We're looking for a seasoned Data Engineer with a passion for Big Data and Cloud technologies to lead our data engineering efforts. As a Lead Data Engineer, you'll be responsible for designing, developing, and implementing scalable data solutions that meet the needs of our business stakeholders. You'll work closely with our Information Item Chiefs, Information Modelers, and Information Architects to ensure that our data solutions are aligned with our overall business strategy. If you're a data enthusiast with a strong technical foundation and a passion for innovation, we want to hear from you!Key Responsibilities
- Add to the plan and development of our data items and data distribution centers around Commitment and Maintenance Examination and Information Science
- Plan and develop versatile information warehousing arrangements, building ETL pipelines in Large Information conditions (cloud, on-prem, hybrid)
- Help engineer data arrangements/structures and define data models for the core data warehouse and data shops
- Team up with Information Item Chiefs, Information Modelers, and Information Architects to design, implement, and deliver successful data solutions
- Keep up with detailed documentation of your work and changes to help data quality and data administration
- Guarantee high operational productivity and quality of your solutions to meet SLAs and support obligation to our clients (Information Science, Information Examination groups)
- Be a functioning member and supporter of agile/scrum practice to ensure well-being and cycle enhancements for your group
Key Capabilities
- Solid SQL abilities and capacity to make inquiries to separate information and fabricate performant datasets
- Involved insight with dispersed frameworks like Hadoop (HDFS, Hive, Voila, PySpark) to inquiry and cycle information
- Solid programming abilities in Python, Java/Scala
- Experience with somewhere around one significant MPP or cloud information base innovation (Snowflake, Redshift, Large Inquiry)
- Strong involvement in data reconciliation toolsets (i.e Wind current) and composing and keeping up with Information Pipelines
- Solid in Information Demonstrating strategies and Information Warehousing standard systems and practices
- Acquainted with Scrum and Agile approaches
Preferred Qualifications
- Experience with Cloud advances like AWS (S3, EMR, EC2)
- Strong involvement in data governance and data quality initiatives
- Experience with data visualization tools like Tableau or Power BI
- Strong communication and collaboration skills