Experienced Full Stack Data Engineer – AI Research and Deployment

At arenaflex, we're pushing the boundaries of AI capabilities and delivering these innovations to the world safely. Our mission is to harness AI's potential to solve significant global challenges, sharing its benefits broadly. As a leading AI research and deployment company, we're seeking a skilled Data Engineer to lead the development of our data pipelines and foundational tables. These pipelines are crucial for powering analytics, enhancing security systems, informing business decisions, fostering product innovation, and preventing disruptions.

About arenaflex

arenaflex is a pioneering company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We strive to create a safer and more inclusive technological future by harnessing AI's potential to solve significant global challenges. Our team of experts is passionate about pushing the boundaries of AI capabilities and delivering these innovations to the world.

Job Summary

We're looking for an experienced Data Engineer to join our team and lead the development of our data pipelines and foundational tables. As a key member of our team, you will collaborate closely with our researchers to help train new models for deployment to our clients. Your data-driven insights will be instrumental in shaping arenaflex's future.

Responsibilities

* Design, build, and manage data pipelines, ensuring seamless integration of all client event data into our data warehouse.

• Develop standardized datasets to track key product metrics, including user growth, engagement, and revenue.
• Collaborate with teams across Infrastructure, Data Science, Product, Marketing, Finance, and Research to understand data needs and provide solutions.
• Implement robust, fault-tolerant systems for data ingestion and processing.
• Contribute to data architecture and engineering decisions, bringing strong insights and expertise.
• Ensure the security, integrity, and compliance of data according to industry and company standards.
• Work closely with our researchers to help train new models for deployment to our clients.
• Develop and maintain data visualizations and reports to inform business decisions and product innovation.
• Stay up-to-date with industry trends and emerging technologies, applying this knowledge to improve our data pipelines and foundational tables.

Qualifications

* Proficiency in at least one programming language commonly used in Data Engineering, such as Python, Scala, or Java.

• Experience with distributed processing technologies and frameworks like Hadoop, Flink, and storage systems such as HDFS and S3.
• Expertise in ETL schedulers like Apache Airflow, Dagster, or similar frameworks.
• Strong understanding of Apache Spark with the ability to write, debug, and optimize Spark code.
• Bachelor's degree in Computer Science, Data Engineering, or a related field.
• 3+ years of experience in Data Engineering, with a focus on data pipelines and foundational tables.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.

Essential Skills

* Programming languages: Python, Scala, Java

• Distributed processing technologies: Hadoop, Flink
• Storage systems: HDFS, S3
• ETL schedulers: Apache Airflow, Dagster
• Apache Spark: writing, debugging, and optimizing Spark code
• Data visualization tools: Tableau, Power BI
• Agile development methodologies: Scrum, Kanban

Preferred Qualifications

* Master's degree in Computer Science, Data Engineering, or a related field.

• 5+ years of experience in Data Engineering, with a focus on data pipelines and foundational tables.
• Experience with cloud-based data platforms: AWS, GCP, Azure.
• Knowledge of machine learning algorithms and their application in data engineering.
• Experience with data governance and compliance frameworks.

Benefits

* Competitive salary of $25/hour, inclusive of generous equity and benefits.

• Comprehensive medical, dental, and vision insurance for you and your family.
• Mental health and wellness support.
• 401(k) plan with a 4% company match.
• Unlimited paid time off and 18 company holidays annually.
• 20 weeks of paid parental leave and family-planning support.
• Opportunities for professional growth and development, including training and mentorship programs.
• Collaborative and dynamic work environment with a team of passionate and talented individuals.

Why Join arenaflex?

At arenaflex, we believe AI has the potential to help solve significant global challenges, and we aim to share AI's benefits broadly. By joining our team, you will be at the forefront of AI innovation, contributing to a safer and more inclusive technological future. Our team is passionate about pushing the boundaries of AI capabilities and delivering these innovations to the world. We're committed to creating a workplace that is inclusive, diverse, and supportive of our employees' growth and well-being.

How to Apply

If you're passionate about data engineering and AI research, and you're looking for a challenging and rewarding role, we encourage you to apply. Please submit your resume and a cover letter explaining why you're the ideal candidate for this role. We can't wait to hear from you! Apply Now! Apply for this job