Big Data Engineer - PySpark
Company Description
We’re a ten-time “Best Company to Work For,” where intelligent, talented people come together to do outstanding work—and have a lot of fun while they’re at it. We offer a solution-focused environment full of collaboration and dedication, to our goals and to each other. You’ll have the opportunity to drive your own success in a supportive, globally connected environment. From advanced tools and technology to an immersive company culture, working at Logic20/20 means working on the leading edge, with a community of the right people around you.
Job Description
As a Big Data Engineer joining our AI & Analytics practice, you'll be responsible for delivering client value and ensuring high client satisfaction. You'll be expected to be adept at recognizing, subscribing to, and applying best practices, methodologies, tools, and techniques to meet client requirements, timelines, and budgets. Role Responsibilities
- Perform data assessment, analysis, and data model design.
- Develop CI/CD pipelines and other DataOps fundamentals.
- Communicate at the appropriate level to both business and technology teams to understand business needs and pain points.
- Be creative in meeting the client’s core needs with their technology.
- Explain technical benefits and deficits to non-technical audiences.
About the Team The Logic20/20 AI & Analytics team is where skilled professionals in data engineering, data science, and visual analytics join forces to build simple solutions for complex data problems. We make it look like magic, but for us, it’s all in a day’s work. As part of our team, you’ll collaborate on projects that help clients spin their data into a high-performance asset, all while enjoying the company of kindred spirits who are as committed to your success as you are. And when you’re ready to level up in your career, you’ll have access to the training, the project opportunities, and the mentorship to get you where you want to go. “We build an environment where we really operate as one team, building up each other’s careers and capabilities.” – Adam Cornille, Managing Director, AI & Analytics
Qualifications
- 5-10+ years of data engineering experience using Python and Spark (PySpark).
- Experience supporting the design and development of cloud ETL and data pipelines.
- Experience working with fast streaming data.
- Experience with Flink, Kafka, and Kubernetes.
- Experience developing CI/CD pipelines.
- Experience with Big Data Technologies (Hadoop, Spark/PySpark, MongoDB).
- Experience working with Azure, AWS, and/or GCP.
- Demonstrated ability to identify business and technical impacts of user requirements and incorporate them into the project schedule.
- Ability to travel at least once per quarter.
Preferred Qualifications
- Extensive experience working with Palantir Foundry.
- Java experience is highly preferred.
- Consulting experience and/or experience working within the Utilities industry is highly preferred.
Additional Information At Logic20/20, we believe in recognizing and rewarding exceptional talent. Logic20/20 offers a competitive compensation package, with a target base salary range of $145,750 - $176,040 for this role. The final base salary offered is dependent on factors such as relevant experience, skills, qualifications, and location. Eligible employees may also qualify for performance-based bonuses and other incentives. All your information will be kept confidential according to EEO guidelines. Learn more about life at Logic20/20! Visit our Life at Logic page to explore our culture, benefits, and what makes Logic20/20 a great place to grow your career! Core Values At Logic20/20, we are guided by three core values: Drive toward Excellence, Act with Integrity & Foster a Culture of We. These values were generated and agreed upon by our employees—and they help us pursue our goal of being one of the best companies to work for and to work with. Learn more at https://www.logic2020.com/company/our-values. Equal Opportunity Statement We believe that people should be celebrated: for their talents, ideas, and skills, but most of all, for what makes them unique. We prohibit harassment and/or discrimination based on age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status, or any other basis as protected by federal, state, or local law. To learn more about our DE&I initiatives, please visit: https://www.logic2020.com/company/diversity-equity-inclusion Privacy Policy During the recruitment and hiring process, we gather, process, and store some of your personal data. We consider data privacy a priority. For further information, please view our company privacy policy. Apply tot his job Apply To this Job