Require Solution Architect- Data Engineering Any Cloud must have Databricks in San Francisco, CA
Job title: Solution Architect- Data Engineering Any Cloud must have Databricks
Company: Capgemini
Job description: About the job
As a Solution Architect - Data Engineering, you will work for an American multinational technology company focusing on various technological domains such as artificial intelligence, online advertising, search engine technology, cloud computing, computer software, quantum computing, e-commerce, and consumer electronics.
The job requires expertise in Databricks, a cloud-based data engineering
Key responsibilities:
- Provide technical leadership in a post-sales capacity to guide strategic customers as they design and implement big data projects, ranging from architectural design to data engineering to model deployment.
- Identify and drive new initiatives that enable customers to turn their data into actionable business value and align these initiatives with their business outcomes for continued success.
- Architect production-level workloads, including end-to-end pipeline load performance testing and optimization.
- Deliver tutorials and training to drive community adoption (including hackathons, conference presentations, etc.)
- Work closely with Engineering and Product Management to drive the direction of the Databricks product.
- Contribute to Databricks SME community.
- Hands-on and technical expertise with Apache Spark
- Proven experience of design and implementation experience in big data technologies including Hadoop, NoSQL, MPP, OLTP, OLAP
- 5+ years? Experience working as either: Software Engineer/Data Engineer: query tuning, performance tuning, troubleshooting, and debugging Spark and/or other big data solutions.
- Comfortable programming in Python, Scala or Java
- Experience using and designing solutions on cloud infrastructure and services, such as AWS, Azure, or GCP
- Experience with Development Tools for CI/CD, Unit and Integration testing, Automation and Orchestration, REST API, BI tools, and SQL Interfaces. E.g. Jenkins.
- Excellent communication skills and comfortable presenting to strategic stakeholders/leadership.
- Experience in customer-facing pre-sales, post-sales, technical architecture guidance, or consulting.
- Passionate about learning new technologies and making customers successful
- Data Science/ML Engineer experience model selection, model lifecycle, hyper-parameter tuning, model serving, deep learning, using tools like MLFlow desired.
- Flexible work
- Healthcare including dental, vision, mental health, and well-being programs.
- Financial well-being programs such as 401(k) and Employee Share Ownership Plan
- Paid time off and paid holidays.
- Paid parental leave.
- Family-building benefits like adoption assistance, surrogacy, and cryopreservation
- Social well-being benefits like subsidized backup child/elder care and tutoring
- Mentoring, coaching, and learning programs
- Employee Resource Groups
- Disaster Relief