Senior Software Engineer, Compute Infra

At , we solve the complex data problems in production machine learning. Tecton’s feature platform makes it simple to activate data for smarter models and predictions, abstracting away the complex engineering to speed up innovation.Tecton’s founders developed the first when they created Uber’s Michelangelo ML platform, and we’re now bringing those same capabilities to every organization in the world.Tecton is funded by Sequoia Capital, Andreessen Horowitz, and Kleiner Perkins, along with strategic investments from Snowflake and Databricks. We have a fast-growing team that’s distributed around the world, with offices in San Francisco and New York City. Our team has years of experience building and operating business-critical machine learning systems at leading tech companies like Uber, Google, Meta, Airbnb, Lyft, and Twitter.The Compute Infrastructure team creates building blocks that power Tecton’s data computation engine. We make it easy to spin up new highly available and performant compute workloads across our Batch, Streaming, and Realtime use-cases, for both Spark and our in-house .ResponsibilitiesBuild re-usable platform components which implement cross-cutting solutions in compute workload orchestration like reconciliation, auto-scaling, observability, and dependency installation/management.Own and evolve our Spark integrations with platforms like Databricks and EMR, exposing the right details while abstracting the “hard parts” away from up-stream product use-cases.Dynamically launch infrastructure across multiple cloud platforms, ensuring compliance with security protocols and data residency requirements.Assess and prioritize tasks, demonstrating a keen awareness of performance-critical areas.Qualifications5+ years of experience in programming, debugging, and performance tuning distributed and/or highly concurrent software systems.Degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience, with strong proficiency in building high-throughput infrastructure.Experience building infrastructure orchestration systems (dynamically provisioning cloud infrastructure, virtual machines, containers, load balancing, etc).Experience building platforms (e.g. technology for internal stakeholders).Experience with at least one of: AWS, GCP.Nice to have:Experience with Python runtimes, dependency resolution, and container sandboxing.Experience with the following technologies: Pulumi, Ray, Spark, hosted Spark providers (Databricks/EMR/Dataproc/etc), PrometheusThe estimated US base salary range for this position is $197,000 - $237,000 annually for employees based within California & New York. In addition to base salary, we offer competitive equity & comprehensive benefits such as medical, dental, vision, life, 401(K), flexible paid time off, 10 paid holidays each calendar year, sick time, leave of absence as per the FMLA and other relevant leave laws. Individual compensation packages are based on multiple factors such as location, level, role scope, and complexity, as well as additional job-related factors such as skills, experience, and expertise.Tecton is a remote-friendly company that employs a hybrid working policy for employees based in the SF, NY, and Seattle areas. We believe that working in-person helps us stay connected, collaborate faster, and promote a strong culture while still providing the flexibility of working from home. We expect SF & NY employees to be in the office at least two designated days per week, and those in the Seattle area at least two designated days per month.Tecton values diversity and is an equal opportunity employer committed to creating an inclusive environment for all employees and applicants without regard to race, color, religion, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or other applicable legally protected characteristics. If you would like to request any accommodations from the application through to the interview, please contact us at [email protected] employer participates in E-Verify and will provide the federal government with your Form I-9 information to confirm that you are authorized to work in the U.S.Compensation Range: $197K - $237K Apply for the job now! Apply for this job