Principal Software Engineer, AI Data Platform

Remote: This role is based remotely but if you live within a 50-mile radius of [Atlanta, Austin, Detroit, Warren, Milford or Mountain View], you are expected to report to that location three times a week, at minimum. This job may be eligible for relocation benefits. We are seeking a technical expert to join our team and lead efforts in designing and implementing robust data ingestion, access, management, and processing systems to power our AI platform. As a pivotal member of our engineering team, you will be instrumental in improving our data infrastructure, particularly focusing on enhancing developer access to vehicle development logs and building efficient data pipelines between on-premises and cloud environments. • *Architect and develop a modern system for ingesting and indexing vehicle data from our development and customer fleet • Develop an access abstraction layer that simplifies how developers interact with data. • Ensure scalability, reliability, and performance of the system to load and train on large volumes of data efficiently. • Automate the extraction, transformation, and loading (ETL) of logs from vehicle systems to a centralized data platform. • Design and build a data platform capable of seamless data movement between on-premises data centers and cloud environments (public and private). • Utilize technologies such as DreamIO, Spark, and Airflow to orchestrate and monitor data workflows. • Provide technical guidance and mentorship to junior team members. • Propose and implement additional solutions to optimize data infrastructure and enhance developer productivity. Apply Job!