Senior Data Engineer job at SmartAsset in New York, NY

Title: Senior Data Engineer Location: New York, NY (remote) About SmartAsset: SmartAsset is an online destination for consumer-focused financial information and advice, whose mission is helping people make smart financial decisions, reaching over an estimated 59 million people each month (as of January 2025) through our educational content and personalized calculators and tools. To extend our mission, we also operate SmartAsset Advisor Marketing Platform (AMP), which helps connect consumers with fiduciary financial advisors.SmartAsset has earned recognition on the Inc. 5000 (#2574 in 2023) and Deloitte Technology Fast 500™ (#250 in 2022) lists. Currently, SmartAsset ranks on Y Combinator’s list of Top 100 Companies. A successful $110 million Series D funding round in 2021 valued the company at over $1 billion.

• Other than application and licensing fees, SmartAsset did not provide compensation for the aforementioned awards.

About the team: SmartAsset’s Data Engineering team builds and maintains the scalable, low-latency systems that power data access across the company. Our platform supports real-time and batch data needs for analytics, reporting, and machine learning, serving teams across Marketing, Product, Sales, and Finance. You’ll be part of a growing data organization that includes analysts, data scientists, and ML engineers that are at the forefront of AI/ML application for the company. As a Senior Data Engineer, you'll work cross-functionally to evolve our architecture, optimize data latency, and build robust solutions that enable data-driven decisions at scale. About the Job: SmartAsset is looking for a seasoned Senior Data Engineer with 7+ years of hands-on experience to help build and optimize the backbone of our data platform. In this role, you’ll design and implement high-impact, cloud-native solutions that improve data reliability, reduce latency, and scale with our growing business. You’ll play a key role in enabling data products, real-time analytics, and cross-functional decision-making by delivering clean, well-structured, and accessible data. Responsibilities: Architect, design, implement, and operate end-to-end data engineering solutions using Agile methodology. Develop and manage robust data integrations with external vendors and organizations (including complex API integrations). Collaborate closely with Data Analysts, Data Scientists, DBAs, and cross-functional teams to understand requirements and deliver high-impact data solutions. Lead and take ownership of assigned technical projects in a fast-paced environment. Drive continuous improvement in the quality, security, efficiency, and scalability of our data pipelines and infrastructure. Skills/Experience you have: Bachelor of Science degree in Computer Science or equivalent practical experience. 4+ years of dedicated experience building and maintaining complex ETL/ELT pipelines. 3+ years of Python development experience, specifically building production-grade data APIs using FastAPI or similar frameworks. Strong expertise in SQL, including advanced query optimization and performance tuning. Expert-level proficiency in dbt implementation, including managing models, macros, and incremental and dynamic tables. Extensive hands-on experience with Snowflake, including performance optimization, data recovery using Time Travel, and advanced data modeling techniques. Practical experience with key AWS data services such as Kinesis, Firehose, Redshift, Spectrum, Elastic MapReduce, and Lambda; and container orchestration services like ECS and EKS for deploying and managing data applications. Skills/Experience preferred: Proven experience designing and building near real-time data processing systems. Experience with data observability tools for proactive monitoring of data quality, lineage, and pipeline health. Familiarity with modern data orchestration platforms such as Argo or Airflow. Hands-on experience with the full software development lifecycle (SDLC), including strong CI/CD practices for data pipelines and proficiency with data testing frameworks. Demonstrated ability to identify and adopt new technologies that improve data quality and reliability. Deep understanding of the data lifecycle, emphasizing the importance of high-quality data in applications, machine learning, business analytics, and reporting. Proven track record of mentoring junior team members. Experience with data ingestion tools like Singer is a plus. Knowledge of analytics tools such as Tableau, Plotly, and Pandas. Experience in the financial services industry. Physical Requirements: Prolonged periods of sitting at a desk and working on a computer Must be able to communicate via phone calls and/or video conferences (mainly for concierge and sales roles) Available Benefits and Perks: All roles at SmartAsset are currently and will remain remote - flexibility to work from anywhere in the Contiguous US. Medical, Dental, Vision - multiple packages available based on your individualized needs Life/AD&D Insurance - basic coverage at 100% company paid, additional supplemental available Supplemental Short-term and Long-term Disability FSA: Medical and Dependant Care 401K Equity packages for each role Time Off: Vacation, Sick and Parental Leave EAP (Employee Assistance Program) Financial Literacy Mentoring Program Pet Insurance Home Office Stipend SmartAsset is an equal opportunity employer committed to fostering an inclusive, innovative environment with the best employees. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. California, Colorado, Connecticut, Maryland, Nevada, Rhode Island, Washington, and New York City residents* $135,500 - $200,000 + RSUs + benefits. Salary at SmartAsset is determined based on permissible, non-discriminatory factors such as skills, experience, and geographic location within the contiguous United States. Apply tot his job Apply To this Job