[Remote] Cloud Data Engineer (Strictly W2 ONLY)
Note: The job is a remote job and is open to candidates in USA. Dice is the leading career destination for tech experts at every stage of their careers. They are seeking a Cloud Data Engineer to develop and implement data engineering solutions using AWS cloud technologies while collaborating with stakeholders to meet business requirements.
Responsibilities
- Collaborate with stakeholders to understand business requirements and convert them into actionable solution components aligned with Enterprise Solution architecture patterns, procedures, and policies
- Design and develop scalable, resilient data service components and engineering solutions using cloud-native services and technologies
- Develop data lakes and CDC services to create cohesive applications within cloud and hybrid infrastructures
- Create comprehensive solution documentation detailing the design, testing, and production support processes and procedures
- Set up and maintain continuous integration and continuous deployment (CI/CD) pipelines to automate updates and feature deployments
- Design and develop cloud-native micro frontend applications and data service APIs using AWS, React, and NodeJS
- Build data quality monitoring dashboards and tools to support data stewardship and policy compliance
- Implement data classification and retention logic using metadata tagging, lifecycle policies, and automation
- Develop secure user portals with role-based access control (RBAC), Single Sign-On (SSO), and integration with AWS Cognito
- Enable workflow automation for data intake, validation, approval, and archival processes
- Create and maintain solution documentation, including architecture diagrams, data flow, testing, and support procedures
- Ensure solution completeness through thorough testing and quality assurance processes, ensuring compliance with security policies and best practices
- Manage configuration drift and ensure consistency across different environments, using tools like AWS Code Build/Deploy and AWS CloudFormation
- Apply DevOps principles to streamline the software development lifecycle (SDLC) and enhance automation
- Deploy solutions to various environments, establish monitoring processes, and ensure ongoing operational stability and application resiliency through system stress testing and feature enhancements
- Collaborate with cross-functional teams to understand change requirements, provide technical expertise, and ensure solutions align with business needs
Skills
- Intermediate, Proficient in AWS Data Engineering, works with limited or no guidance
- Technical proficiency in AWS cloud development with Data engineering & full stack skills including glue, Athena, RDS, Snowflake Integrations, ELT&ETLs, lambda, API Gateway, node js, react js, python etc
- Adherence to software engineering best practices
- Appreciation to data management principle and alignment with the agency's technical direction & data policies
- Collaboration with stakeholders to understand business requirements and convert them into actionable solution components aligned with Enterprise Solution architecture patterns, procedures, and policies
- Design and develop scalable, resilient data service components and engineering solutions using cloud-native services and technologies
- Develop data lakes and CDC services to create cohesive applications within cloud and hybrid infrastructures
- Create comprehensive solution documentation detailing the design, testing, and production support processes and procedures
- Set up and maintain continuous integration and continuous deployment (CI/CD) pipelines to automate updates and feature deployments
- Design and develop cloud-native micro frontend applications and data service APIs using AWS, React, and NodeJS
- Build data quality monitoring dashboards and tools to support data stewardship and policy compliance
- Implement data classification and retention logic using metadata tagging, lifecycle policies, and automation
- Develop secure user portals with role-based access control (RBAC), Single Sign-On (SSO), and integration with AWS Cognito
- Enable workflow automation for data intake, validation, approval, and archival processes
- Create and maintain solution documentation, including architecture diagrams, data flow, testing, and support procedures
- Ensure solution completeness through thorough testing and quality assurance processes, ensuring compliance with security policies and best practices
- Manage configuration drift and ensure consistency across different environments, using tools like AWS Code Build/Deploy and AWS CloudFormation
- Apply DevOps principles to streamline the software development lifecycle (SDLC) and enhance automation
- Deploy solutions to various environments, establish monitoring processes, and ensure ongoing operational stability and application resiliency through system stress testing and feature enhancements
- Collaborate with cross-functional teams to understand change requirements, provide technical expertise, and ensure solutions align with business needs
- Expertise in developing AWS full stack applications: Translate business requirements into fully tested applications workflows by designing, implementing, and maintaining technology assets using approved tools and plugins for AWS for python
- Proficiency in data services orchestration: Strong proficiency in cloud platforms, leveraging native cloud services data orchestration solution
- API Development: Expertise in designing, developing, and maintaining APIs specifically tailored for cloud environments including AWS API Gateway
- Cloud Networking and Security: Understanding of cloud networking concepts including VPCs, subnets, security groups and cloud security best practices, including identity and access management (IAM)
- Serverless Computing: Experience with serverless computing concepts, event-driven architecture, and serverless platforms
- Infrastructure as Code (IaC): Automate the provisioning and management of cloud infrastructure using tools like AWS CloudFormation and Terraform
- Scripting and Automation: Ability to write scripts and automate tasks using scripting languages including NodeJS and Python
- Experience with data quality frameworks, data validation, and anomaly detection
- Familiarity with data classification models, metadata management, and retention policies
- Monitoring and Logging: Experience in setting up alerts, dashboards, and logs for cloud infrastructure and applications
- DevOps Practices: Strong understanding of DevOps practices, including developing and optimizing CI/CD pipelines, version control, and collaboration tools including AWS CodePipeline and Github
- End-User Training and Support: Provide support and training to end-users for improved solution literacy and tool usage in a cloud ecosystem
- Business Process Automation: Analyze business process life cycles to identify opportunities for automation and simplification, implementing appropriate solutions
- Collaboration and Communication: Collaborate with product and business owners to deliver robust cloud-based solutions, demonstrating excellent communication skills (both written and verbal)
- Compliance: Adhere to all policies and procedures of the Agency
- AWS Data Engineer Associate and Solution architect Professional Certification is desired
- Familiarity with data governance frameworks such as DAMA-DMBOK or NIST Data Management
Company Overview
- Welcome to Jobs via Dice, the go-to destination for discovering the tech jobs you want. It was founded in undefined, and is headquartered in , with a workforce of 0-1 employees. Its website is https://www.dice.com.
Apply tot his job Apply To this Job