[Remote] Data Engineer
Note: The job is a remote job and is open to candidates in USA. Shift5 is building the data platform for onboard operational technology (OT). They are seeking a Data Engineer to design, build, and maintain data processing, storage, and integration pipelines while collaborating with a team of engineers and product managers to create impactful data products.
Responsibilities
- Design, build, and maintain robust, scalable batch and streaming data processing, storage, and integration pipelines
- Interpret requirements and design specifications, taking full ownership of building features from the ground up
- Write clean, well-documented, scalable, extensible, and testable code to ensure application quality and maintainability
- Partner with data scientists and engineers to create semantic data models representing complex vehicular systems, and integrate applications cleanly across other Shift5 componentry
- Build scalable data products for data scientists, transportation engineers, and executives to drive insights and decision-making
- Create efficient, reliable, cost-effective, dynamically scalable, and observable solutions utilizing AWS cloud services
- Analyze complex data sets to create data ontologies, verify data quality/integrity, and ensure data accuracy throughout pipelines
- Support the design process and occasionally travel to customer sites (estimated a few times per year) to collaborate with Field Engineers on data integration and deployment
Skills
- 2+ years of software/data engineering experience with a deep understanding of software engineering practices and concepts
- 2+ years of experience with a major programming language (GoLang, Java, or Python)
- 2+ years of relational database experience (PostgreSQL, MySQL, Oracle, etc.) alongside 2+ years of experience with Big Data (Hadoop, Spark) and Data Modeling
- 2+ years of experience with containerization and cloud services (Docker, Kubernetes) and cloud monitoring tools
- Expertise with batch and streaming data pipelines using technologies such as Apache Airflow or Benthos
- Familiarity with modern data stack components including data ingestion, transformation, and orchestration
- U.S. citizenship required and ability to obtain a security clearance
- Experience and understanding of data lakes/warehouses (e.g., Snowflake, Databricks, Redshift)
- Proficiency with CI/CD, source control, design reviews, and integrating observable practices
- Willingness to travel occasionally to customer and partner sites to support field integration and deployment efforts
Benefits
- Bonus program and equity in a fast-growing startup
- Competitive salary and stock options in a fast-growing startup
- Employer-paid medical, dental and vision coverage
- Health Savings Account with annual employer contributions
- Life Insurance
- Uncapped paid time off policy
- Flexible work & remote work policy
- Tax-deferred public transit benefits with Metro SmartBenefits (DC/MD/VA)
Company Overview
Apply To This Job