Staff Software Engineer



Software Engineering
Philadelphia, PA, USA
Posted on Thursday, May 16, 2024
*This person is expected to be in our Philadelphia, PA office two times per week*
How you will help
As a Staff Engineer on the Data Transmission Engineering team, you will develop and maintain the services and tools powering HealthVerity’s data pipelines. This includes the ingestion of raw data into our petabyte sized warehouse -- all the way to the delivery of cleaned, de-identified and linked data to our clients. You will interact with internal teams to create applications they can use and software that empowers HealthVerity to process and deliver terabytes of data at a time.
Our tech stack:
The Data Transmission team leverages the following technologies in our day-to-day development process:
Python, Spark, Hive, Hadoop, Serverless Framework, Postgres, React, AWS Lambda, AWS ECS, AWS SNS/SQS, AWS Eventbridge, Airflow

What you will do

  • Develop services that facilitate ingestion, storage, and extraction of data throughout HealthVerity’s data ecosystem
  • Design and build APIs that support data pipelines
  • Build applications that enable internal teams to configure data pipelines
  • Build tools that will orchestrate and automate data pipeline
  • Work collaboratively with a team of driven engineers, engaging in paired programming and code reviews
  • Work with key stakeholders to refine requirements and eliminate ambiguity
  • Design, discuss, implement, and ship solutions to support the healthcare insights economy
  • Work with our product teams to understand the needs of our users and build the software that addresses those needs
  • Improve the software development process through agile ceremonies
  • Mentor engineers and foster an environment of collaboration and learning

How success is defined

  • High throughput, consistently maintains high velocity
  • Assess technical feasibility of high complexity requests across multiple systems
  • Optimize systems for known constraints
  • Fosters a strong team culture with focus on cross functional collaboration

Required skills and experience

  • 8+ years of Python experience
  • 3+ years of AWS experience
  • 4+ years experience with javascript or modern frameworks (React js preferred)
  • Experience with continuous integration and continuous deployment technologies
  • 3+ years of Spark, or similar technologies, experience
  • 3+ years of experience building data pipelines
  • Experience with serverless framework

Desired skills and experience

  • Bachelor’s in computer science, engineering or related field
  • Prior experience developing software in a fast paced, start up environment
  • Experience working in regulated industry like healthcare or finance with compliance requirements
  • Experience in application architecture, microservice architecture, event driven architectures, messaging systems, and domain driven design
  • Experience with Airflow
  • Experience working with Lean / Agile development methodologies