Sr. Cloud Data Engineer in at Ellkay LLC
Explore Related Opportunities
Job Description
ELLKAY started out providing connectivity solutions to laboratories and within a few years, grew to also provide data management solutions to ambulatory organizations. ELLKAY is now a trusted data management partner in five healthcare segments. ELLKAY’s solutions continue to serve laboratories and ambulatory practices and have expanded to empower hospitals and health systems, healthcare IT vendors, ambulatory practices, health plans, and other healthcare organizations with cutting-edge technologies and solutions that drive their growth and interoperability strategies.
Today, ELLKAY remains true to our core values, building strong partner relationships and offering unparalleled service and support while providing innovative, scalable solutions to the challenges our customers face in today’s data-rich world.
ELLKAY's experience, customer-focused approach, and reputation for innovation, speed, and accuracy differentiate ELLKAY as a premier partner for your interoperability needs and data management strategy.
Job Description:
We are seeking a Senior Cloud Data Engineer to help build and scale our modern healthcare data platform. This hands-on role will design, build, and operate cloud-native data pipelines that ingest, cleanse, normalize, and deliver clinical and operational healthcare data at scale.
You will work closely with architecture, engineering, data governance, QA, and product teams to modernize legacy point-to-point integrations into a secure, scalable, observable, and reusable data platform.
Essential Duties & Responsibilities:
- Build scalable data pipelines for batch and streaming workloads using technologies such as Spark, Databricks, Airflow, and dbt.
- Process healthcare data including HL7, FHIR, X12/EDI, CCD/CCDA, and flat-file formats.
- Build cloud lakehouse solutions using S3/ADLS, Delta Lake, Apache Iceberg, or Hudi, along with modern cloud data warehouses i.e. Snowflake, Redshift
- Improve data quality through automated validation, cleansing, de-duplication, schema validation, and quarantine workflows.
- Support identity resolution and master data by integrating patient/member, provider, subscriber, and reference data with MPI/EMPI capabilities.
- Modernize legacy integrations into reusable, configuration-driven, event-based, streaming, and API-based patterns.
- Build for production reliability with monitoring, alerting, audit logging, data lineage, security, and operational observability.
- Collaborate across teams to translate architecture into well-tested, production-grade solutions that meet healthcare security and compliance requirements.
Qualifications:
- 5+ years of data engineering experience, including 2+ years building cloud-native solutions on AWS, Azure, or GCP.
- Strong experience with Python and SQL and distributed data-processing technologies such as Apache Spark or Databricks.
- Experience with orchestration and transformation tools such as Airflow, dbt, Prefect, or Dagster.
- Experience with cloud storage/lakehouse technologies such as S3, ADLS, Delta Lake, Apache Iceberg, or Hudi.
- Experience with a modern data warehouse such as Snowflake, Redshift, BigQuery, or Synapse.
- Experience with streaming/event-driven technologies such as Kafka, Kinesis, SQS/EventBridge, RabbitMQ, Amazon MQ, or Azure Event Hubs.
- Familiarity with Docker, Kubernetes, Terraform, CI/CD, and automated testing.
- Understanding of data quality, de-duplication, master/reference data, security, and governance.
Technology Environment
AWS / Azure / GCP • Python • SQL • Spark • Databricks • Airflow • dbt • Kafka • SQS/EventBridge • S3 / ADLS • Iceberg / Delta Lake • Snowflake / Redshift / BigQuery • Docker • Kubernetes • Terraform • HL7 • FHIR • X12/EDI
Candidates do not need experience with every technology listed. Strong data-engineering fundamentals, cloud experience, and the ability to learn new technologies are most important.
Additional Information:
ELLKAY is committed to fostering a collaborative and high-performance work environment that supports innovation, teamwork, and professional growth. Most roles are designed to operate from our office locations to encourage effective collaboration and engagement across teams.
Any alternative work arrangements may be considered at the company’s discretion based on role requirements and business needs.
For more information about our company, please visit www.ELLKAY.com.
ELLKAY is a Smoke-Free Workplace.
ELLKAY, LLC provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.