Location: 

(

New York City

,

NY

)

Salary: 

$

215k

 - $

271k

Our hiring partner is building the technology infrastructure the nation needs to deliver the healthcare everyone deserves. As a health technology company providing benefit administration solutions to employers, unions, health plans, and government entities, they are replacing fragmented, outdated systems with an industry-first unified claims processing architecture. This platform seamlessly consolidates pharmacy and medical benefit administration onto a single, secure system delivering true price transparency, eliminating unnecessary middleman fees, and leveraging advanced AI-powered care delivery.

The company is the intelligence platform powering benefits plans for millions of Americans and is proudly leading the next generation of care. Their Architecture organization is responsible for the technical foundation the rest of the company builds upon: the standards, patterns, and infrastructure that engineering teams use to move fast and build efficiently.

Why This is a High-Impact Technical Leadership Role

  1. Define the Technical Bar: As a Staff Engineer in Architecture, your influence extends beyond what you ship directly. The standards you set, the patterns you establish, and the decisions you document become the reference point for how event-driven systems are built across the organization.
  2. Own Mission-Critical Infrastructure: Lead the team responsible for streaming infrastructure that services and data consumers depend on for timely, correct event delivery—including cache invalidation systems, analytics pipelines, and change-data-capture subscribers.
  3. Drive Major Architectural Migration: Spearhead the migration of the data warehouse synchronization layer from batch-driven processes to a unified WAL-based replication pipeline, establishing an open table format as the canonical source.
  4. Cross-Organizational Influence: Drive adoption of event-driven design best practices across engineering, producing architectural guidance that the broader organization depends on.

About the Role

The Realtime & Streaming team sits within Architecture's Core Platform function, owning the streaming infrastructure that services and data consumers depend on for timely, correct event delivery. The platform's consumers each carry different latency and ordering requirements, and the Staff Engineer will be directly responsible for scaling delivery without degrading it while honoring per-consumer SLAs as volume grows.

One of the first major initiatives will be leading the migration of the data warehouse synchronization layer from independently managed, batch-driven processes to a unified WAL-based replication pipeline using an open table format for transactional data. This spans the full synchronization path from PostgreSQL to downstream data warehouses used for analytics, leveraging native streaming and ingestion capabilities to support real-time synchronization.

Key Responsibilities

  1. Design, build, and operate the WAL replication and event streaming platform that cache invalidation, data warehouse synchronization, and change-data-capture consumers across the platform depend on for correctness and low latency.
  2. Own the full lifecycle of the streaming platform, from replication topology and delivery guarantee design through operational recovery and post-incident review.
  3. Define and own the performance and correctness contracts between the streaming platform and the services that depend on it.
  4. Lead the migration of batch-driven data warehouse synchronization to a unified WAL-based replication pipeline, establishing an open table format as the canonical source and replacing independently managed sync processes.
  5. Drive adoption of event-driven design best practices across engineering by eliminating anti-patterns, producing architectural guidance, and making correct consumption of the streaming platform the default.
  6. Set the technical bar for the Realtime & Streaming team through design review, code review, and direct mentorship of senior engineers.
  7. Participate in a 24/7 on-call rotation to provide continuous operational support and rapid incident response.

Required Qualifications

  1. 10+ years of production engineering experience, with deep specialization in real-time data infrastructure and event streaming systems.
  2. Production experience designing and operating WAL-based or log-structured replication systems, such as PostgreSQL logical replication, Debezium, Kafka Connect, or equivalent CDC frameworks at scale, with an understanding of delivery guarantees, consumer lag management, and failure recovery.
  3. Deep understanding of event streaming correctness: ordering guarantees, at-least-once vs. exactly-once delivery semantics, idempotency requirements, and how those properties propagate to downstream consumers.
  4. Experience leading batch-to-streaming migrations, replacing polling or batch-driven synchronization with event-driven architectures without disrupting dependent consumers.
  5. Fluency in a systems-level language (Rust, Go, or C/C++) used to build high-throughput, low-latency data plane components in production.
  6. A track record of leading cross-team technical initiatives—driving decisions through influence and producing documentation that holds up over time.
  7. Strong written and verbal communication—you produce architectural guidance that the broader engineering organization depends on.
  8. Comfortable operating with ambiguity—at this level, you will be handed problems, not plans, and are expected to identify the right approach and drive it from first principles to production.
  9. Strong experience supporting 24/7 production on-call rotations, including responding to alerts and resolving incidents outside of standard business hours.

Preferred Qualifications

  1. Systems-level programming experience in Rust for high-throughput streaming pipeline components, such as binary protocol handling, I/O-intensive services, or data plane infrastructure where performance and correctness are both hard constraints.
  2. Experience with open table formats (Apache Iceberg, Delta Lake, Parquet) as the storage layer bridging streaming ingestion and analytical query workloads.
  3. Hands-on experience integrating streaming pipelines with analytical query engines—Redshift, Snowflake, BigQuery, ClickHouse, Databricks including schema evolution, backfill strategies, and latency and cost trade-offs.
  4. Deep familiarity with PostgreSQL WAL internals, including logical decoding, replication slots, checkpointing, and the failure modes that emerge at scale.
  5. Familiarity with the streaming runtime landscape—Kafka, Kinesis, Redpanda, Pulsar, and similar—and the ability to evaluate trade-offs across managed and self-managed deployment models.
  6. Experience with AWS data infrastructure and how managed services compose with self-managed streaming components in a hybrid architecture.
  7. Background in healthcare, pharmacy, financial services, or other regulated domains where data pipelines carry audit and correctness obligations.

Apply Now

If you are a staff-level engineer with deep expertise in real-time data infrastructure and event streaming, and you are excited by the challenge of building the technical foundation for a mission-driven healthcare platform, we encourage you to apply. This is a defining opportunity to set the technical bar and drive architectural excellence at scale.

Ready to grow your career?

Let's get started