Location: Palo Alto, CA (Onsite, 5 days a week)

Team: Engineering

Partner: A pioneering company building the first safety-focused Large Language Model designed specifically for healthcare.

About Our Hiring Partner

Our hiring partner is tackling one of the most ambitious and meaningful challenges in technology today: developing a safety-first Large Language Model to revolutionize global healthcare. Their mission is to dramatically improve health accessibility and outcomes by making deep medical expertise available to every person through AI. This represents a foundational shift in healthcare technology with potential for unprecedented global impact.

Founded by a coalition of visionary leaders—including a seasoned CEO alongside physicians, hospital administrators, and AI researchers from elite institutions like Stanford, Johns Hopkins, and technology leaders from Google and NVIDIA—the company is built on unparalleled expertise. With $278 million in funding from top-tier investors including Andreessen Horowitz and General Catalyst, they have the resources and strategic backing to execute their long-term vision. For engineers seeking purpose-driven startup jobs in SFC, this represents a rare opportunity to build technology that truly matters.

Why This Role Matters

1. Build Foundational Technology: Create the core infrastructure that powers safety-critical AI applications in healthcare, directly impacting patient outcomes worldwide.
2. Solve Complex Scale Challenges: Work on distributed systems handling multi-modal data (speech, text, vision) at unprecedented scale.
3. Learn from the Best: Collaborate with world-class AI researchers, engineers, and healthcare experts in a cross-functional environment.
4. Career-Defining Growth: Join a well-capitalized company offering stability and rapid growth—a key advantage for startup jobs in SFC seeking both impact and professional development.

About the Role

We are seeking a Backend Engineer to help build the next generation of AI voice agents and the highly scalable infrastructure that powers them. You'll join an interdisciplinary team working on cutting-edge LLM processing systems, focusing on creating robust, efficient data pipelines and backend services that handle complex healthcare data.

This role sits at the intersection of infrastructure and AI, requiring someone who enjoys building systems that can handle massive scale while maintaining reliability and performance. You'll be instrumental in developing the backbone that supports our AI training and inference workflows.

What You'll Do

1. Design, develop, and maintain scalable backend systems to support high-performance AI applications in healthcare environments.
2. Collaborate with cross-functional teams including data scientists and ML engineers to build efficient data pipelines for large-scale multi-modal healthcare datasets.
3. Build and manage APIs and microservices that enable seamless data retrieval, processing, and interaction with advanced AI models.
4. Develop and optimize backend infrastructure supporting data ingestion, feature extraction, and tagging workflows for ML experimentation.
5. Implement robust tag management and metadata systems to streamline dataset organization and retrieval across distributed environments.
6. Monitor, troubleshoot, and improve backend systems to optimize performance, reliability, and uptime for production AI workloads.
7. Contribute to end-to-end ML workflows, integrating data preparation, training, evaluation, and deployment into reproducible pipelines.
8. Work closely with product managers to understand healthcare requirements and translate them into effective technical solutions.

Qualifications (Must-Have)

1. Bachelor's degree in Computer Science, Computer Engineering, or related field (Master's preferred).
2. 2-5+ years of professional experience in backend development using Python, Golang, or similar languages.
3. Experience building and maintaining multi-modal data pipelines (speech, vision, text) using distributed processing frameworks like Ray or Apache Airflow.
4. Strong background in distributed computing with Spark, Hadoop, or similar technologies.
5. Familiarity with relational database systems and designing RESTful APIs.
6. Solid understanding of cloud infrastructure (AWS, GCP) and distributed system principles.

Bonus Qualifications (Nice-to-Have)

1. Exposure to AI/ML concepts or direct experience working with LLMs in production environments.
2. Experience working with sensitive or regulated data in healthcare or similar domains.
3. Familiarity with gRPC, GraphQL, or similar technologies for efficient service communication.
4. Experience with real-time audio processing and streaming architectures.
5. Exposure to DevOps concepts including CI/CD, infrastructure as code (Terraform), and build systems.
6. Background in data science or experience collaborating closely with data science teams.

This is a full-time, onsite role based in Palo Alto, CA. The company culture emphasizes in-person collaboration to foster innovation and build strong, cohesive teams.

Apply Now

If you're a backend engineer passionate about building scalable infrastructure for groundbreaking AI applications and want to work on technology that improves lives, we encourage you to apply. This role represents one of the most impactful startup jobs in SFC for engineers who want to merge technical excellence with meaningful purpose.