Principal Engineer, AI/ML Architecture - 11310
Coupa Software, Inc.
Apply to this jobCoupa's AI platform powers production agents, conversational AI (Navi), customer-built agents (Agent Studio), and a suite of ML models for classification, fraud detection, and supplier intelligence. The Principal Engineer, AI/ML Architecture will define the technical direction for the next generation of these capabilities, designing how we train, evaluate, and serve models that are deeply tuned to enterprise spend management. Reporting to the Sr. Director, you will be hands-on in architecture and prototyping while guiding a growing team of ML and data engineers.
What You'll Do:
- Define the architecture for model training, evaluation, and serving across Coupa's AI platform.
- Evaluate and select model approaches (open-weight, commercial, and hybrid) against enterprise accuracy and cost requirements.
- Design evaluation frameworks that measure model quality on Coupa's specific task categories.
- Drive technical partnership evaluations with AI infrastructure and model providers.
- Architect training data pipelines, including synthetic data generation and quality validation.
- Design retrieval-augmented generation (RAG) systems that extend our existing RAG infrastructure with structured knowledge retrieval.
- Establish technical standards for model safety, tenant data isolation, and responsible AI.
- Write code, review PRs, and prototype approaches, especially in the early phases.
- Mentor and guide ML and data engineers across US and India.
- Collaborate with product, existing AI platform, and cloud operations teams.
What You Will Bring to Coupa:
- 15+ years of software engineering experience, with 5+ years focused on ML/AI systems.
- Demonstrated experience training or fine-tuning large language models. Must have shipped a fine-tuned or domain-adapted model to production.
- Deep knowledge of transformer architectures, training optimization (LoRA, QLoRA, PEFT, RLHF, DPO), and inference serving.
- Experience with distributed training on GPU clusters.
- Strong understanding of RAG architectures, vector search, embedding models, and knowledge graph integration.
- Hands-on experience with cloud AI/ML services (model hosting, managed training, or equivalent).
- Experience designing and running custom evaluation suites for LLMs.
- Proficiency in Python, PyTorch, and ML infrastructure tooling.
- Advanced degree in Computer Science, Machine Learning, or equivalent practical experience.
- Experience with enterprise B2B SaaS platforms preferred.
- Global Wellness Days: Enjoy two designated, company-wide paid wellness days off each year (typically the first Friday in March and the last Friday in September) so the entire global team can unplug, step away, and recharge together .
- Birthday Time-Off: Celebrate your day! Coupa provides a paid day off on your birthday or another day of your choice within your birthday month .
- Volunteer Time Off (VTO): Giving back is in our DNA. We offer 40 hours of paid VTO annually to support the community initiatives and volunteer programs you are passionate about .
- Employee Assistance Program (EAP): Access free, confidential, 24/7/365 counseling and resources for emotional support, work-life solutions, financial advice, legal guidance, and support for new parents .
- Business Travel Protection: Travel with peace of mind. Zurich Travel Assist provides medical, safety, pre-trip planning, and emergency support during any business travel .
- Referral Bonus Program: Share the Coupa experience! Receive generous monetary referral bonuses when you successfully refer talented friends or acquaintances who are hired into open roles .
Compensation (from employer):
241000–337400 USD per year
Summary
Designs AI/ML architecture, trains models, guides engineering team, ensures safety and performance.
Job title
Principal Engineer, AI/ML Architecture
Experience level
15+ years
Minimum experience
15+ years exp
Industry
software
Location requirements
Foster City, CA, hybrid work allowed
Salary
$241k–$337k
Visa sponsorship
H-1B sponsor history
Management role
No
Required skills
Preferred skills
Specializations
Structured locations inferred from the posting.
Foster City, CA, USA