Principal Product Manager, SeekrFlow Evaluations
SEEKR TECHNOLOGIES · Austin, TX
📍 Austin, Texas, United Statesvia greenhousePosted 2026-07-02
Apply on company site ↗
CareerRiver pulls this listing straight from the employer's hiring system — no recruiter middleman, no reposts. Applying takes you directly to SEEKR TECHNOLOGIES.
About the Opportunity
SeekrFlow is an end-to-end AI development platform used to build, fine-tune, evaluate, and deploy AI systems in production environments. As AI adoption accelerates across enterprises and government agencies, the ability to rigorously evaluate AI models and applications, and to trust those evaluations, has become a critical capability. We’re hiring a Principal Product Manager to own SeekrFlow’s evaluations product area end to end.
This is a senior individual contributor role with broad scope. You will define strategy and drive execution across all evaluation surfaces inside SeekrFlow: base models, fine-tuned models, agents, distilled applications, and beyond. You’ll work in close partnership with other product leaders, ensuring that evaluation capabilities inside SeekrFlow connect seamlessly with scoring, certification, and governance workflows across all Seekr products. You’ll operate with a high degree of autonomy, partnering directly with Engineering, Research, Design, and GTM to make AI evaluation rigorous, scalable, and customer ready.
What You’ll Own
Evaluations product strategy & roadmap: Define and own the multi-year strategy and roadmap for SeekrFlow’s evaluation capabilities, covering the full spectrum of model types (base models, fine-tuned models, agents, and distilled applications) and ensuring alignment with platform and business priorities.
End-to-end product ownership: Drive evaluation features from discovery and specification through delivery, launch, and iteration, working in close partnership with Engineering and Design. Own prioritization decisions and hold the line on quality and scope.
Cross-surface evaluation coverage: Develop deep expertise in the unique evaluation requirements for each model type and application surface, translating those requirements into coherent product direction across SeekrFlow.
SeekrGuard alignment: Partner closely with other leaders in the technology organization to ensure SeekrFlow evaluation outputs connect directly to SeekrGuard’s risk scoring and evaluation workflows, creating a seamless end-to-end trust pipeline.
Research & capability translation: Engage with Research and Engineering teams to identify emerging evaluation techniques and benchmarks, and determine how to turn experimental work into scalable, customer-facing product capabilities.
Customer & market insight: Work directly with enterprise and government customers to understand evaluation requirements, workflow gaps, and trust needs. Use those insights to validate direction and sharpen the roadmap.
Technical specification: Write clear, detailed product specifications that define evaluation workflows, metrics, API/SDK surfaces, UI behavior, and expected system behavior across SaaS and self-hosted deployments.
Metrics & outcomes ownership: Define success metrics for evaluation capabilities and track adoption, performance, and customer outcomes to drive continuous improvement.
Required Qualifications
8–12+ years of product management experience, with demonstrated ownership of complex, technically deep platform or infrastructure products
Strong understanding of AI/ML model evaluation concepts, including benchmarking, bias and reliability testing, task-specific evaluation frameworks, and application types (base models, fine-tuned models, agents)
Experience productizing research-driven or experimental technology areas where requirements evolved through iteration and technical discovery
Proven ability to operate autonomously as a senior IC: setting direction, writing specifications, and driving cross-functional execution
Comfortable engaging deeply with engineers, designers, and researchers on technical tradeoffs, system design decisions, and emerging research
Experience building for enterprise or government customers in B2B software environments, including multi-stakeholder requirements and compliance-sensitive contexts
Strong product writing skills: able to produce structured, precise specifications that enable high-quality engineering execution
Clear communicator capable of making complex evaluation concepts legible to both technical teams and executive or customer audiences
Reside in or willing to relocate to Austin, TX; able to work in office on a hybrid schedule
Technical Skills
Deep familiarity with AI/ML evaluation and benchmarking approaches across model types and use cases
Working knowledge of LLMs, RAG, agents, fine-tuning, and distillation, deep enough to evaluate technical tradeoffs and shape product direction
Understanding of how evaluation integrates with broader AI lifecycle workflows: data preparation, training, deployment, and monitoring
Ability to define API, SDK, and UI surfaces for evaluation workflows and specify behavior across SaaS and self-hosted environments
Comfortable reviewing and engaging with research papers, experimental results, and benchmark methodologies
Preferred / Differentiating Qualifications
Experience with AI governance, model risk management, trust and safety tooling, or audit-ready AI systems
Experience designing platform surfaces such as dashboards, scoring systems, certification workflows, or real-time monitoring interfaces
Background in high-growth startups or early-stage platform products where you helped define product practice and AI evaluations
Ability to use AI-assisted tools to prototype workflows, validate concepts, or accelerate discovery
Experience with or exposure to U.S. federal government, defense, or intelligence community AI programs
About the Company:
Seekr is a leader in explainable and trustworthy artificial intelligence designed to power mission-critical decisions in enterprises, government, and regulated industries. SeekrFlow™, our end-to-end AI platform, provides secure, auditable AI solutions tailored to sectors where transparency, accuracy, and compliance are paramount. Available across cloud, on-premises, and edge en
More Austin, TX jobs
Austin, TX jobs · Browse all locations