Technical Product Manager, Applied Science – AI Products

Caseware is one of Canada's original Fintech companies, having led the global audit and accounting software industry for over 30 years, with more than 500,000 users across 130 countries and available in 16 different languages. While you might not have heard of us (yet) over 36,000 accounting and audit professionals list Caseware as a skill on their LinkedIn profiles!

What you will be doing

Own agents, the agent builder, the eval builder, and agentic memory as products: their roadmap, sequencing, and the business outcomes they drive, using results and practitioner feedback to shape what ships.

Own the applied-science delivery roadmap and cross-team orchestration for the Caseware AI platform — sequence the evaluation, agentic-memory, and platform workstreams into a single plan, and keep delivery moving.

Own the product acceptance bar for every AI feature — decide when an output is good enough to put in front of practitioners, and set the eval baseline so every agent and skill is measured against a stated bar.

Embed with domain experts and partner accounting and audit firms to validate AI outputs against professional standards — not just user preferences, but what a qualified practitioner would actually sign off on.

Be the voice of the practitioner as an SME proxy — shadow real audit workflows, test prototypes in context, and translate "this doesn't feel right" into specific, actionable failure modes the team can act on.

Work daily with engineering to turn precise problem statements into well-scoped requirements, with acceptance criteria agreed before development begins.

Stay ahead of the AI landscape — monitor model developments, new architectures, emerging agent patterns, and competitor moves, and bring a clear product point of view on what matters for Caseware.

Define and own product health metrics for AI features: task completion, correction rates, override frequency, trust signals, and time-to-completion — and use them to drive product decisions.

What you will bring

6+ years of experience in technology-focused product management or product development, including 3–4 years working deeply with AI or machine learning–driven products. Software engineers transitioning into PM are welcome.

Proven ability to drive delivery across multiple technical teams coordinating dependencies, shared interfaces, and timelines across applied-science, and platform-engineering pod.

Direct experience building and running eval frameworks for production AI products: defining acceptance bars, running human-in-the-loop, practitioner validation, regression tracking across releases, and using results to decide what ships.

Technical fluency in LLMs, RAG, prompt engineering, embeddings, and agentic patterns, enough to drive substantive conversations with engineers and know when a product problem is a model problem.

High agency: you identify what needs to happen, move without waiting to be told, and take ownership of outcomes rather than just activities.

Intellectual curiosity about AI — you follow model releases, read research, understand what frontier labs are shipping, and form your own views on what matters.

Experience being the voice of the customer or practitioner: working with domain experts or subject matter specialists to define quality bars in high-stakes, regulated, or professional-grade contexts.

Comfortable with ambiguity and energized by it. Many of the problems this role works on do not have clear playbooks, when there is no established benchmark for the work, you can go and find out how it should be measured.