Product Manager, AI Agent & Harness
Binance
Apply to this jobAbout the Role
We're building the core Agent capabilities and Skill ecosystem for Binance Agentic. We're looking for a Product Manager with a strong AI and Web3 background to drive Agent product design, the Harness evaluation framework, end-to-end task validation, and continuous iteration.
You'll need to understand both the capability boundaries of AI Agents and the nuances of Web3 / exchange business scenarios — and proactively rally engineering, business, operations, and partner teams to ship Agent-powered products.
Responsibilities
- Agent Product Design: Own the design of Agent-related capabilities across Binance Agentic, including task flows, user interaction patterns, capability boundaries, failure fallbacks, and result feedback loops.
- Harness & Evaluation: Build and maintain the Harness framework — design test scenarios, define evaluation criteria, curate task sets, analyze performance, and drive actionable iteration recommendations.
- Cross-functional Delivery: Partner closely with Tech Owners, frontend engineers, and Skill design leads to break down business requirements into shippable, testable, production-ready product specs.
- Web3 Use Case Discovery: Map high-value, deployable Agent use cases across Web3 Wallet, Account, Payment, Trading, and other Binance business lines.
- Industry Tracking: Stay current on AI Agent, MCP, tool-calling, prompt engineering, and automated evaluation developments — and translate them into executable product initiatives for the team.
- Metrics & Quality: Define and track Agent performance metrics, including task success rate, user satisfaction, error rate, response quality, and tool-calling accuracy.
- Continuous Improvement: Proactively identify issues from real-world Agent usage and drive improvements across product, engineering, and operations.
Requirements
- Experience in AI products, Agent products, AIGC applications, automation tools, or developer tooling.
- Background in Web3, exchanges, wallets, payments, on-chain transactions, DeFi, or crypto assets.
Hands-on understanding of how AI Agents work — tool-calling, task planning, context management, and evaluation frameworks.
Strong ownership and learning agility; able to define problems, decompose workstreams, and drive execution in ambiguous environments. - Solid product fundamentals — clear PRDs, flow diagrams, test cases, acceptance criteria, and iteration plans.
- Excellent cross-team collaboration and communication skills across engineering, design, operations, and business stakeholders.
- Experience with exchanges, Web3 wallets, on-chain trading, payments, or fintech products.
- Experience with AI Agent Harness, Eval, Benchmarking, automated testing platforms, or prompt evaluation.
- Familiarity with MCP, Function Calling, RAG, multi-Agent orchestration, or workflow automation.
- Knowledge of the Binance ecosystem or mainstream Web3 user scenarios.
- Strong English reading and writing skills, with the ability to keep up with global AI / Web3 product and technical materials.
Summary
Drive AI agent product design, evaluation framework, and Web3 use cases.
Job title
Product Manager, AI Agent & Harness
Experience level
null
Industry
blockchain
Location requirements
remote work allowed, based in Asia
Salary
Not specified
Management role
No
Required skills
Preferred skills
Specializations
Structured locations inferred from the posting.
Unknown location