Microsoft Phi
What is Microsoft Phi?
Microsoft Phi is part of Microsoft's Foundry stack for developers who need to benchmark, route, and govern model use in one platform. It offers more than 11,000 models, fine-tuning, distillation, and real-time routing, plus agent orchestration, Foundry IQ retrieval, and tools for OCR, translation, speech, and object detection. It connects with Microsoft Defender and Entra ID, and is used by ACOM Foundry. Plans run from Microsoft Agent pre-purchase plan: Tier 1 at $19,000/year to Tier 3 at $425,000/year.
Last verifiedHow we evaluate
At a glance
- Microsoft Phi is best for developers who want model access, routing, and governance inside one AI platform.
- 30 days, no credit card
What does Microsoft Phi do?
Microsoft Phi runs as part of Microsoft's Foundry stack, where teams can access more than 11,000 models, benchmark them for a use case, and route requests in real time to the most suitable model. The surrounding platform also supports fine-tuning, distillation, and model upgrades with minimal coding, so Phi fits into a broader workflow rather than a standalone model drop-in. On the agent side, Foundry pairs model access with agent orchestration, grounded retrieval through Foundry IQ, and pre-built or customizable tools for OCR, translation, speech, and object detection. At scale, the platform is used by more than 80,000 enterprises and digital natives, with 80% of Fortune 500 companies represented among Azure customers. Microsoft also points to 3B daily enterprise search queries and over 60 million downloads across its ecosystem. ACOM Foundry is cited among customer stories, and the platform connects with Microsoft Defender and Entra ID for governance and access control.
Why use Microsoft Phi?
- It combines model access, agent orchestration, tools, and governance in one platform, reducing the need to assemble separate services.
- Real-time model routing helps teams balance quality and cost without manually switching models.
- Built-in user access permissions and Microsoft Defender and Entra ID integration support org-wide control over AI usage.
- Serverless hosting and event-driven functions make it easier to scale agentic apps without managing infrastructure directly.
- The platform spans cloud and edge scenarios, so teams can keep workloads close to where they run.
Who is Microsoft Phi for?
- AI developers who need to benchmark and route models without stitching together separate tools.
- Platform teams who want governed model access, agent orchestration, and shared controls.
- Data scientists who fine-tune and distill models as part of an Azure-based workflow.
- Enterprise architects who need retrieval, tools, and access permissions in one stack.
What are Microsoft Phi's key features?
cost-effective
Runs on a pay-as-you-go model with 11K+ Foundry Models and a 30-day trial, helping teams control spend while testing production use cases.
high-performance
Delivers low-latency inference for more than 11,000 foundational, open, reasoning, multimodal, and industry-specific models, which matters for responsive apps and agents.
at the edge
Supports local and edge deployment for on-device or nearby inference, reducing round trips and keeping AI available in constrained environments.
The AI app and agent factory
Provides a single place to build AI apps and agents with Microsoft Agent Framework, Azure App Service, and Microsoft Copilot Studio, speeding delivery.
Models
Offers more than 11,000 Foundry Models, including open, reasoning, multimodal, and industry-specific options, so teams can match model choice to each workload.
Agent Service and frameworks
Connects agent workflows to Microsoft Agent Framework, LangChain, CrewAI, and LlamaIndex, helping teams assemble agents with familiar development tools.
Knowledge and Tools
Links agents to SAP, Salesforce, Dynamics 365, Azure Cosmos DB, and Azure AI Search, so they can use business data and external systems.
Observability and trust
Adds fleet-wide monitoring, Microsoft Defender, Microsoft Security, and customizable guardrails, giving teams visibility and control over model behavior.
What does Microsoft Phi integrate with?
- SAP
- Salesforce
- Dynamics 365
- Visual Studio Code
- GitHub Copilot
- Microsoft Copilot Studio
- Azure App Service
- Microsoft Agent Framework
- Microsoft 365
- Microsoft Fabric
- Azure Cosmos DB
- Azure AI Search
- Microsoft Defender
- Entra ID
- Microsoft Security
- LangChain
- CrewAI
- LlamaIndex
What are Microsoft Phi's use cases?
Model routing for AI developers
AI developers use Microsoft Phi to benchmark and route models without stitching together separate tools, using real-time model routing to send each request to the right model for latency, cost, or quality. They can compare options in Models and keep production behavior consistent as workloads change.
Governed agents for platform teams
Platform teams use Microsoft Phi to stand up shared agent workflows with The AI app and agent factory, then manage access through built-in user access permissions. They also rely on Observability and trust to monitor usage and apply customizable guardrails across teams.
Fine-tuning workflows for data scientists
Data scientists use Microsoft Phi to fine-tune and distill models inside an Azure-based workflow, starting with Models and then validating results through fleet-wide monitoring. They can iterate faster with high-performance models while keeping experiments aligned to deployment needs.
Retrieval and tools for architects
Enterprise architects use Microsoft Phi to assemble retrieval, tools, and permissions in one stack, combining Knowledge and Tools with pre-built and customizable tools. They can connect governed data sources and services while keeping agent behavior visible through Observability and trust.
How does Microsoft Phi work?
- Start with Models and choose a Phi option that fits your workload, then compare cost-effective and high-performance choices before you wire it into development or production.
- Connect your first app or agent flow in The AI app and agent factory, using Agent Service and frameworks to shape orchestration without assembling separate point solutions.
- Add Knowledge and Tools to ground responses in your data and actions, then plug in pre-built and customizable tools for retrieval, workflows, and external system calls.
- Set built-in user access permissions and customizable guardrails so teams can safely share the stack, while Observability and trust keeps behavior visible during testing and rollout.
- Monitor usage with fleet-wide monitoring, then refine routing and deployment choices over time so the same setup stays reliable as demand, models, and agents evolve.
Frequently asked questions
What is Microsoft Phi?
Microsoft Phi is part of Microsoft's Foundry stack for developers who need to benchmark, route, and govern model use in one platform. It offers more than 11,000 models, fine-tuning, distillation, and real-time routing, plus agent orchestration, Foundry IQ retrieval, and tools for OCR, translation, speech, and object detection. It connects with Microsoft Defender and Entra ID, and is used by ACOM Foundry. Plans run from Microsoft Agent pre-purchase plan: Tier 1 at $19,000/year to Tier 3 at $425,000/year.
How much does Microsoft Phi cost? Is it free?
Microsoft Phi has 3 paid plans: Microsoft Agent pre-purchase plan: Tier 1 at $19,000, Microsoft Agent pre-purchase plan: Tier 2 at $90,000, Microsoft Agent pre-purchase plan: Tier 3 at $425,000. A 30-day free trial is available.
What is Microsoft Phi used for? Who is it for?
Microsoft Phi is used for cost-effective, high-performance, and at the edge. It's built for AI developers, Platform teams, and Data scientists.
Does Microsoft Phi have an API and what does it integrate with?
Microsoft Phi doesn't publish a public API. It integrates with SAP, Salesforce, Dynamics 365, Visual Studio Code, GitHub Copilot, and 13 more.
Editor's read
Check the annual pre-purchase tiers against your expected agent volume before committing. Tier 1, Tier 2, and Tier 3 are priced around 20,000, 100,000, and 500,000 units respectively, so a workload that grows past your tier's allowance will move you up quickly.
Explore other AI Model Providers