mirror of
https://github.com/microsoft/semantic-kernel.git
synced 2026-10-12 02:19:06 +00:00
Tao ChenandEvan Mattson
d22ee5af55
### Motivation and Context <!-- Thank you for your contribution to the semantic-kernel repo! Please help reviewers and future users, providing the following information: 1. Why is this change required? 2. What problem does it solve? 3. What scenario does it contribute to? 4. If it fixes an open issue, please link to the issue here. --> Related to: https://github.com/microsoft/semantic-kernel/pull/6693 Azure Model-as-a-Service allows users to deploy certain models from the Azure AI Studio model catalog as an API. This option also provides pay-as-you-go access to the models hosted. Below are some of the models that are supported: - Microsoft Phi-3 family - Meta Llama family (Llama 2 chat & Llama 3 instruct) - Mistral-Small & Mistral-Large - and more We'd like to provide an AI connector for users of SK to use Azure Model-as-a-Service. ### Description <!-- Describe your changes, the overall approach, the underlying design. These notes will help understanding how your code works. Thanks! --> A new AI connector named `azure_ai_inference` is added to support Azure Model-as-a-Service. This connector takes a new dependency on the Python `azure.ai.inference` SDK. ### Contribution Checklist <!-- Before submitting this PR, please make sure: --> - [X] The code builds clean without any errors or warnings - [X] The PR follows the [SK Contribution Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md) and the [pre-submission formatting script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts) raises no violations - [X] All unit tests pass, and I have added new tests where possible - [X] I didn't break anyone 😄 --------- Co-authored-by: Evan Mattson <[email protected]>