Dynamics Community Forum Thread Details

Cannot launch the AI Prompt model in deployed environment if using Foundry model

Issue: Applied AI Foundry, worked great in DEV. Deploy all to UAT( AI prompt, AI model catalog, connection ref)

When run in UAT, it is said that

Could not find connection 'fb5e557a4be2467c8443717e1035810b' for API 'shared_azureaifoundryinference'.

After a bunch of exploration, I found out that in export package, AI prompt stored connectionid from DEV, which is

{"byomConnectionId":"fb5e557a4be2467c8443717e1035810b","byomModelType":"Foundry","modelSpecificParameters":{"byomConnectorId":"azureaifoundryinference","temperature":0,"top_p":0,"max_tokens":2000}}},"settings":{"recordRetrievalLimit":30,"shouldPreserveRecordLinks":null,"runtime":null},"code":"","signature":""}

Normally if using default model, it will use the default value like :"modelParameters":{"modelType":"gpt-41-mini","gptParameters":{"temperature":0}},"settings":{"recordRetrievalLimit":30,"shouldPreserveRecordLinks":null,"runtime":null},"code":"","signature":""}"

Since UAT does not have this id, it failed to find.

How to fix this ?

Categories:

Dynamics 365 general

Power Platform integration

Quick Links

Leaderboard > Microsoft Dynamics 365 | Integration, Dataverse, and general topics