Skip to main content

Notifications

Customer experience | Sales, Customer Insights,...
Suggested answer

Data ingestion questions

(0) ShareShare
ReportReport
Posted on by Microsoft Employee

Dear Team, 

few questions.

- Any possibilities to enter custom python scripts data source during ingestion? Power Query editor seems only support standard functionality.

- Possibility to ingest data from event-hubs or streaming analytics? If I'd need very frequent updates on certain profile attributes?

Thanks for answering

L

  • Suggested answer
    Aurelien Clere Profile Picture
    Aurelien Clere 5 User Group Leader on at
    RE: Data ingestion questions

    Hello Lawrence,

    Maybe a good way to achieve that is to do an intermediate work with Azure Data factory on an SQL Azure Database before putting/ingest your data in D365 CI.

    You will have all needed with ADF to work with Python Scripts or whatever needed to correct DATA/JOIN/UNION some other tools you want.

    Stream Analytics or Event Hubs can have an output with Azure SQL Database.

    So this will be your Azure SQL Database (like a staging database) that will be sink to D365 CI.

    Also a scenario of deployment of D365 CI is to have access directly to your Azure Data Lake behind the scene. But this will need some works for your to sync your DATA to your ADLS.

    Aurélien

  • RE: Data ingestion questions

    Hi -- Great questions.

    We are actively working on some of the above asks that you have. Can we connect with you offline to understand your scenarios better and also include you in the early private preview of the features as it becomes available?

    Please reach out to us at CIhelp@microsoft.com if you are interested to work with us on this.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Announcing Our 2025 Season 1 Super Users!

A new season of Super Users has arrived, and we are so grateful for the daily…

Vahid Ghafarpour – Community Spotlight

We are excited to recognize Vahid Ghafarpour as our February 2025 Community…

Congratulations to the January Top 10 leaders!

Check out the January community rock stars...

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,996 Super User 2025 Season 1

#2
Martin Dráb Profile Picture

Martin Dráb 230,853 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans