Skip to main content

Notifications

Dynamics 365 general forum

Automate data import using flow

Posted on by 7,314

Hi,

Is it possible to automate data imports into D365 Customer Engagement?

Our users don't use D365 but would like to import data every few days. Right now, we have accommodated a custom feature to upload to CRM 2016 and the csv file gets stored on a server location. There we have a scheduled process which transforms the data in csv and uploads into CRM 2016. All this was setup in OnPrem. We are now moving to D365 online.

What would be a good approach in Dynamics 365 online, now that we are planning to move everything online. I've looked into Microsoft Flow but there are many options available and it is really confusing as to what is the best approach. If anybody has implemented this feature(preferably GCC clients), I would like to know. Thanks for any suggestion.

  • PS10 Profile Picture
    PS10 428 on at
    RE: Automate data import using flow

    Hi meenoorami

    Could you please share the details of how you were importing the csv file stored on a server location using a scheduled process which transforms the data in csv and uploads into CRM 2016.we are also OnPrem.

    Thanks,

    PS

  • Verified answer
    TylerS.Dev Profile Picture
    TylerS.Dev 725 on at
    RE: Automate data import using flow

    It depends on the relationship, if it is 1:N, then you will not want parent and child on the same csv file because you will have the same parent record list multiple times for each related child record.  For this, it will be better to have two separate csv file and have the scheduler update child and then parent (it will still be single flow process, schedule, list records from csv1--> foreach loop (update parent from Dynamic)--> list records csv2 from csv2 --> foreach loop (update child from Dynamic).

    If the relationship is 1:1, you can do single csv file, have flow list records from csv1 --> foreach loop (update parent, update child).

    Please mark as verified if this answers your question.

  • meenoo Profile Picture
    meenoo 7,314 on at
    RE: Automate data import using flow

    Thanks Tyler, that sounds good. I will explore Flow further.

    I definitely will not have more than 50k to upload at any point, so Flow should suffice for my requirements.

    One last question, can we import related records(child records) as well through flow?  

  • Suggested answer
    TylerS.Dev Profile Picture
    TylerS.Dev 725 on at
    RE: Automate data import using flow

    If you plan to do it through scheduler, than MS flow is a good approach but keep in mind that there are limitations.  There are only a few adopters for source files available out of box, your file must be stored either on sharepoint, onedrive, or Excel online.

    If you plan to move everything at once and the record size is large (like over 50k+), I would suggest using Kingswaysoft and build your ETL through SSIS.

    Here is a tutorial on how to import from excel to dynamic 365 using microsoft flow:

    www.inogic.com/.../

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

November Spotlight Star - Khushbu Rajvi

Congratulations to a top community star!

Forum Structure Changes Coming on 11/8!

In our never-ending quest to help the Dynamics 365 Community members get answers faster …

Dynamics 365 Community Platform update – Oct 28

Welcome to the next edition of the Community Platform Update. This is a status …

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 290,900 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 229,297 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans