Skip to main content

Notifications

Small and medium business | Business Central, N...
Suggested answer

Scraping JavaScript based website using HTTPClient

Posted on by 115

Hello everyone

I'm using HTTPClient (https://learn.microsoft.com/en-us/dynamics365/business-central/dev-itpro/developer/methods-auto/httpclient/httpclient-get-method) to scrape my vendors' webshops to update information on my items. Unfortunately, the site cannot be used without JavaScript, as it  is based on React, Angular, etc. Is it possible to generate the page first with JavaScript in order to then read the information. Or do I need to use a third-party headless browser.

Thank you and best regards
Nico

  • Suggested answer
    Marco Mels Profile Picture
    Marco Mels on at
    RE: Scraping JavaScript based website using HTTPClient

    Hello,

    We currently do not have dedicated Dev support via the Dynamics 365 Business Central forums, but I wanted to provide you some additional resources to assist. If you need assistance with debugging or coding I would recommend discussing this on one of our communities.

    www.yammer.com/dynamicsnavdev

    www.dynamicsuser.net/.../14

    I will open this up to the community in case they have something to add.

    Thanks.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

December Spotlight Star - Muhammad Affan

Congratulations to a top community star!

Top 10 leaders for November!

Congratulations to our November super stars!

Community AMA December 12th

Join us as we continue to demystify the Dynamics 365 Contact Center

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,240 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,104 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans