Author Topic: Best way to get a page from Edge into a DOM  (Read 310 times)

John Sikora

  • Newbie
  • *
  • Posts: 1
Best way to get a page from Edge into a DOM
« on: July 12, 2023, 08:30:31 am »
I've been searching through the forum and other sources and am, to put it bluntly, confused. What is the best way (if there is one), to request a page from the Edge browser and then make that page a DOM object so that I can pull items from the page?

td

  • Tech Support
  • *****
  • Posts: 4382
    • WinBatch
Re: Best way to get a page from Edge into a DOM
« Reply #1 on: July 12, 2023, 08:50:40 am »
Why do you want to use Edge? There are several techniques for Web scraping including the WinBatch WinInet extender, WinBatch COM automation subsystem, or WinBatch .Net subsystem. But which one you use depends greatly on the nature of the Webpage you are scraping. Keep in mind that some "dynamic" Webpages may require third-party software to use with the above WinBatch functionality.

Most of this is covered in the Tech Database and on this forum.
"No one who sees a peregrine falcon fly can ever forget the beauty and thrill of that flight."
  - Dr. Tom Cade

td

  • Tech Support
  • *****
  • Posts: 4382
    • WinBatch
Re: Best way to get a page from Edge into a DOM
« Reply #2 on: July 12, 2023, 10:24:49 am »
It may be a bit dated but here is an about 5-year-old discussion about using a third-party tool for Web scraping:

https://forum.winbatch.com/index.php?topic=2010.msg10318#msg10318
"No one who sees a peregrine falcon fly can ever forget the beauty and thrill of that flight."
  - Dr. Tom Cade

stanl

  • Pundit
  • *****
  • Posts: 1812
Re: Best way to get a page from Edge into a DOM
« Reply #3 on: July 13, 2023, 02:28:18 am »
It may be a bit dated but here is an about 5-year-old discussion about using using a third-party tool for Web scraping:

https://forum.winbatch.com/index.php?topic=2010.msg10318#msg10318


and here is a more recent discussion
https://learn.microsoft.com/en-us/microsoft-edge/webdriver-chromium/?tabs=c-sharp


td

  • Tech Support
  • *****
  • Posts: 4382
    • WinBatch
Re: Best way to get a page from Edge into a DOM
« Reply #4 on: July 14, 2023, 06:09:21 am »
With Edge thrown in as a bonus.
"No one who sees a peregrine falcon fly can ever forget the beauty and thrill of that flight."
  - Dr. Tom Cade