Test Scripts: Webview Extender Web-Scraping

Started by spl, August 17, 2025, 06:14:32 AM

Previous topic - Next topic

spl

The previous thread for Jim's Webview2 Extender is getting long, so I have attached 3 working scripts to perform web-scraping. This assumes knowledge of the Files\folder-setup involved and scripts based on most recent update. All scripts work with public urls used to test web-scraping
  • QuickParse - returns Product Information for 'commercial' site, main page
  • Recursion - returns results for multiple 'pages' from url
  • Tags - returns results for all pages with sub-elements

The Tags script is of interest as per formatting. The 'tags' are comma-delimited sub-elements related to the quote. For purposes of keeping them under a 'Tag' variable a bracket is used. See below how the data might appear if you choose to format other than the script:

[script will return]
Title:  "The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking."
Author: Albert Einstein
Tags:   {change, deep-thoughts, thinking, world}

[if formatted as Json]
[
    {
        "Quote":  ""The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking."",
        "Author":  "Albert Einstein",
        "Tags":  "(change,deep-thoughts,thinking,world)"


[if formatted as cwsv]
Quote,Author,Tags
"The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.",Albert Einstein,(change,deep-thoughts,thinking,world)
Stan - formerly stanl [ex-Pundit]

SMF spam blocked by CleanTalk