how to download webpage by skipping javascript

**catjoke** · 12-10-2010, 02:31 PM

I want to download the result of HKJC horse racing into Excel.
http://www.hkjc.com/chinese/racing/results.asp
or
http://www.hkjc.com/chinese/racing/r...eno=8&venue=HV

The actual size Saved by IE or other programming language should be round 40k.

But there is a javascript to rewrite the result.
Whatever I use,

ActiveSheet.QueryTables.Add(Connection:="URL;" & sURL ...)
URLDownloadToFile Lib "urlmon"
InternetReadFile Lib "wininet.dll"
nor
CreateObject("MSXML2.ServerXMLHTTP") => to get objHttp.ResponseText

all feedback me only around 10k and cut off the result part of the webpage.
which is the executed result of javascript on the above given page!!!
That javascript use document.write to rewrite the webpage and hide the RESULT from the original webpage.

I need the result, by download the webpage and CUT-off all javascript from it.
i.e. save the webpage from starting of "<body bgcolor"
Then, the horse racing data will appear properly on excel by ActiveSheet.QueryTables.

I don't want to save the webpage manually and cut-off the javascript by IE.
What can I do?

**royUK** · 12-10-2010, 02:33 PM

Your post does not comply with Rule 3 of our Forum RULES. Use code tags around code. Posting code without them makes your code hard to read and difficult to be copied for testing. Highlight your code and click the # at the top of your post window. For more information about these and other tags, found here

**royUK** · 12-10-2010, 02:34 PM

Also, don't use bad language in your titles or posts

**catjoke** · 12-11-2010, 11:07 PM

Function WebHTML(ByVal sURL As String) As String
    Dim objLink As HTMLLinkElement
    Dim objMSHTML As New MSHTML.HTMLDocument
    Dim objDocument As MSHTML.HTMLDocument
    
    Set objDocument = objMSHTML.createDocumentFromUrl(sURL, vbNullString)
   
    Do While objDocument.readyState <> "complete"
        DoEvents
        'Wscript.sleep 50
    Loop
    WebHTML = objDocument.documentElement.innerHTML
    Set objLink = Nothing
    Set objMSHTML = Nothing
    Set objDocument = Nothing
End Function

Tool->add reference-> Microsoft HTML object library
This works now but ask security prompt x2 when run.

can I skip the prompt?

Another way is to CreateObject InternetExplorer.Application but IE crash easily after run few times.

**catjoke** · 12-12-2010, 12:02 AM

Oh No.
#4 return 99k when is also hide the result of horse racing.

objMSHTML.designMode = "on"

if I put above line, the security prompt is skipped but give back 11k similar to #1 result.

**catjoke** · 12-30-2010, 12:54 AM

Finally, I upgrade VFP5 to VFP9 with SAME API InternetReadFile call to grap the innerHTML.

I've tried open IE object to get innerHTML but IE crash after few runs.
Thus, using VFP9 to get is the fastest way to do.