Web scraping with xml

Hi,

Can anyone help me finish this macro? I have the following but can't get the innertext.

Sub GetData()
  Dim htmlDoc As Object             ' MSHTML.HTMLDocument
  Dim htmlBody As Object            ' MSHTML.HTMLBody
  Dim htmlText As Object
  Dim xml As Object                 ' MSXML2.XMLHTTP60
  Dim mystring$
  
    Set xml = CreateObject("Microsoft.XMLHTTP")
    With xml
        .Open "POST", "http://eutils.ncbi.nlm.nih.gov/entrez/eutils/esearch.fcgi?db=pubmed&term=review", False
        .send
    End With
    
    Set htmlDoc = CreateObject("htmlfile")
    Set htmlBody = htmlDoc.body
    Set htmlText = htmlDoc.getElementByID("Count")
    
    mystring = htmlText.innertext
    Debug.Print mystring
End Sub

Thanks.

abousetta

If it's just xml, use the xml document object, it's much easier than trying to stuff xml in an html object:

Sub GetCount()
    
    With CreateObject("MSXML2.DOMDocument")
        .Load "http://eutils.ncbi.nlm.nih.gov/entrez/eutils/esearch.fcgi?db=pubmed&term=review"
        Do: DoEvents: Loop Until .readystate = 4
         Debug.Print .SelectNodes("//eSearchResult/Count").Item(0).Text
    End With

End Sub

I've assumed that you wanted the count for the overall results, there are multiple count properties in the document

Thanks Kyle. This is exactly what I needed. As I learn XML more, my needs will probably change in future tasks but for the current project, I just wanted to extract the count.

Have a great Monday.

abousetta

Yes, pubmed is one of the most frequented websites for medical (journal) information. It's the free portal to the National Library of Medicine's Medline database. I practically search it daily for one reason or another. As part of my work, we have to do extensive searches of PubMed along with other medical citation databases and automating the process has taken a great deal of load off me, but the learning curve is really more like a rocky road than a curve .

Thanks again for all your help and insight.

abousetta