+ Reply to Thread
Results 1 to 5 of 5

scraping webpage data modification

  1. #1
    Registered User
    Join Date
    07-11-2016
    Location
    Delhi, India
    MS-Off Ver
    7
    Posts
    47

    scraping webpage data modification

    Hi,


    As i need some expert advise to help me get this code working properly.
    1) This code(in attachment notepad) is working fine to scrape data from web page and successfully pasting it to Excel, but ii requires little modification in code so that it will paste data in only one cell, rather than pasting it to whole workbook.

    2) Addition modification requires to make a loop through code so that it access the input from Excel(in attachment-Input sheet) and make changes to URL(i noticed in URL that only last word needs to be changed which will be taken from excel file column 1and so on till its find blank)


    Any help be much appreciated.
    Thanks.
    Attached Files Attached Files

  2. #2
    Forum Expert
    Join Date
    03-28-2012
    Location
    TBA
    MS-Off Ver
    Office 365
    Posts
    12,454

    Re: scraping webpage data modification

    Automation has been disabled on this site says Wiki. Try to use HTTP request(There are many threads on this site)

    The code

    Please Login or Register  to view this content.
    Range("A1").Resize(UBound(x)) = Application.Transpose(x)
    You have an array with 456 rows. You are dumping in to a cell. If you want to scrape the data, you need to break down the page by locating the element where the data is stored.

  3. #3
    Registered User
    Join Date
    07-11-2016
    Location
    Delhi, India
    MS-Off Ver
    7
    Posts
    47

    Re: scraping webpage data modification

    Hi,

    As pasting all the wen data into single is getting done by this code, but i still need help to loop it for all the website access.
    2nd additional requirement of my original post.

    2) Addition modification requires to make a loop through code so that it access the input from Excel(in attachment-Input sheet) and make changes to URL(i noticed in URL that only last word needs to be changed which will be taken from excel file column 1and so on till its find blank)





    Please Login or Register  to view this content.

  4. #4
    Forum Expert
    Join Date
    03-28-2012
    Location
    TBA
    MS-Off Ver
    Office 365
    Posts
    12,454

    Re: scraping webpage data modification

    I doubt if you read what I wrote in post 2.

    First, the site does not allow multi page requests. The code stopped at the second loop. There are restrictions. There are some people who claim you can get around this problem, but I doubt it if the owner does not allow multi request.

    Second, if you overcome the limitation issue, you need to find the elements where the data is stored to scrape it.

  5. #5
    Registered User
    Join Date
    07-11-2016
    Location
    Delhi, India
    MS-Off Ver
    7
    Posts
    47

    Re: scraping webpage data modification

    Hi AB33,


    Much appreciated for your help and concern.
    As i am not trying to access this(WIKI) site for any use, its just a sample web page. My company web page have lots of restriction, that why i cannot post that, and this example was very much similar to what i was trying to achieve with macro.

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Scraping Java Webpage into Excel 2013
    By free008 in forum Excel Programming / VBA / Macros
    Replies: 6
    Last Post: 05-11-2023, 10:04 AM
  2. Web Scraping Data Using VBA
    By zaska in forum Excel Programming / VBA / Macros
    Replies: 16
    Last Post: 02-25-2017, 09:52 PM
  3. [SOLVED] Help scraping data from webpage into a sheet based on date
    By ozbad5243 in forum Excel Programming / VBA / Macros
    Replies: 15
    Last Post: 11-23-2016, 06:43 PM
  4. [SOLVED] Data Scraping
    By underwater24 in forum Excel Programming / VBA / Macros
    Replies: 3
    Last Post: 10-30-2016, 11:36 PM
  5. [SOLVED] Webpage scraping into Excel - Run-time error '438': Object doesn't support this property..
    By kaseyleigh in forum Excel Programming / VBA / Macros
    Replies: 10
    Last Post: 12-29-2014, 08:15 AM
  6. scraping a webpage for flood info
    By yarrick22 in forum Excel Programming / VBA / Macros
    Replies: 6
    Last Post: 02-13-2014, 02:35 AM
  7. Data scraping
    By brewers7 in forum Excel General
    Replies: 8
    Last Post: 02-06-2011, 12:45 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1