+ Reply to Thread
Results 1 to 23 of 23

Pulling data from a password protected website.

  1. #1
    Registered User
    Join Date
    08-21-2024
    Location
    Manchester
    MS-Off Ver
    Microsoft 365 MSO (Version 2408
    Posts
    32

    Pulling data from a password protected website.

    Hi

    I read a previous post with this problem

    I am trying to set up a formula that will pull data from a password-protected website but using the suggested methods isn't working. I can't seem to get the "Access web content " window to open; I enter the URL and it just opens without giving me the option of selecting "Basic" so I can enter my username and password.Is there any way to force the "Access web content" window to open?

    A "forum expert" replied :


    I assume you are using Get & Transform, from web. It should always take to Access Web content dialog window.
    There you should have Anonymous, Windows, Basic, Web API etc.

    If you don't get that. Connect to base URL (i.e. login page). Then edit source in the query editor to the URL you need. And then, go to Data source settings in the query editor and hit Edit Permissions..
    There you will find Credentials section. Hit Edit. It should bring up Access Web contend dialog.


    Unfortunately I'm not allowed the post the link


    I'd like to follow the same procedure but I'm getting lost in the process.

    For example using this web page

    I hit F12 to access the source page then I have some icons on the bar on the right - one of which is called Sources.

    Is this right so far ? Perhaps someone could show me slowly how to get to credentials so that I can access my full log on details so that I can learn how to connect another protected web page to excel.

    Thank you

  2. #2
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (both in England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2504 (Windows 11 Home 24H2 64-bit)
    Posts
    91,006

    Re: Pulling data from a password protected website.

    Why are you trying to scrape your credentials from the website? You should know what your user name and password are ...

    Please clarify, because we have a rule against bypassing security measures, and at the moment, this reads as if this is what you are trying to do.

    With over 10 posts, you ARE allowed to post links, but here's the older thread: https://www.excelforum.com/excel-pro...ic-option.html
    Last edited by AliGW; 01-15-2025 at 06:09 AM. Reason: Link added.
    Ali


    Enthusiastic self-taught user of MS Excel who's always learning!
    Don't forget to say "thank you" in your thread to anyone who has offered you help. It's a universal courtesy.
    You can reward them by clicking on * Add Reputation below their user name on the left, if you wish.

    NB:
    as a Moderator, I never accept friendship requests.
    Forum Rules (updated August 2023): please read them here.

  3. #3
    Registered User
    Join Date
    08-21-2024
    Location
    Manchester
    MS-Off Ver
    Microsoft 365 MSO (Version 2408
    Posts
    32

    Re: Pulling data from a password protected website.

    Yes I know what my username and password is.

    I'm trying to connect it to an excel spreadsheet.

  4. #4
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (both in England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2504 (Windows 11 Home 24H2 64-bit)
    Posts
    91,006

    Re: Pulling data from a password protected website.

    So why are you looking at the website source code?

  5. #5
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (both in England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2504 (Windows 11 Home 24H2 64-bit)
    Posts
    91,006

    Re: Pulling data from a password protected website.

    In Excel, go to the Data ribbon > From Web > paste the URL into the box and hit OK > select Basic on the left (in the green panel) > enter your credentials.

  6. #6
    Registered User
    Join Date
    08-21-2024
    Location
    Manchester
    MS-Off Ver
    Microsoft 365 MSO (Version 2408
    Posts
    32

    Re: Pulling data from a password protected website.

    Maybe I've misunderstood the original post.

    I'm trying to connect a web page where I need to log into with username and password (which I have) to an excel spreadsheet.

  7. #7
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (both in England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2504 (Windows 11 Home 24H2 64-bit)
    Posts
    91,006

    Re: Pulling data from a password protected website.

    See post #5.

    Did you see my note about your previous threads?

  8. #8
    Registered User
    Join Date
    08-21-2024
    Location
    Manchester
    MS-Off Ver
    Microsoft 365 MSO (Version 2408
    Posts
    32

    Re: Pulling data from a password protected website.

    Quote Originally Posted by AliGW View Post
    In Excel, go to the Data ribbon > From Web > paste the URL into the box and hit OK > select Basic on the left (in the green panel) > enter your credentials.

    I have no Basic option on the left nor Green Panel


    I type the url into the 'From Web' box.

    It Connects

    I see the 'Navigator' Page where I see the displayed text

  9. #9
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (both in England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2504 (Windows 11 Home 24H2 64-bit)
    Posts
    91,006

    Re: Pulling data from a password protected website.

    Are you working in the desktop app or online?

  10. #10
    Registered User
    Join Date
    08-21-2024
    Location
    Manchester
    MS-Off Ver
    Microsoft 365 MSO (Version 2408
    Posts
    32

    Re: Pulling data from a password protected website.

    Desktop app

  11. #11
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (both in England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2504 (Windows 11 Home 24H2 64-bit)
    Posts
    91,006

    Re: Pulling data from a password protected website.

    OK - then in 365, you should see the attached. You must be doing something wrong ...
    Attached Images Attached Images
    Last edited by AliGW; 01-15-2025 at 06:42 AM.

  12. #12
    Registered User
    Join Date
    08-21-2024
    Location
    Manchester
    MS-Off Ver
    Microsoft 365 MSO (Version 2408
    Posts
    32

    Re: Pulling data from a password protected website.

    I get that box from the Amazon url but not from the site I'm trying to access

  13. #13
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (both in England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2504 (Windows 11 Home 24H2 64-bit)
    Posts
    91,006

    Re: Pulling data from a password protected website.

    What's the site you are trying to access? It may be that they do not allow logins like this.

  14. #14
    Registered User
    Join Date
    08-21-2024
    Location
    Manchester
    MS-Off Ver
    Microsoft 365 MSO (Version 2408
    Posts
    32

    Re: Pulling data from a password protected website.

    https://sorareinside.com/

    I'd be surprised if they've disallowed access like this

    (Thanks for your help)

  15. #15
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (both in England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2504 (Windows 11 Home 24H2 64-bit)
    Posts
    91,006

    Re: Pulling data from a password protected website.

    Works exactly the same as Amazon for me, following the steps taken in my screenshots above.
    Attached Images Attached Images
    Last edited by AliGW; 01-15-2025 at 07:02 AM. Reason: Screenshots added.

  16. #16
    Registered User
    Join Date
    08-21-2024
    Location
    Manchester
    MS-Off Ver
    Microsoft 365 MSO (Version 2408
    Posts
    32

    Re: Pulling data from a password protected website.

    How strange!

    Have you any suggestions? Are there cookies or something I could clear ?

  17. #17
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (both in England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2504 (Windows 11 Home 24H2 64-bit)
    Posts
    91,006

    Re: Pulling data from a password protected website.

    I doubt it will be cookies - I have cookies saved for Amazon. No, I have no suggestions - sorry. I can't replicate the problem. You'll have to wait and see if anyone else can.

    Now, have you been back and thanked those who assisted in your last two threads? Also, you need to provide a workbook for your other query this morning.

    Just a thought: is Edge your default browser? Mine is Firefox. So maybe you could try deleting cookies for the site in question in Edge, and then try connecting again in Excel.
    Last edited by AliGW; 01-15-2025 at 07:19 AM.

  18. #18
    Registered User
    Join Date
    08-21-2024
    Location
    Manchester
    MS-Off Ver
    Microsoft 365 MSO (Version 2408
    Posts
    32

    Re: Pulling data from a password protected website.

    To ensure that the ability to enter your credentials is available :

    Data > Get Data > Data Source Settings > Global Permissions

    And delete the relevant url from the list

  19. #19
    Registered User
    Join Date
    08-21-2024
    Location
    Manchester
    MS-Off Ver
    Microsoft 365 MSO (Version 2408
    Posts
    32

    Re: Pulling data from a password protected website.

    After a week of trying I've reached the end of the road for this. I've learnt plenty but getting the url to connect to excel has proved beyond me.
    The website / url is a niche hobby and my password hides no personal data but I can't really post my password here

  20. #20
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (both in England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2504 (Windows 11 Home 24H2 64-bit)
    Posts
    91,006

    Re: Pulling data from a password protected website.

    If you want it tested, and you are prepared to change it after that, you can send it to me in a private message. I could test tomorrow and let you know.

  21. #21
    Registered User
    Join Date
    08-21-2024
    Location
    Manchester
    MS-Off Ver
    Microsoft 365 MSO (Version 2408
    Posts
    32

    Re: Pulling data from a password protected website.

    Thank you. Message sent

  22. #22
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (both in England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2504 (Windows 11 Home 24H2 64-bit)
    Posts
    91,006

    Re: Pulling data from a password protected website.

    I have messaged you back. I do not see any data that is importable or that matches your description. Sorry.

  23. #23
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (both in England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2504 (Windows 11 Home 24H2 64-bit)
    Posts
    91,006

    Re: Pulling data from a password protected website.

    Just FYI: I am heading out shortly - won't be back until later this afternoon.

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Pulling data from a password protected website. No "basic" option
    By Wartrace in forum Excel Programming / VBA / Macros
    Replies: 5
    Last Post: 01-15-2025, 05:50 AM
  2. Pulling data from company website that requires username and password
    By mediocreamateur in forum Excel Programming / VBA / Macros
    Replies: 1
    Last Post: 10-26-2023, 02:47 PM
  3. Replies: 1
    Last Post: 11-11-2020, 02:40 PM
  4. Pulling Data From Password Protected Website Using VBA Macro
    By jdautel in forum Excel Programming / VBA / Macros
    Replies: 1
    Last Post: 06-16-2016, 05:53 PM
  5. Excel 2016 - looking for script to get data from password protected website
    By harris1210 in forum Excel Programming / VBA / Macros
    Replies: 2
    Last Post: 05-25-2016, 01:58 PM
  6. How to download data from password protected website?
    By Excellearner2012 in forum Excel Programming / VBA / Macros
    Replies: 1
    Last Post: 07-21-2013, 08:40 PM
  7. Importing/Refreshing Data from Password-Protected Website
    By daniel3417 in forum Excel General
    Replies: 5
    Last Post: 06-29-2012, 12:46 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1