Hello,
I am trying to import data from bitfinex.com/stats
When I do this using Data>from Web I get this error:
Capture.PNG
When I do this using Data>New Query>From Other Sources>From Web I get this error:
Capture.PNG
Any idea how to fix this?
I really need to import that data, please help me to solve this!
That site may be blocking automated way of accessing the data
If your problem is solved, then please mark the thread as SOLVED>>Above your first post>>Thread Tools>>
Mark your thread as Solved
If the suggestion helps you, then Click *below to Add Reputation
Same error message here. When I go to the site online, there is a CloudFlare redirection - I suspect this might be part of the problem.
Ali
Enthusiastic self-taught user of MS Excel who's always learning!
Don't forget to say "thank you" in your thread to anyone who has offered you help. It's a universal courtesy.
You can reward them by clicking on * Add Reputation below their user name on the left, if you wish.
NB: as a Moderator, I never accept friendship requests.
Forum Rules (updated August 2023): please read them here.
so, is there any way to import the data into excel from that site? or is it just not possible because the site somehow prevents it?
IMO there is too much js but still you can copy data directly
Is this page of no use to you?
https://www.bfxdata.com/datadownload/
They don't seem to want to prevent people from accessing their data!
However, do read what it says there - contact them to gain access to what you need.
this would not work, because the data is constantly changing, hence I need to import it so I could update it very easily.Originally Posted by sandy666
Please follow the link in post #6 and see what THEY say about data scraping from their site. If you have a legitimate reason for doing this, contact them and they will help you.
I understand you
but there is some warnings: Object not defined - so they publish worng js maybe or not updated. I can not be responsible for improper site construction. Maybe they forgot about something, who knows? Maybe you need account there?
I could do that, but the thing is, I need the data from multiple (quite a lot of) exchanges, for example this one as well:
https://bittrex.com/home/markets
When I try to import their data, I get exactly the same error, even though there is no CloudFlare redirection.
As you suggested, I could give them an email and ask for the permission to scrape the data, but that would take way too long, these exchanges are overwhelmed by the amount of new customers and issues of existing ones, I am pretty sure I would not receive a positive answer anywhere soon, therefore, I am asking if there is any other option to do this?
Maybe use some special web scraping application as an intermediary and then import data from that application to excel? (I need excel in order to perform calculations).
Here's what they say:
Please note that the csv files available on this page are intended for personal use only. Those who want to use the data provided by bfxdata.com programatically should contact bfxdata@gmail.com to explain what data is required and for what purposes. We'll surely be able to work something out. People ignoring this remark will risk geting their IP adress blacklisted and will be denied access from bfxdata.com altogether. Some of these files are quite large and we'd like to keep them available for everyone. Bots polling these files periodically will require a lot of the monthly available bandwith and that would mean that the bandwidth limits of bfxdata.com's hosting plan would be easaly exceeded, causing the data not to be available for all those other visitors.
For those already polling some of bfxdata.com pages please also contact bfxdata@gmail.com and explain what you are doing and exactly what data you're interested in. Crawling entire pages is just too inefficient and bandwidth intensive. If I don't hear from you soon, be prepared to be denied access....
Sorry for these harsh words, but we're a bit displeased by all those people/bots crawling pages constantly, without bothering to contact us and ask if it's ok poll the data.
For everyone who just want to download these files and import them into a spreadsheet or some other analytics tool, feel free to do so and just ignore these words. It would be greatly appreciated though if you would share your analyses and ideas here, maybe your findings will be useful to other users as well and if they are useful they might just get added to bfxdata.com. Also if you miss data on this page, leave a comment and we'll see if we can add it.
The thing is, I get the same error from other exchanges as well.I understand you
but there is some warnings: Object not defined - so they publish worng js maybe or not updated. I can not be responsible for improper site construction. Maybe they forgot about something, who knows? Maybe you need account there?
I do have an account with them, but how does this help here? I don't need an account in order to perform an import of data to excel, do I?
Given what it says on their site, it would be unethical of us to help you to get their data in any other way. You cannot make the assumption that it will take too long: if your reasons for wanting their data are legitimate, you need to contact them. Please do so.
Thead now closed.
There are currently 1 users browsing this thread. (0 members and 1 guests)
Posting Permissions
LinkBack URL
About LinkBacks
Register To Reply
Bookmarks