What is best Excel strategy to enter/analyze/display complex data?

**StiefBijer** · 10-02-2011, 07:30 PM

Hi, thanks for any ideas and support! :-)

I recently began a personal research project that addresses a lot of data (~150+ columns by ~50,000+ rows). The data is all identically time-sorted by day for several centuries (= the same long X time axis). The 150+ Y axes data sets have been quantified for purposes of this project.

The goal is to identify any statistically-valid, time-based repetitive patterns (cycles) underlying the data, and then predict their potential re-occurance in the future.

I need your ideas for a wise initial approach to my:

- data entry.....most of my available data is "raw" so I must process it--via multi-step Excel formuli--into a usable final form

- data analysis....currently I only have educated guesses as to which data combinations and time points may be significant. I need an efficient way to analyze the data in various sets.

- data display ....since people are the best tool for pattern recognition, I need a clear way to multi-configure and display the data sets. My initial idea is to chart the data, using time as the X axis, and many (150?) different data sets on the Y axes.

A survey for previous forum posts like mine shows that pivot tables, summary tables, and maybe multi-sheet and multi-series charts were previously recommended by pro members Teylyn, Andy Pope, MarvinP and others.

The value, if any, of these and other Excel tools is still an exciting mystery to me, an Excel novice.

Only a tiny sample is available, since I have entered just a fraction of the data so far.

Thanks for any help!

**Marcol** · 10-02-2011, 08:17 PM

If Teylyn, Andy Pope, MarvinP and others. can't offer a solution, then perhaps you might want to reconsider your query.

What do you have so far?

As any well respected citizen of Floriduhh might do, post a sample workbook, so us lesser mortals can see your ambitions.

It should clearly illustrate your problem and not contain any sensitive data.

From Forum FAQs

How do I attach a file to a post?

The value, if any, of these and other Excel tools is still an exciting mystery to me, an Excel novice.

The mystreries might then just appear, like genies from a bottle.

**StiefBijer** · 10-02-2011, 11:17 PM

Your post suggests that I have upset you somehow, Marcol.

That was certainly never my intent, so I hope I am simply mis-understanding your post.

I only wish is to complete my project successfully. Being new, I read the forum guidelines for new member posts. It told me to search the forum for similar questions. In doing so, I encountered the names of the people I mention addressing possibly similar issues as I am. Yet their comments for those other posts may or may not be applicable to my need for assistance.

Peace and good will.

**shg** · 10-03-2011, 12:26 PM

I think Marcol was just responding in his usual good humor, Stief.

I doubt anyone can make any type of suggestion without seeing a representative sample of your data, and an explanation in context of what you're looking for.

**Whizbang** · 10-03-2011, 01:27 PM

It sounds like your analysis will soon be way over my head, but it sounds like you are a little daunted by the scope of it as well.

First, I would suggest you chunk your problems into manageable sizes. Your original post requests help on three areas; entry, analysis and display. Each of those is a fairly large category that potentially could have numerous challenges to overcome. Take it one step at a time and idenitfy any issues or problems you have along the way.

As others have said, please provide a sample workbook. But also, clarify your your requirements as specifically as possible. Also, detail what you have tried and have not tried. What worked and what didn't work?

For entry, define the data source and any constraints that may be in place. Is the data being imported? Entered by users? A combination of sources? Identifying the method of entry will greatly help in indentifying the preferred method.

All you have done so far is identify the scope of the project. But now some serious planning and analysis needs to occur before any development can take place.

**StiefBijer** · 10-05-2011, 12:02 AM

Please find above the small sample workbook of my project for your review.

I hope this tiny sample gives you a clear understanding of the X axis (daily timeline column A) and the various 150+ cycles (Y axes, columns B-FZ(?))

I look forward gratefully to any concept suggestions!