Hello,
I am rebuilding a model I have already completed, but it has become too big. VERY BIG. I am basically separating the model into different workbooks now and then putting them all together. The Data Sets being put into the model will contain upwards of 50,000+ records or up into the 100,000's. That's not my current problem, but just a quick overview on the following problem.
My first step is very basic. I have a connection to another Excel Workbook that houses a large datafile. I have a simple pivot table that has necessary fields for my next table. Below is a picture example.
My problem is with Column B. All it is a simple index; counts if there is an actual record and if there isn't return zero. Cell B4=SUM($A$4:A4)*A4 where Column A indicates if there is a field or not.
Currently the Pivot Table is about 36,000 rows. Every try to copy and paste Column B down, Excel freezes. Every time. I have no clue why, but it has been happening or the past 2 hours.
What is going on? I don't understand because my initial model was a file size of 450,000KB. Very big, and yet excel could handle calculations relatively fine. I was pulling down and copying and pasting array formulas and nested iffs across 10s of thousands of rows, and while slow, excel could handle it. Now, excel if freezing on what is a very basic command.
I am sure I am not doing something proper or what not, so I am looking for a design solution anyone may have. However, the main thing I am looking for is an understanding on why Excel is freezing. Is it because it is calculating on a Pivot? Is it because there is a connection? The file size is about 35,000 KB, so while large, it is no where near what I was doing before.
Any help on what to do would be greatly appreciated. thanks!
Note that this doesn't link to the original large model.
I am rebuilding a model I have already completed, but it has become too big. VERY BIG. I am basically separating the model into different workbooks now and then putting them all together. The Data Sets being put into the model will contain upwards of 50,000+ records or up into the 100,000's. That's not my current problem, but just a quick overview on the following problem.
My first step is very basic. I have a connection to another Excel Workbook that houses a large datafile. I have a simple pivot table that has necessary fields for my next table. Below is a picture example.
My problem is with Column B. All it is a simple index; counts if there is an actual record and if there isn't return zero. Cell B4=SUM($A$4:A4)*A4 where Column A indicates if there is a field or not.
Currently the Pivot Table is about 36,000 rows. Every try to copy and paste Column B down, Excel freezes. Every time. I have no clue why, but it has been happening or the past 2 hours.
What is going on? I don't understand because my initial model was a file size of 450,000KB. Very big, and yet excel could handle calculations relatively fine. I was pulling down and copying and pasting array formulas and nested iffs across 10s of thousands of rows, and while slow, excel could handle it. Now, excel if freezing on what is a very basic command.
I am sure I am not doing something proper or what not, so I am looking for a design solution anyone may have. However, the main thing I am looking for is an understanding on why Excel is freezing. Is it because it is calculating on a Pivot? Is it because there is a connection? The file size is about 35,000 KB, so while large, it is no where near what I was doing before.
Any help on what to do would be greatly appreciated. thanks!
Note that this doesn't link to the original large model.
