Freeze Panes re-setting after a Custom View?

[SamAnnElizabeth]

I hope there's an explanation for this. I'm setting a custom view that has certain sorts set on my data. I'm filtering by columns E and I. Once I've applied the custom view, I go to Data-> Sort & Filter-> Clear so that I can see all of my data again. When I do that, the data that was filtered out of my custom view (ie not showing) becomes a part of the frozen header rows at the top.

Is there a way I can fix this besides re-setting the frozen panes each time I look at a custom view?

Thanks!