I think you need to decide for yourself exactly how you would like to smooth the data, and then, if you can't work out how to do that in Excel, we might be able to help you.
At one extreme, you've already smoothed the data a little, by taking daily averages.
At the opposite extreme, you could just average ALL your data, to produce one single number.
Another, slightly more realistic option, would be to calculate annual averages.
And there are many, many more ways.
For example, you could ignore any value that is more than a certain distance away from a mean.
But you've got to decide for yourself whether or not such an approach would be appropriate to your situation.
Once you've done that, we may be able to help you do it in Excel.