Your system worked for me the first 2 years.
After that I took soooo many pictures, sometimes of the same scenes or parts of the county I live in but in all different seasons.
It became hard to remember what day o that season I took that scene since all days have their own folders.
You should probably come up with simple tags instead of ones that you cant remember.
For me I use some of these for my local shots.
canal, mill, sheep, roosters, structures, morning, sunrise, sunset etc.
I stop at many of my places all times of the day to see the different changes in light
So if I took a picture of the local mill near me and wanted the one I rember taking with sheep but really forget what month it was taken, my tags would help me find it.
I just have to find the time to go back on 2 years worth of extensive local photography to tag them all so I can find them a lot faster