Yes, society will miss religion when it is gone. When you go from a society of adults taking care of problems themselves to a society of children asking the government for help, only tyranny can ensue.
Trust me, it's not easy being Catholic these days. With so many other distractions - and just plain laziness - it is very easy to just drift away. Drift away for both individuals and society.