Lets see if I can some this up. People quit bowling because it is too easy and they quit golf because it is too tough.
Seriously, not sure about golf but bowling started to die at the organized level when other activities started cutting into hunior bowling. 40 years ago every house in town was full with juniors on Saturday morning. Only a small percentage went on to adult leagues, but a small percentage of a big number is still signifivant