This is a closeup of my pop-up diffuser, showing how I added a wide rubber band so it would stay on the front of my lens better.

The rubber band is actually a piece of bicycle inner tube. I attached it to the diffuser with a hot glue gun.