Camera Activates in Pocket

I've been noticing an interesting problem of late with my Note 5. As most of us do, I put my phone in my front pocket when it's not in use. Since the camera now activates with a double press of the home button, I'm getting the camera activated quite a bit, which is draining the battery. Has anyone found a solution to keep this from happening? Just curious.