But just because some of us accept 3rd party access to our front & rear-facing phone cams in order play a game of Squirrelly Nut Crush, doesn't mean Starfleet crew would so easily surrender their own right to privacy. They wear the combadge at all times, but they do not monitor each other (even when it would be a quick solution to a major problem, such as stealing a shuttle). Knowing it could be remotely activated at any time is entirely a different proposition. Let alone leaving it on! The cure is worse than the disease.
It might relate to the same reason they don't lock their food pantries, weapons lockers or com panels.
(Are you REALLY comfortable knowing your geolocation is ALWAYS a matter of record? Why not make it illegal to forget your phone, seems well within the creeping latitude of acceptability)?