You'll probably get used to keeping the bags on. Just too convenient. I take mine off for maintenance and cleaning, that's all. Never put any kind of quick connect on them.
It's really ez to remove and replace the bags. I have Pappa Bags inserts which makes it a bit more complicated and still it's a 5-10 minute job. Don't bother with quick disconnect imo.
Removable bags are removed from a lever inside the bag. Lock the bag.
The stock bag connection points aren't very stable (as noted by some who lost bags mid ride). I imagine it isn't much for someone to pop those latches where the mounting pins slide in.