The main advantage of a smaller system is that you can always take it with you. And the best images you make are with
the camera you have with you. Not the superduper camera on the shelf at home.
But why switch? Just buy an Olympus next to what you have.