According to the CRL's, and established Mando culture, the Mandalorian warrior forsakes his former life to become Mandoa. Bardan Jusik, the only "known" canon Jedi/Mando, gave up his Jedi status to become part of the Skirata clan. He did keep his light saber, but only as a backup weapon and to be able to keep Scout and Kad trained in Jedi defenses until they made a decision one way or the other as to which path they would follow.
It is generally a bad idea to be a saber jockey Mando because it is just too hard to explain. For a character, it's fine, and even when costuming, you can have saber hilts as trophies or even as a carry over from your character's former life. But, it should never be the first weapon you draw in a fight - even cosplay, pretend fighting.
So, yes to Force adept, no to gauntlet-based mini-saber.