What is this plant?

My mother-in-law gave me this plant about 5 years ago as a 6 inch shoot she “harvested” from a potted plant in Florida. She thought it was a nutmeg tree, but the leaves are nothing like a nutmeg. I’ve kept it as a house plant and put it outside for the summer. The first few years, it lost all its leaves over the winter. I moved it to an east window and now it keeps more than 1/2 its leaves year-round. It bloomed last year and again this year. Any ideas?