Not sure if this is intended behavior, but when I disable Join Meshes Enabled it gets enabled again when I open blender again or make a new file.