Might be obvious to some, but not to me: you have to save org-protocol.app under `/Applications` for this to work.