Have you checked for an existing issue?
Use case
Basic toolbar buttons can have dividers as you know, but custom buttons for custom embeds can't. I've tried using QuillToolbarCustomButtonOptions() function to insert vertical divider as icon to show it as an alternative way but it also doesn't display divider on screen.
Proposal
It would be nice to have option to display vertical dividers among custom embed buttons.