Dragging to remove breakpoint doesn't always remove it

Here the first drag shows smoke animation but the breakpoint stays.
Second drag does remove it.

Seems to be something to do with hovering over the resize view widget.