logical replication: restart_lsn can go backwards (and more), seems broken since 9.4

Applying: asserts: restart_lsn
Using index info to reconstruct a base tree...
M	src/backend/replication/logical/logical.c
M	src/backend/replication/slot.c
Falling back to patching base and 3-way merge...
Auto-merging src/backend/replication/slot.c
CONFLICT (content): Merge conflict in src/backend/replication/slot.c
Auto-merging src/backend/replication/logical/logical.c
Patch failed at 0001 asserts: restart_lsn

error: Failed to merge in the changes.
hint: Use 'git am --show-current-patch=diff' to see the failed patch
hint: When you have resolved this problem, run "git am --continue".
hint: If you prefer to skip this patch, run "git am --skip" instead.
hint: To restore the original branch and stop patching, run "git am --abort".
hint: Disable this message with "git config advice.mergeConflict false"