Consider removing `path_id` from `Responder`

[TheBlueMatt]

See discussion at #3078 (comment). Need to figure out for this release as it will change serialization that we don't want to deal with backward compat for.