Fix a refcounting bug introduced in https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/5146 If upstream returns FALSE when processing a latency event, it will be unreffed an extra time Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/5150>