Workaround: Segfault in RCF ByteBuffer on deinit

Currently there is a segfault when using hxtorch if RCF deinits.

This can be workarounded by not performing a full RCF-deinit if
QuiggeldyConnection goes out of scope, but should be investigated
further.

Change-Id: I88b3cbb8277546361752c268a45f41156bb8d482