If When Robert returns, the only drawback will be having to endure Wendy's insistent whining. We think it's bad now but it'll be 10000x worse. However, if it ends up running Wendy out of the village all together then I'll happily suffer it.
Do we want Robert to return as a broken shell of his former self or a legitimate post prison bad guy? Or something else entirely? I lean towards the broken shell version myself.