kkarhi:
Would being able to switch the primary from the remote to the TE and back be enough?
I don't think so. Not if the goal is to have specific scenes from TE assigned to specific/limited scene buttons on the remote you're using (ie 9 buttons on the CA5500R; 12 on the HA07).
But, it's a really good start.