Retain incoming callerID on Other phone numbers to dial

Hopefully this an easy fix. On device based hunt list, there's the Other phone numbers to dial option which works perfectly for having a cell phone ring along with the SIP phone (small office, they don't care if cell phone voicemail answers). But unfortunately the callerID going the the "Other Phone Number" number is that of the tenants default callerID. I tried adding dial commands o for fun but it didn't change anything. Any easy way for it to retain the original caller id?