We are seeing this same issue - user1 calling on behalf of user2. Using the web client the caller id correctly shows user2. Using the regular client the caller id incorrectly shows user1.  Did Microsoft provide a solution?

We support Ukraine and condemn war. Push Russian government to act against war. Be brave, vocal and show your support to Ukraine. Follow the latest news HERE