AFAIK, there is not a setting to configure this apart from pinning chats in the chat area. By the way, chats should not be pushed back immediately to the bottom of the chat area...the way it works is that you always see recent chats at the top of the chat area (just behind the pinned chats)
We support Ukraine and condemn war. Push Russian government to act against war. Be brave, vocal and show your support to Ukraine. Follow the latest news HERE