That is indeed the case, and the root cause is the "loosely coupled" nature of Groups/Teams. Because they package together multiple workloads, and sometimes the synchronous "notifications" between those workloads fail, it's not that uncommon to have to wait for the background async process to pick up the changes. Thus the delays.