Here’s a helpful write-up for the release you’re referencing:
Page refresh is required for change to chat to occur