If you are a network administrator of your Office Chat domain you should see the “Admin” button at the right top next to the Conversations icon; Kindly refer screenshot here:
In-case you are not the domain Admin, you would not see the “Admin” button as shown above.