It won't stop appearing on my second monitor

I have tried many times to change the setting to off but every time I load into a match it still appears. If I restart the app and go to settings it will show it as on again.