You can go to the outlook templates in the admin tool, and turn off outlook pop up reminders.