most likely it's a caching issue. you could try clearing your browser's cache. or, it could be your server caching your site. or worse (depending on how you look at it) your router or gateway is caching things for you.
I know of people who couldn't see their updated site (not related to this plugin) while they were at home but could see it just fine when they brought their laptops to work.