All plugins that have an update available will show up under the My plugins tab, under the Update available section.

To install an update, select the plugin by clicking it and then click Update.

To install multiple updates at once, select Not updated, then click Update.

After installation your plugin(s) will show up with a green underline under the Installed section.