Microsoft has released a preview version of the Azure Portal app for Windows. I used it for some time now and it works quite well. You get rid of the browser, while the functionalities remain the same as in the Azure portal.
Download for Windows: https://portal.azure.com/App/Download
When on the go, I recommend the Microsoft Azure app for iOS or Android.
App Store Download: https://itunes.apple.com/app/microsoft-azure/id1219013620
Google Play Download: https://play.google.com/store/apps/details?id=com.microsoft.azure