Updating App.Config on-the-fly

Like most .NET developers, I use an application configuration file to store information that will be needed by my application at run-time. But what happens if you want to change the values that your application is using while the application is running? Fear not: there is a solution!