C# Audio Library
Bass Audio Library is one option.
Audio library for c#
I believe NAudio has all or at least most of those features.
WinRt C# Audio Library
The current alpha build of NAudio 1.7 (available via NuGet) does contain a Windows RT assembly and the source code includes a simple demo of playback and recording as a Windows Store app. Since it uses Media Foundation, you'll be able to play most of the file types you suggested (although ogg won't be supported out of the box), and you can construct your audio pipeline to access the audio as floating point samples for analysis.
Things that aren't currently supported are using the Media Foundation encoders to encode, and the various reader/writer classes need to be re-written to use the WinRT asynchronous streams and File I/O APIs instead of the regular .NET ones. Hopefully these features will be added to the library soon.
Related Topics
C# MACro Definitions in Preprocessor
Exclude a Field/Property from the Database with Entity Framework 4 & Code-First
An Efficient Way to Base64 Encode a Byte Array
Use Linq to Generate Direct Update Without Select
Does Anyone Know of a Good C# API for Subversion
In C# Why Can't a Conditional Operator Implicitly Cast to a Nullable Type
How to Create a Constant Value - Only Primitive Types
Newtonsoft JSON Deserialize Dictionary as Key/Value List from Datacontractjsonserializer
When Is Using the C# Ref Keyword Ever a Good Idea
Why Visual Studio Doesn't Create a Public Class by Default
Remove Item in Dictionary Based on Value
Why Is 16 Byte the Recommended Size for Struct in C#
How to Implement the Sieve of Eratosthenes Using Multithreaded C#