Linear Algebra Library

MathNet.Numerics has a pretty solid linear systems solver, and has multiple additional native providers that, depending on what hardware you have to work with, and the size of your solves, dramatically increases performance.

Well, let's start with which ones you have looked at, and why they aren't to your liking.