One issue is the missing `reinit!` method for the new handling of ForwardDiff duals. An attempt to add it is here: https://github.com/SciML/LinearSolve.jl/pull/836