LlexThere's not going to be a huge difference, the rule of thumb - as long as the damping factor is above 8 then it won't really matter. So with NFB's 2ohm output, you'll need a headphone that's at least 16 ohm, that's really easy to achieve.
Any distortion you get above 8 is going to be negligible, there's other sources of distortion that will outweigh any gained from damping. Even with a low damping factor, not many people are going to be able to tell the difference, and some even prefer a bit of colour to a completely neutral frequency response.