[Rusty]

No, 'sadly famous' isn't quite right.

Instead of that, I would say 'unfortunate fame' or something like it.

Two expressions are needed, I think.

inglorious/ill-fated fame (for the victim)
infamous or notorious (for the perpetrator)