Yup. It will detract from it no question. How much depends on what kind of rowing you're doing. 2k is probably going to be more endurance based clearly.
I wonder, actually, if you do mostly interval sprints how that would transfer over to rowing.. because doing intervals for sprinting really brings down 1-2 mile times significantly (if you have a grasp of good pacing).