If it's been done irresponsibly, yes, it will have a negative effect on your PS2. However, if you (or whoever modded your console) handled your PS2 with care during the procedure, everything should be fine.
Personally, I own both an X-Port and a modded PS2. I tend to use the X-Port for other...