I didn't mind Xen at all. It was a nice change from Black Mesa.
And I don't remember ever being teleported by Nihilanth. Whenever he launched a portal at me I hid behind one of those spiky things and he always missed...
perhaps there is enough xen envirement seeping through to our dimension in HL2 that there is no need to have a seperate dimension for Xen to travel to..