James Middleton: It's "Frustrating" Being Kate's Brother