Meh, his kid, his rules: "Is this taking the whole Star Trek thing a teensie weensie bit too far? d'Armond Speers spoke only Klingon to his child for the first three years of its life."
Thing is, kids learn languages like a sponge at that age. Other than teaching him a few strange-ish sounds, I'll wager he'll be fine.