New Scientist is carrying this article summarizing new findings by primatologists concerning speach recognition in monkeys. It would seem a primary, and fundamental, difference is not the ability to recognize words, but the ability to figure out sophisticated language rules like recursion.
While interesting, I wonder what the results would be if the experiments were performed on any of our cousins, the apes.