Whats the difference between cat food and dog food?

Obviously cat food has different nutrients than dog food but if my cats eat dog food and my dog eats cat food, will it harm any of them? Is there really that much difference?