For sure, horses can give birth to twins. The thing is that such phenomenon is really rare and actually dangerous for a mother horse. There is not enough space for the foals inside. So when the unwanted twin pregnancy is discovered early it is common for horse owners to have one of the embryos removed.