I agree. I see Arceus as, if anything, some kind of cervine or equine (common thought is it has some centaur or qilin origins).
But I definitely don't see much goat in it, at least personally.
Anybody seen Princess Mononoke? Arceus strikes me in a similar vein to the Forest Spirit, particularly when it is mid-transformation.