As others have said, aiming to become a zookeeper is a worthwhile career goal to have and certainly not one you should have to go on the defensive about. From the sound of it you are passionate about it and entering it for the right reasons, and that should be enough to satisfy others. If they keep questioning it, point out to them that zoology is a recognised branch of biology and it's comparable with other scientific roles.
Best of luck.
