As Kate said, while gender is such a spectrum and even within "labels" of gender identity it can mean different things for different people, what seems to fit most with what you're expressing is agender, non-binary.
There are a bunch of great things to read about this that may help you better understand those terms and yourself:
Gender Queer by Maia Kobabe
Beyond the Gender Binary By ALOK VAID-MENON
How to Understand Your Gender: A Practical Guide for Exploring Who You Are
Life Isn't Binary: On Being Both, Beyond, and In-Between