They say my whte blood cells are extremly low they mentioned anemia neutropenic can this be a sign of cancer?

My white blood cell count is very low and the doctor wants me to see a specialist. My thyroid, liver,heart was ok I am 57 and I work alot I am scared I might have cancer I am the only one bringing in an income. I am tired alot and I have always been very active.