Yes, a queen bee is a virgin for a period of time.
After a queen bee emerges from her cell, she is initially a virgin. According to the reference, "the virgin queens take their mating flights" approximately 7-10 days after emerging. During these flights, the virgin queen mates with 10-20 drone bees. After mating, she returns to the hive as a mated queen bee. Therefore, before these mating flights, the queen bee is a virgin.
