Yes, male ants do produce sperm.
According to research, male ants do produce sperm. Their testes, however, degenerate at a young age after they have finished sperm production. After mating, the sperm is transferred to the queen ant, who stores it for her entire lifespan. She does not need to mate again after this initial transfer.