Yes, Gohan can pull out the Z Sword, but not without transforming.
After initially struggling to pull the Z Sword in his base form, Gohan transforms into a Super Saiyan 2 and successfully pulls the sword from the stone. This feat also results in some damage to the surrounding area, showcasing the immense power he exerted. Kibito is notably impressed by this display of strength. The Z Sword was said to be unbreakable, and therefore, Gohan needed a significant boost in power to even budge it.
