Generally, no, you don't wear clothes in a Japanese bath (onsen) bathing area.
According to provided reference, you can't wear anything in the bathing area.
Exceptions:
- Unisex Onsen: Some unisex onsen may allow you to cover up. It's always best to double-check the specific onsen's rules beforehand.
Onsen Towel:
- If you feel self-conscious, you can use a small onsen towel for modesty when entering the water.