Supreme Kai is considered to be approximately 1000 times stronger than Frieza. He could supposedly defeat Frieza with a single blow.
While the exact power levels in Dragon Ball are often debated and not precisely defined, the narrative strongly suggests a vast power difference between Supreme Kai and Frieza during the time Frieza was considered a major threat. Supreme Kai's status as a deity and his role in overseeing the universe imply a power far exceeding that of even a fully powered Frieza.
Keep in mind that power scaling in Dragon Ball can be inconsistent, and later transformations and characters may significantly alter the perceived strength comparisons. However, based on the information available during the early stages of Dragon Ball Z's Buu Saga, Supreme Kai's power dwarfs that of Frieza.