The Polish sentence isn’t half as ambiguous as the English translation—in fact, I don’t think it could be interpreted as referring to anything other than distance.
(I don’t really like the Polish sentence here, it sounds a bit artificial and I can’t really imagine myself using it. Looks like it’s a translation of the English sentence, and it’s quite hard to translate it well without context.)
Of course, “daleko” can also be used in a metaphorical sense, as in “daleko mu do doskonałości” (= “it is far from perfect”). However, it isn’t used in superlatives, as in the English “far better”.