The word "evidence" has agreed meaning in specific contexts
such as court proceedings, or scientific experiments. The production of such evidence is part of a functional decision procedure usually regarding what to do next. But there is a failure of agreement in other contexts such those involving questions about the "existence of a deity" or "existence of an ultimate reality". In these cases, what some call "evidence" others dismiss as irrelevent.
Now the word "fact" implies it is supported by "evidence", but from the above such status depends on degree of agreement in particular contexts. Thus in the context we might call the Middle Ages, when there was general agreement as to the evidence for the four elements, that was
"a fact". As the context shifts, so too does the status of former "facts". What worked (socially) in context 1, ceases to work in context 2. But there is no indication that there is an ultimate
context involving permanent facts.