worker_db: Only warn on repeated archive read if dataset changed

In larger experiments, it is quite natural for the same dataset
to be read from multiple unrelated components. The only situation
where multiple reads from an archived dataset are problematic is
when the valeu actually changes between reads. Hence, this commit
restricts the warning to the latter situation.
This commit is contained in:
David Nadligner 2018-07-11 20:09:18 +01:00 committed by Sébastien Bourdeauducq
parent 4843832329
commit 141fcaaa8a

View File

@ -227,9 +227,9 @@ class DatasetManager:
else:
data = self.ddb.get(key)
if archive:
if key in self.archive:
logger.warning("Dataset '%s' is already in archive, "
"overwriting", key, stack_info=True)
if self.archive.get(key, data) != data:
logger.warning("Older value of dataset '%s' is already in "
"archive, overwriting", key, stack_info=True)
self.archive[key] = data
return data