mirror of
https://github.com/EleutherAI/lm-evaluation-harness.git
synced 2026-10-11 21:59:53 +00:00
The `__main__` block passed `model=` and `device=` to `run_model_for_task_caching()`, whose signature is `(tasks, cache_requests)` -- both are read from module constants inside the function, so the call raised `TypeError: run_model_for_task_caching() got an unexpected keyword argument 'model'` before anything ran. With that fixed the script then failed with `NameError: name 'request_caching_arg_to_dict' is not defined`, because that helper was defined *below* the `__main__` block and so was not yet bound when the block executed. Drop the two extra keyword arguments and move the helper above the `__main__` block, next to its only caller.