W&B Causing GPT3 Run to Crash
Weights and Biases is causing some GPT-3 runs to fail. This seems to occur randomly. When launching multiple identical jobs, the first two can fail because of this and the third one works.

Traceback:

> Traceback (most recent call last):
  File "/opt/conda/bin/wandb", line 8, in <module>
    sys.exit(cli())
  File "/opt/conda/lib/python3.8/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/opt/conda/lib/python3.8/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/opt/conda/lib/python3.8/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/opt/conda/lib/python3.8/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/conda/lib/python3.8/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/opt/conda/lib/python3.8/site-packages/wandb/cli/cli.py", line 86, in wrapper
    return func(*args, **kwargs)
  File "/opt/conda/lib/python3.8/site-packages/wandb/cli/cli.py", line 235, in login
    wandb.login(relogin=relogin, key=key, anonymous=anon_mode, host=host, force=True)
  File "/opt/conda/lib/python3.8/site-packages/wandb/sdk/wandb_login.py", line 65, in login
    configured = _login(**kwargs)
  File "/opt/conda/lib/python3.8/site-packages/wandb/sdk/wandb_login.py", line 268, in _login
    wlogin.configure_api_key(key)
  File "/opt/conda/lib/python3.8/site-packages/wandb/sdk/wandb_login.py", line 154, in configure_api_key
    apikey.write_key(self._settings, key)
  File "/opt/conda/lib/python3.8/site-packages/wandb/sdk/lib/apikey.py", line 223, in write_key
    api.clear_setting("anonymous", globally=True, persist=True)
  File "/opt/conda/lib/python3.8/site-packages/wandb/apis/internal.py", line 75, in clear_setting
    return self.api.clear_setting(*args, **kwargs)
  File "/opt/conda/lib/python3.8/site-packages/wandb/apis/internal.py", line 19, in api
    self._api = InternalApi(*self._api_args, **self._api_kwargs)
  File "/opt/conda/lib/python3.8/site-packages/wandb/sdk/internal/internal_api.py", line 78, in __init__
    self._settings = Settings(
  File "/opt/conda/lib/python3.8/site-packages/wandb/old/settings.py", line 23, in __init__
    self._global_settings.read([Settings._global_path()])
  File "/opt/conda/lib/python3.8/configparser.py", line 697, in read
    self._read(fp, filename)
  File "/opt/conda/lib/python3.8/configparser.py", line 1082, in _read
    raise MissingSectionHeaderError(fpname, lineno, line)
configparser.MissingSectionHeaderError: File contains no section headers.
file: '/root/.config/wandb/settings', line: 1
'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
wandb: Appending key for api.wandb.ai to your netrc file: /root/.netrc
