ConnectionError: Couldn't reach https://huggingface.co/datasets/segments/sidewalk-semantic/resolve/main/dataset_infos.json (error 403)
@John6666Dear John and other community members,Do you know why and how to solve this error? I have reset my token several times and it seems doesn’t help the connections at all.Best regards,Sean
2024-11-25T04:30:48Z
To be honest, I’m not sure, but I think your case is similar to the second link?Connection Error when Accessing Dataset URL on Hugging Face🤗DatasetsI am currently experiencing an issue while trying to access my private dataset in my repo 
for example: (https://huggingface.co/dataset/Mustafa21/dataset) 
The error message I encountered is as follows: 
ionError(f"Couldn't reach {url} ({repr(head_error)})")
ConnectionError: Couldn't reach https://huggingface.co/datasets/Mustafa21/dataset/resolve/main/dataset_infos.json (ConnectionError('Unauthorized for URL https://huggingface.co/datasets/Mustafa21/dataset/resolve/main/dataset_infos.json. Pleas…github.com/huggingface/datasetsConnection error of the HuggingFace's dataset Hub due to SSLError with proxyopened06:56AM - 07 Nov 22 UTCleemgs### Describe the bug

It's weird. I could not normally  connect  the dataset H…ub  of  HuggingFace due to a SSLError in my office. 
Even when I try to connect using my company's proxy address (e.g., http_proxy and https_proxy), 
I'm getting the  SSLError issue. What should I do to download the datanet stored in HuggingFace normally?
I welcome any comments. I think those comments will be helpful to me.

* Dataset address - https://huggingface.co/datasets/moyix/debian_csrc/viewer/moyix--debian_csrc
* Log message
```
      ............ OMISSION ..............
Traceback (most recent call last):
  File "/data/home/geunsik-lim/qtlab/./transformers/examples/pytorch/language-modeling/run_clm.py", line 587, in <module>
    main()
  File "/data/home/geunsik-lim/qtlab/./transformers/examples/pytorch/language-modeling/run_clm.py", line 278, in main
    raw_datasets = load_dataset(
  File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1719, in load_dataset
    builder_instance = load_dataset_builder(
  File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1497, in load_dataset_builder
    dataset_module = dataset_module_factory(
  File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1222, in dataset_module_factory
    raise e1 from None
  File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1179, in dataset_module_factory
    raise ConnectionError(f"Couldn't reach '{path}' on the Hub ({type(e).__name__})")
ConnectionError: Couldn't reach 'moyix/debian_csrc' on the Hub (SSLError)
[2022-11-07 15:23:38,476] [INFO] [launch.py:318:sigkill_handler] Killing subprocess 6760
[2022-11-07 15:23:38,476] [ERROR] [launch.py:324:sigkill_handler] ['/home/geunsik-lim/anaconda3/envs/deepspeed/bin/python', '-u', './transformers/examples/pytorch/language-modeling/run_clm.py', '--local_rank=0', '--model_name_or_path=Salesforce/codegen-350M-multi', '--per_device_train_batch_size=1', '--learning_rate', '2e-5', '--num_train_epochs', '1', '--output_dir=./codegen-350M-finetuned', '--overwrite_output_dir', '--dataset_name', 'moyix/debian_csrc', '--cache_dir', '/data/home/geunsik-lim/.cache', '--tokenizer_name', 'Salesforce/codegen-350M-multi', '--block_size', '2048', '--gradient_accumulation_steps', '32', '--do_train', '--fp16', '--deepspeed', 'ds_config_zero2.json'] exits with return code = 1

real    0m7.742s
user    0m4.930s

```

### Steps to reproduce the bug

Steps to reproduce this behavior. 



```
(deepspeed) geunsik-lim@ai02:~/qtlab$ ./test_debian_csrc_dataset.py
Traceback (most recent call last):
  File "/data/home/geunsik-lim/qtlab/./test_debian_csrc_dataset.py", line 6, in <module>
    dataset = load_dataset("moyix/debian_csrc")
  File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1719, in load_dataset
    builder_instance = load_dataset_builder(
  File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1497, in load_dataset_builder
    dataset_module = dataset_module_factory(
  File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1222, in dataset_module_factory
    raise e1 from None
  File "/home/geunsik-lim/anaconda3/envs/deepspeed/lib/python3.10/site-packages/datasets/load.py", line 1179, in dataset_module_factory
    raise ConnectionError(f"Couldn't reach '{path}' on the Hub ({type(e).__name__})")
ConnectionError: Couldn't reach 'moyix/debian_csrc' on the Hub (SSLError)
(deepspeed) geunsik-lim@ai02:~/qtlab$
(deepspeed) geunsik-lim@ai02:~/qtlab$
(deepspeed) geunsik-lim@ai02:~/qtlab$
(deepspeed) geunsik-lim@ai02:~/qtlab$ cat ./test_debian_csrc_dataset.py
#!/usr/bin/env python
from datasets import load_dataset
dataset = load_dataset("moyix/debian_csrc")

```

1.  Adde proxy address of a company in /etc/profile
2.  Download dataset with load_dataset() function of  datasets package that is provided by HuggingFace.
3.  In this case, the address would be "moyix--debian_csrc".
4.  I get the "`ConnectionError: Couldn't reach 'moyix/debian_csrc' on the Hub (SSLError`)" error message.

### Expected behavior


* error message:
ConnectionError: Couldn't reach 'moyix/debian_csrc' on the Hub (SSLError)

### Environment info


* software version information:

```
(deepspeed) geunsik-lim@ai02:~$
(deepspeed) geunsik-lim@ai02:~$ conda list -f pytorch
# packages in environment at /home/geunsik-lim/anaconda3/envs/deepspeed:
#
# Name                    Version                   Build  Channel
pytorch                   1.13.0          py3.10_cuda11.7_cudnn8.5.0_0    pytorch
(deepspeed) geunsik-lim@ai02:~$ conda list -f python
# packages in environment at /home/geunsik-lim/anaconda3/envs/deepspeed:
#
# Name                    Version                   Build  Channel
python                    3.10.6               haa1d7c7_1
(deepspeed) geunsik-lim@ai02:~$ conda list -f datasets
# packages in environment at /home/geunsik-lim/anaconda3/envs/deepspeed:
#
# Name                    Version                   Build  Channel
datasets                  2.6.1                      py_0    huggingface
(deepspeed) geunsik-lim@ai02:~$ uname -a
Linux ai02 5.4.0-131-generic #147-Ubuntu SMP Fri Oct 14 17:07:22 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
(deepspeed) geunsik-lim@ai02:~$ cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=20.04
DISTRIB_CODENAME=focal
DISTRIB_DESCRIPTION="Ubuntu 20.04.5 LTS"

```github.com/huggingface/transformersSSLError: HTTPSConnectionPool(host='huggingface.co', port=443)opened03:46PM - 08 Jun 22 UTCclosed03:02PM - 15 Aug 22 UTCalexsomozaI'm trying in python:

from sentence_transformers import SentenceTransformer…sbert_model = SentenceTransformer('all-MiniLM-L6-v2')

and I get this error:

SSLError: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/sentence-transformers/all-MiniLM-L6-v2 (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate in certificate chain (_ssl.c:1091)')))

I have no proxy, just getting direct to internet !!!
2024-11-25T04:32:54Z
By the way, that model is a gated model, so you can’t use it without permission, but did you get permission?huggingface.coGated modelsWe’re on a journey to advance and democratize artificial intelligence through open source and open science.
2024-11-25T04:43:40Z
Who would’ve thought a tutorial would use a gated dataset, pardon my dumb question. Thanks for helping me out
2024-11-25T04:46:42Z
Who would’ve thought a tutorial would use a gated dataset,What? The model specified in the tutorial was a gated model?If that wasn’t explained in the tutorial, it’s almost a bug!Give me the link. I’ll just report the bug…
2024-11-25T04:48:12Z
It’s a github tutorial that uses huggingface so I don’t know if it counts as huggingface faults… but thanks…Here’s the link, I hope I didn’t shame myself by not reading it properlygithub.comhuggingface/notebooks/blob/main/examples/semantic_segmentation.ipynb{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "CL089-JvFAXe"
   },
   "source": [
    "# Fine-tuning for Semantic Segmentation with 🤗 Transformers\n",
    "\n",
    "In this notebook, you'll learn how to fine-tune a pretrained vision model for Semantic Segmentation on a custom dataset in PyTorch. The idea is to add a randomly initialized segmentation head on top of a pre-trained encoder, and fine-tune the model altogether on a labeled dataset. You can find an accompanying blog post [here](https://huggingface.co/blog/fine-tune-segformer). "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "2UEtIWt0sGkR"
   },
   "source": [
    "## Model\n",This file has been truncated.show original
2024-11-25T04:51:26Z
It’s a github tutorial that uses huggingface so I don’t know if it counts as huggingface faults…Thank you. That’s the github account managed by HF, so it’s HF’s fault.
2024-11-25T05:09:50Z
I raised an issue.github.com/huggingface/notebooksA dataset used in the tutorial is a gated problemopened05:08AM - 25 Nov 24 UTCJohn6666catThe dataset used in one of the tutorials seems to be a gated model, as the title…suggests.
As there is no explanation of this in the tutorial, it seems that it was not gated at the time the tutorial was written.
I noticed this after someone pointed it out in the forum.

### Code
https://github.com/huggingface/notebooks/blob/0454d7dbc7d0b1acbe78fd38e979a30729947026/examples/semantic_segmentation.ipynb#L150
### Gated dataset
https://huggingface.co/datasets/segments/sidewalk-semantic
### Reference
https://discuss.huggingface.co/t/connectionerror-couldnt-reach-https-huggingface-co-datasets-segments-sidewalk-semantic-resolve-main-dataset-infos-json-error-403/127549
2024-11-25T08:40:14Z
Thank you very much, will watch over that issue
2024-11-25T20:41:03Z
This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.