Hi I've been exposed to python for a long time
Hi I’ve been exposed to python for a long time and I had never track any site before. This time I decide to givehttps://deevid.ai/a try. But before that, I want to know if it is legal to crawl a site like this?I’ve created the codes in the following, will they work?import requestsurl = “https://deevid.ai/”response = requests.get(url)if response.status_code == 200:print(“Page successfully fetched!”)soup = BeautifulSoup(response.content, ‘html.parser’)print(“Page Title:”, soup.title.string)#Find all links on the page
links = soup.find_all('a', href=True)
print("\nLinks found on the page:")
for link in links:
    print(link['href'])

# Find all paragraph texts on the page
paragraphs = soup.find_all('p')
print("\nParagraphs found on the page:")
for paragraph in paragraphs:
    print(paragraph.get_text())else:print(f"Failed to retrieve the webpage. Status code: {response.status_code}")
2025-01-16T12:28:44Z
Crawling and scraping itself is not usually considered illegal, but there are rare cases where you may be accused of overloading the target server, infringing on copyrights, or other such things. Well, it’s rare, but… at your own risk.