Can creating a web scraper be illegal? Let me start with specifying that I'm not asking about the act of web scraping itself, neither the use of the data obtained through that method. What I'm asking exactly in simple terms: Can I be sued for developing a web scraper that targets a specific site and publishing its source code online? EDIT: About the duplicate suggestion - while answers there were helpful, I find the question too general for my case...
When the question is "Can I be sued for..." there can't ever be a really useful answer, because anyone can be sued for just about anything. The suit may be tossed as pointless early in the process, but it can be filed. That said, could there be a valid ground of suit against a developer for creating a scraper? Possibly. Scraping a site could be against the site's TOS. It could be largely a way of committing copyright infringement. It could be unlawful in some other way. For most sites, scraping is not unlawful. Google does it all the time. If there is no legitimate use for the scraper, or very nearly none, so that any user is likely to be acting maliciously and unlawfully, and if the developer knows this, or any reasonable developer should know this, then the developer could possibly be found liable for the illegitimate actions of those who use the scarper. If there is a legit use for the scraper, or the developer would plausibly think that there is, then such development is not illegal, and a successful suit against the developer is unlikely.
...due to the international registration of multiple domains to generate ad revenue by recycling stories across sock puppet networks, giving the impression of multiple, independent companies. None of that is illegal on its face. Internet domains are freely registerable by anyone, anywhere (with the exception of some laws in some nations that restrict such Internet-related activity), and registered privately or publicly, and websites can be hosted anywhere. Writing articles and "spinning" and copying articles (even if that writing is sales gibberish in broken English) among the same copyright owner is legal, and using the same design and layout for a network of sites is legal. The formation of multiple, related companies and shell companies to give the impression that companies are separate and independent is legal (again, with the exception of some business and corporate laws in some nations that restrict such activity). These are all common business practices. Some business practices may appear to be unethical - trying to fool customers in order to make money and get clicks and sell ads. And what you may be feeling is that such activity is unethical. And that's OK. But feeling that they are unethical doesn't make the practices illegal. Many common activities that are considered to be unethical are illegal; but not all. Buyer beware. One way some of that activity may be illegal is if those articles are factually incorrect and promote quack medical treatments, are financial scams requiring payments, are gambling sites or promote other clearly illegal things. But then you get into the complexity of exactly how they are illegal, which jurisdictions are involved, and on and on.
Yes. This is infringement. This infringement might be excused by a &quot;fair use&quot; defense but it probably isn't. At a very small scale tailor to a very specific educational program, for example, for just members of a thirty person English class that they are currently taking, it might qualify as educational fair use. But I get the impression that the contemplated translation project is far more ambitious than that. The underlying content of the events reported in the news are not protected by copyright, but the language used to report those events and any translations of that language, is protected. The only reliable way to solve it is to get permission to do so from the holder of the copyright of the source of the new reports you are translating.
Please Note: This was written before the title change of this question and may no longer be applicable According to the Harvard website: In Feist Publications, Inc. v. Rural Telephone Service Co. 499 US 340 (1991) the United States Supreme Court held that copyright does not extend to a mere compilation of facts. In this case, it was a telephone directory much the same as the one in ProCD v. Zeidenberg 86 F.3d 1447 (7th Cir. 1996). Furthermore, the Court also ruled that something more than simple "sweat of the brow" labor was required before copyright protection would ensue, with some modicum of authorial originality necessary. Accordingly, it was held in Feist that copyright did not extend to a telephone directory, no matter how laborious a task its compilation was. The decision in ProCD v. Zeidenberg 86 F. 3d 1447 (7th Cir. 1996) is highly significant, therefore, in that it permits copyright or quasi-copyright protection to be extended to non-copyrightable material through the use of contract. One would have to consider each meta tag independently. For example, the "description" tag could by copyrightable since it is written for more than just the 'facts', such as a subtle advert for the site that is more than an objective description. However the 'og:type' would not be copyrightable since it would just be considered a fact. Now, if you are using it on another website and sourcing it properly, you could probably use it under "Fair Use" Uses That Are Generally Fair Uses Subject to some general limitations discussed later in this article, the following types of uses are usually deemed fair uses: Criticism and comment -- for example, quoting or excerpting a work in a review or criticism for purposes of illustration or comment. News reporting -- for example, summarizing an address or article, with brief quotations, in a news report. Research and scholarship -- for example, quoting a short passage in a scholarly, scientific, or technical work for illustration or clarification of the author's observations. Nonprofit educational uses -- for example, photocopying of limited portions of written works by teachers for classroom use. Parody -- that is, a work that ridicules another, usually well-known, work by imitating it in a comic way. A copyright would exist on the image. One would have to know what license currently applies to the image to know for sure, however, the "Fair Use" to copyright would still apply. With Fair Use, the entity type that uses the image is important. There is much more leniency when a non-profit uses copyrighted information than when the information is used in commercial activity. (With, of course, more exceptions.)
It would be illegal because only you are allowed to view the comic you purchased. Creating a copy of your comic (e.g photcopying, scanning etc) is not allowed, and showing others a copy of your comic is also not allowed
Sure, you can. But if you, from the US, contract with and pay someone outside the US and then use the results of that effort - the reverse-engineered code, either directly in violation of copyright or to find workarounds - within the US, you may not be culpable in a criminal sense (depending on different jurisdictions and trade/IP agreements), but you certainly would be liable in a civil sense. If the US based software developer (I assume a US-based software company, as you said "outside the US") tracks you down, they can open a civil action against you for any damages they want to claim, including theft of IP, loss of profits, EULA violations, and on and on, because you posses and are using reverse engineered code. How much money do you have to lose?
First I should point out that the Google question is about a different situation, the "snippet" issue where a tiny part of a web page is redistributed, where the issue of resolved in the US by appeal to the "fair use" defense. The proposed scenario as written here is broader since it would go beyond a couple of lines, and goes up to the limit of copy an entire web page. That is copyright infringement, with or without an associated link. Copyright protection is not just about attribution, it is about control. If you can limit your copying appropriately, you may survive under a fair use analysis; but you need to hire a lawyer with experience in copyright litigation to vet your notions of what is "a small amount" etc.
The purpose of the button is not to put liability on you, but to shield the website from liability. The website does not want you looking up information about drugs, deciding that a particular drug is right for you, causing yourself harm and then blaming the website. You may have acted unlawfully but you would have no liability because no injury (financial or otherwise) has been caused to the website. Clicking the button is an assertion that one is a medical professional. This is a false statement, so the website could sue you for the tort of deceit, but there is no injury, which is one of the elements of deceit. The website would not even get nominal damages. The button may also constitute a contract. In exchange for access to a website, you warrant that you are a medical professional. You are not, which is a breach of the contract. However, the damages are nil. Conceivably, if you passed the information on to someone else who misused it, there may be some injury to the website, and then you would have to compensate the website for that injury under one or both of the heads of liability described above. In terms of criminal liability, it is rarely an offence to make a false statement to a private body without some other aggravating element. For example, in Australia, it is an offence to make a false statement for financial gain, or to make a false statement to a government official (regardless of whether there is financial gain etc). But simply making a false statement is not by itself a crime. You may breach a computer law. The United States Computer Fraud and Abuse Act is pretty broad. Obtaining information from a computer without authority is an offence: 18 USC s 1030(a)(2)(C). The only exception is if the web server is in the same state as you and somehow nobody from outside the state can access it: see definition of 'protected computer' in 18 USC s 1030(e)(2).