Ethical Scraping

We all 'extract' web data.
That's the WHOLE point of the internet!


Some of us specialise, without even knowing it.
In our little corner of the internet you will find Data Scientists, Marketers, Businesses, Analysts, Hackers, Researchers, Search Engines, Marketing Companies, the data curious, and so many more. Everyone really!

Estimate Your Own Migration Package Price​

I want to migrate:
Please Enter the Number of Forums
Please Enter the Number of Forums Topics
Please Enter the Number of Forums Posts
Please Enter the Number of Pages & Posts
Please Enter the Number of Users
Please Enter the Number of Comments
Please Enter the Number of Taxonomy
Migration Price:

* The price of the full migration may change according to the number of entities

Throughout our development we have always paid heavy regard to what is ethically reasonable and what is not. The law in regards to scraping web data is complicated and will one day see reforms but that is probably a very long time away. It’s not that no one is thinking, or writing, about the ethics of scraping, or harvesting, but rather that both those scraping and those being scraped can’t agree on basic principles. It’s a well trodden path or arguments and precedents and confusion.
Being in the industry so long we have been on both sides of this coin. We scrape data mostly for personal, commercial and above all research projects, but we have employed it as a form of data collection, targeting assets clients assert they have legal rights too.
On the other side, we have always battled with bots when it comes to analytics, and protecting our clients data.

In terms of making the efforts of ethical we adhere to the following principles.

Our Policy (for now) as @ 2021

If it is publicly available, and viewable – a human can see it online – then the data is public domain.

Global Rules

This is by no means comprehensive but shows some examples of organisations and practices that seek to define what is ethical and what is not in the field of data scraping.

You have SOPA on one hand and STOP CENSORSHIP
Then there is technical and non-technical censorship.


on the other side….

Here is the whole history of internet censorship better than we could ever write it.

This website uses cookies to improve your user experience. By using this site you agree to these cookies being set. Find out more in our Privacy Policy