OPEN WEB INDEX

The Open Web Index is a European-based approach for a competitive and data-protecting digital infrastructure. It aims to build a basis for genuine competition in the digital platform business.

In a nutshell

The main Idea of Open Web Index is to set up a publicly funded, global, searchable index of the Web that is open to competing companies, institutions and civil society actors.The main Idea of Open Web Index is to set up a publicly funded, global, searchable index of the Web that is open to competing companies, institutions and civil society actors.

VISION

To build a public library of the Web.

TECHNICAL IDEA

Separate the index from the services that are built on the index.

PUBLIC VS PRIVATE

While the index should be public, the services can be proprietary.

Structure for separating index and services

Separating the index and the servicesallows for a multitude of services, whether existing as search engines or otherwise, to be run on a shared infrastructure. The figure shows how the public infrastructure is responsible for crawling the web, for indexing its content, and for providing an interface and application programming interface (API) to the services that are built upon the index. While services are allowed to do their own further indexing to prepare documents, some advanced indexing is also provided by the open infrastructure. Furthermore, as modern search engines rely heavily on usage data, these data (most prominently search queries routed to the index) are collected and made available for reuse.

Some possible applications

A web index puts unstructured and heterogeneous data of the Internet into a structured shape. This enables setting up Internet services, which process this data for different kinds of usage.A web index puts unstructured and heterogeneous data of the Internet into a structured shape. This enables setting up Internet services, which process this data for different kinds of usage.

N.B.: This list of ideas is far from being complete and only serves illustrative purposes.

Search

– Web Search
– Vertical Search, e.g., video or scholarly content


Science / Research

– Trend analysis, e.g., political trends
– Language use on the Web
– Research evaluation, e.g., Altmetrics


Data Analysis

– Data aggregation, e.g., company or person dossiers
– Opinion mining 
– Market research


Artificial Intelligence

The OWI could build the foundation for large-scale AI applications, e.g.,
– Maschine translation
– Question answering


Read more. Download our proposal for an Open Web Index

Who we are

We are a team of activists acting under the umbrella of the SUMA-EV, a nonprofit organisation to help secure free access to the knowledge and information embodied in the Internet.

CONTACT US

dirk.lewandowski@haw-hamburg.de