Big tech locks data away. Wikidata Gives It Back to the Internet

While Tech and AI GIANTS GUARD their Knowledge Graphs Behind Proprietary Walls, A More Open Model is Quietly Powering Innovative Projects from São Paulo to Nairoobi. Wikidata, The Collaborative Backbone Behind Wikipedia’s structured data, has become the world’s largest free knowledge database.

Lydia Pintscher, who leads the wikidata project at Wikimedia Deutschland, Oversees this enormous experience in open collecting. More than 25,000 Contributors Across 190 Countries Have Built A Database Containing 116.6 Million data points, Edited Nearly 500,000 Times Daily.

Unlike With Proprietary Alternatives, Anyone Can Access, Query, and Contribute to this Growing repository of human know. Developers can build upon this Community-Dr. Driven Knowledge Base Without Worrying About Corporate Gatekeepers or Sudden API Changes.

Pintscher spoke with Fast company About How Open Data Challenges Big Tech Dominance and Enables Innovation in Underserved Markets, and Why Transparency in Knowledge Graphs Matters Matters More Than Ever.

The conversation has been edited for length and class.

What are a less projects buy on wikidata that reflex’s potential for social good?

There are many, but the ones i’d like to highlight are:

• Govdirectory, Making it Easier for People to get in touch with their government and make their Voice heard on topics that matter to them
• OpenSanctions, Tracking Politically Exped Persons, their connections, and the sanctions imposed on them, ensuring that interactive sanctions are enforced
• Aletheiafact, a fact-checking project from Brazil Combating Misinformation
• Open Parliament TV, Making It Easier to Track What Politicians Are Saying in Parliament about Crucial Issues
• Gestapo.terror.orte, a project helping to understand the atrocities of the secret police in Nazi Germany

All of them are grassroots efforts, made possible or easy with the support of wikidata’s data and communication.

When Developers Cold Use Proprietary APIS from Major Tech Companies, Why Choose the More Complex Path of Building on Open Data?

I’ll Answer That Question With Another Question: Do you want to be behlden to the beeims of a major tech company that could decide tomorrow to no longer making Price, and under conditions you cannot agree to? Or would you raather work with and support a movement that cares Deeply About Accsses to Knowledge for Everyone?

On top of that, wikidata empowers you to be an active participant, not just a consumer. You found an issue in the data? Something you really care about is missing? You can go and make the changes in wikidata yourself, directly.

How Does Wikidata’s Approach Difer from How Companies Like Google or Microsoft Manage Their Knowledge Graphs?

The starkest contrast is the openness. In wikidata you can literally go to the website, look up an entry, and sift through every single change that has ever ben made to that entry to see how it goes to it is today. And beyond just being able to see what that entry looks like now or look like in the past, you can also make an edit to it and contribute to the sum of all human know. Right there. With one edit.

The second difference is the complexity and nuance with what we try to model the world. Since the beginning of wikidata I have found so many beautiful, weird, and thought-provoking entities that really do’t a simple model of the world. Did you know about that one year sweden decided to have a februry 30th, for example? Or all the countries that have more than one capital city? There are planty of funny examples but also ons that really matter, such as disputed territories where other websites might decide to show you just one side of the dispute Depending on your accessory depending

We can’t have civil conversations when we don’t even get shown that another view on a topic exists. That’s why I believe it is so important to surface at least some of that complexity. The world we live in is complex, weird, and beautiful, and the technology we use in that world needs to be removed to reflex.

What’s the most notable technical challenge you’ve solved that other Organizations Building Global Platforms Should Know About?

Making a knowledge graph the size of wikidata publicly accessible and Queryable to Everyone is definitely a Technical Challenge, Especially Given the Rate of Changes and Access to the Data. Wikidata Gets Edited Almost 500,000 Times A Day. Our sparql endpoint services about 10,000 requests per minute, and it is growing every day. Building and mainTaining infrastructure to support with the resources of a nonprofit is definitely a challenge.

What’s your sense of how open data projects will evolve over the next few years?

Large Tech Companies have been extracting value from the Commons for many years, be that in open data or free software. As a Society, we need to understand that this is undermining the commons we all relay on, and we need to expect and demand better. I believe, especially in the age of llms and related technologies, that we need to understand what this technology is bill on, and this is often Haappening without guiving back.

So I would like to see people contribute more to open projects like wikidata and then build on that data, all the while giving back to the project they relay on.

The alternative is a world where we are as a social do not have influence over the technology we use every day and that democracy depends on. INTEAD, we’D be beholden to the black-box technology we are given. That’s not a future I wish to live in.

What do you mean about llms not “giving back”?

These larger ai companies are basically strip-mining the internet. They will undermine the source of a lot of the material that they’re training their models on. If they’re not sending people back to projects like wikipedia or wikidata, or many many others, they’re basically cutting them off from the people who actually make the ophlly make the responsible.

Are you saying the sites providing the content might disappear?

So someone put out a blog post about stack overflow analyzing how large language models influenced the traffic on their site. And the analysis suggested that if people are just asking their programming questions to an llm, why would they need to go to stack overflow anymore, Right? But why is the llm altar to answer programming questions? Because it has been trained on something like stack overflow.

So what should ai companies do to ensure the vitality of the communications they’re taking material from?

Two Things. One is recognition in the sense of “Hey, this answer you’re gotting here is coming from these places,” and they’re starting to do that, so that people can find their way their way back to the source of that content. And the second is that that’re making a lot of money, and they should give some of that money back to the projects that are making them that money.

How do Handle Conflicts when Contributors from Different Countries or Just Different Perspectives Disagree about how to how to structure or present information?

There communication processes to handle editorial disputes, starting with discussing the pros and Cons of different ways of describing a site (in what is called is called a wikiproject) Topic. Often, More Senior Editors Can Help Resolve Disagreements that Way, For Example, by Pointing to Best Practices for Modeling or by Asking for References for A Specific Data Point Someone Wants to Add. WORST CASE An Entry Might Get Locked Down by an admin if different parties can’t stop editing back and forth on a particular point.

Many potentially divisive topics thanktly Never even escalate to that Level, in Part decision of how wikibase, the underlying software of wikidata, is live. Based on many years of experience in Wikidata’s Sister Project Wikipedia, from the start we centered it Arind the concept of verifiable. That means an editor cannot just show up and claim something. They need to have a reliable and Trustworth Source for What they Claim, Such as an article in a reputable newspaper.

Additionally, we allow different conflicting views and even conflicting claims to stand side by side, something especially Important for Disputed Territories, For Example, and The FENDEXT to these claims (Explain) The nuance of the situation. This can include things such as which international body supports or does not support a specific territorial claim.

Your 25,000 Contributors Span 190-Plus Countries. How do you ensure voices from marginalized communities are drowned out by more resource contributors?

We are dedicating a lot of effort to ensuring that everyone can contribute data that is relevant to them and their communities. For example, we are running Editing Workshops Africa to help more people make their first steps in contributing to wikidata. We are also working on improvements to editing from mobile devices to make sure people who primarily or even exclusively access wikidata from a mobile phone has a good experience extra World’s Knowledge.

What has surprised you most about how developers worldwide have used Wikidata’s Open Data?

What Astonishes me the most is the fact that many of the applications people are building with the help of wikidata are ons that I would never have developed when we are the first. Take kde itinerary, for example, the digital travel assistant that keeps track of all your travel documents and -to -thehanks to wikidata – reminds you to brings an adapter for your laptop when traveling to Different Power Outlets. Orutter, The Historical Sea-Routing Website That Lets You Imagine How You Might have traveled from Continent to Continent to Continent in Ancient Times.

A bangladeshi development with wikidata can access the same data infrastructure as google. How Does Open Data Level The Playing Field for Innovation in the Global South?

A lot of applications today are powered by data. As a developer, that means you don’t just have to actually build your application, you also have to collect and maintain the data your application relevant. For a large company, that is not as big of a problem, but if you are an individual development or small team, this really limits what you are able to build. This is where wikidata is there to support you, with basic data about the things that matter in the world, from people to events to locations to culture, you name it.

Thanks to a dedicated communication of over 25,000 editors on wikidata, you have access to up-to-date and reliable basic data to build upon. And not just that: wikidata also provides you with links to 10,000 other websites, archives, social media sites, and more to make it easier to access additional data about the topics you need for our application.