Project ideas from Hacker News discussions.

Measure internet censorship

📝 Discussion Summary (Click to expand)

1. Platform‑level vs. government/ISP censorship – which is the “real” censorship?
- like_any_other: “The most pervasive censorship is who and what social media companies decide to block or suppress. Even in places like China. It's deliberately harder to measure, but any censorship measurement that omits it is like measuring war casualties, but ignoring those on the front lines.”
- geraneum: “Not to minimize the impact of social media censorship, but one should really live in a country like Iran to grasp what pervasive censorship is.”
- howunfortunate: “I'd wager the vast majority of internet censorship is within platform, like that done by Reddit mods.”

2. Perceived trends: Is censorship increasing or decreasing?
- howunfortunate: “Twitter is unarguably far less censored than it was before … censorship in particular seems to be on the backswing, if anything.”
- geraneum: “It’s too soon for such a conclusion IMO. The pervasive Iran‑like censorship I was talking about will rear its ugly head when those authoritarian regimes are established.”
- ACCount39: “Multiple jurisdictions have tried to play the stupid games of 'we'll make a dumb fuck law that creates problems for you, the website operator, and if you don't conform, we'll sinkhole you at ISP level' … The 'age verification' push is a big move in that direction in Western countries.”

3. Difficulty of measuring censorship, especially internal moderation
- walrus01: “It doesn't measure censorship at what we would call layers 4‑7 in the OSI model. It's concerned with IP reachability and layer 3.”
- eigenspace: “If you count platform moderation as 'censorship' then there's practically no uncensored public spaces on the internet.”
- howunfortunate: “Depends on the platform. On Reddit, definitely yes, as almost all censorship is 'deletion style' … But your point is well taken, it's definitely more challenging and expensive than what's being done here.”


🚀 Project Ideas

Generating project ideas…

ModWatch: Real‑time Platform Moderation Transparency

Summary

  • A browser extension + backend that monitors user‑generated content on Reddit, Twitter/X, and Facebook for deletions, shadow‑bans, and DM blocking, providing measurable censorship signals.
  • Gives journalists, researchers, and platform watchdogs transparent, quantifiable data on internal platform moderation, filling the gap left by current network‑only tools.

Details

Key Value
Target Audience Journalists, researchers, digital rights NGOs, power users
Core Feature Real‑time detection of content removal via hash‑based snapshots and API polling, with alerts and visual dashboard
Tech Stack TypeScript/React extension, Node.js backend, PostgreSQL, Puppeteer/Playwright, Twitter API v2, Reddit API, Facebook Graph API (public)
Difficulty Medium
Monetization Revenue-ready: Subscription SaaS (free tier, paid plans for higher volume & API access)

Notes

  • HN user howunfortunate asked: “Is there any attempt to capture that signal?” – ModWatch directly answers that.
  • The most egregious example cited was old Twitter censoring a NYPost article and blocking sharing in DMs; ModWatch would flag such deletions and DM blocks.
  • Provides concrete data for academic studies, transparency reports, and informed debate about moderation policies.

CensMap: Global Network Censorship Measurement Network

Summary

  • A volunteer‑run probe network that runs lightweight HTTP/DNS/TCP tests from diverse vantage points to detect IP‑level blocking, DNS tampering, and throttling, producing live censorship maps.
  • Provides actionable, layer‑3/4 censorship data that complements platform‑focused tools, addressing the need to measure censorship beyond social media and see fragmentation like Russia banning speedtest.

Details

Key Value
Target Audience Network researchers, ISPs, digital rights organizations, curious users
Core Feature Distributed measurement agents (Wasm or lightweight client) that run periodic tests and upload results to a central aggregator for visualization
Tech Stack Go agent, WebAssembly for browser deployment, Prometheus+Grafana backend, Mapbox/Leaflet UI, optional IPFS storage for raw results
Difficulty High
Monetization Revenue-ready: Enterprise API licensing / sponsored data access

Notes

  • Commenters referenced NDT‑style tests and noted that Russia bans speedtest because it helps “map” the network – CensMap supplies exactly that measurement capability.
  • One HN user said measuring censorship is “one heck of a challenge, but … almost by definition ‘impossible’”; CensMap makes it tractable with crowdsourced probes.
  • Enables real‑time visibility of internet fragmentation, useful for policy advocacy, academic research, and evasion tool development.

ContentSentinel: Automated Removal Detection & Alerting for Sensitive Information

Summary

  • A service that watches specific URLs, hashtags, or document hashes across platforms (Twitter/X, Reddit, Telegram, Discord, etc.) and alerts owners when the content is removed, suppressed, or blocked in DMs.
  • Gives activists, journalists, and whistleblowers verifiable proof of censorship, directly addressing the frustration about missing signals like DM blocking and post deletion.

Details

Key Value
Target Audience Journalists, NGOs, whistleblowers, content creators
Core Feature Periodic crawling/search of platforms using public APIs and search indexes, content fingerprinting (hashes), DM simulation via test accounts, and alerting via email/webhook/Slack
Tech Stack Python backend, Celery workers, PostgreSQL, Twitter API v2, Reddit API, Telegram Bot API, optional headless browsers (Playwright) for sites lacking API; React dashboard
Difficulty Medium
Monetization Revenue-ready: Usage‑based pricing (pay per check) or subscription tiers

Notes

  • HN discussion highlighted the NYPost article censored and blocked in DMs – ContentSentinel would detect both the removal and the DM block.
  • howunfortunate’s query “Is there any attempt to capture that signal?” is satisfied by providing concrete, auditable evidence of suppression.
  • Offers practical utility for transparency reports, legal evidence, and raising awareness of selective content takedowns.

Read Later