IdeaWell

Project ideas from Hacker News discussions.

Silk: Open-source cooperative fiber scheduler

Original Article

Hacker News Discussion

📝 Discussion Summary (Click to expand)

3 Key Themes in the Discussion

1. ClickHouse moving to a dedicated async‑I/O library to bypass thread‑per‑connection limits

"Looks really interesting. I assume this suggests that ClickHouse is going to gradually switch to using this library for network and I/O, thus addressing the main weakness (in my mind) of C++ thread‑per‑connection servers, which is, they (surprisingly!) create too many threads and can't really handle more than, say, a thousand active connections at the same time." — nasretdinov

2. Comparison with existing async runtimes such as SeaStar

"Is this comparable to Sea star [0]?" — jeffreygoesto

3. Interest in lightweight fork/join or continuation‑stealing runtimes and exception‑safety concerns > "It’s narrower than Silk/SeaStar: continuation stealing for CPU‑bound recursive code, not a general async I/O fiber runtime." — enduku

"Seems not exception safe when task switching during unwind." — feverzsj

🚀 Project Ideas

Generating project ideas…

Corespun

Summary

  • Provides an exception‑safe, low‑overhead task scheduler with continuation stealing for CPU‑bound recursive workloads.
  • Enables thread‑per‑connection servers to switch to fiber‑based async I/O without rewriting core logic.

Details

Key Value
Target Audience C++ server developers maintaining high‑concurrency network services
Core Feature Continuation‑stealing fiber scheduler with exception safety
Tech Stack C++20, LLVM, optional Rust bindings
Difficulty Medium
Monetization Revenue-ready: Subscription $19/mo

Notes

  • “Finally a safe way to replace my thread‑per‑connection code!” – HN comment
  • Sparks discussion on integrating with existing async MySQL/ClickHouse clients

Asyncify‑Transpiler

Summary

  • Automatically converts legacy thread‑per‑connection C++ code to coroutine‑based async patterns.
  • Generates exception‑safe wrappers and inserts safe unwind checks during task switches.

Details

Key Value
Target Audience Engineers maintaining large, threaded networking codebases
Core Feature Source‑to‑source transpilation with safe unwind instrumentation
Tech Stack Python 3, Clang AST, regex‑based rewrite scripts
Difficulty High
Monetization Revenue-ready: Pay‑per‑repo $500

Notes

  • Users will love avoiding manual async refactor for existing services
  • Will generate debate on migration strategies for monolithic servers

FiberCloud

Summary

  • Managed async I/O layer that wraps fiber schedulers for database clients (e.g., ClickHouse).
  • Offers low‑latency, high‑concurrency connections under 1 k active sockets.

Details

Key Value
Target Audience DevOps and backend engineers using ClickHouse or similar columnar DBs
Core Feature SaaS endpoint exposing async fiber connections with built‑in back‑pressure
Tech Stack Go, gRPC, WebSocket, PostgreSQL wire protocol
Difficulty Medium
Monetization Revenue-ready: Usage‑based $0.02 per 1k connections

Notes

  • “Would finally let ClickHouse handle more than a thousand active connections” – HN sentiment
  • Generates discussion on adopting managed fiber services for real‑time analytics

Read Later