IdeaWell

Project ideas from Hacker News discussions.

Tar Files Created on macOS Display Errors When Extracting on Linux (2024)

Original Article

Hacker News Discussion

📝 Discussion Summary (Click to expand)

1. Apple’s “faithful archive” philosophy
Apple deliberately preserves macOS‑specific metadata (Finder info, resource forks, Gatekeeper tags, etc.) when creating tarballs, treating them as a way to keep the original filesystem semantics intact.

"From Apple's perspective, this is the way to preserve Finder / Gatekeeper / metadata semantics." – LatencyKills

2. Annoyance with hidden macOS artifacts
Many users are frustrated by the proliferation of invisible files like .DS_Store, .fseventsd, and other “garbage‑dump” attributes that clutter archives and can be unintentionally included.

"never seeing another .DS_Store should be a system‑wide option!" – taftster

3. Work‑arounds and portable‑tar strategies
The practical fix is to suppress the extra metadata when creating archives—using the COPYFILE_DISABLE environment variable or tar options such as --no-xattrs/--no-mac-metadata. This lets users produce clean, cross‑platform tarballs without the surprise of hidden attributes.

"setting the COPYFILE_DISABLE=1 env variable would disable the inclusion of macOS‑specific metadata." – LatencyKills

🚀 Project Ideas

Generating project ideas…

macOS‑Safe Tar Helper

Summary

  • Eliminates silent macOS metadata stripping and duplicate warnings when using tar, preserving Finder metadata for developers who need loss‑less archives.
  • Provides an opt‑in flag (or env var) that automatically disables libarchive’s mac‑specific extensions, letting users export safely without manual hacks.

Details

Key Value
Target Audience macOS developers, DevOps engineers, CI/CD pipelines that generate portable tarballs on macOS.
Core Feature CLI wrapper around libarchive that detects macOS metadata entries and offers --preserve-mac mode, plus embeds a manifest file for later restoration.
Tech Stack Rust + libarchive bindings, optional Python wrapper, distributed as a single static binary via Homebrew.
Difficulty Medium
Monetization Revenue-ready: Subscription (Free tier includes CLI; Pro tier adds CI integration and support).

Notes

  • HN users repeatedly ask “Never seeing another .DS_Store should be a system‑wide option!” – this tool can auto‑exclude such files.
  • Offers a clean path for portable builds while keeping Apple‑centric semantics optional, directly addressing the “latency kills” concern.

Cross‑Platform ArchiveKit#Summary

  • Unified archiver that normalizes file‑system semantics across macOS, Linux, and Windows, preventing surprise metadata loss when moving artifacts between platforms.
  • Supplies a single CLI/library API that maps extended attributes, forks, and streams to standard xattrs, enabling reproducible builds without host‑specific tools.

Details| Key | Value |

|-----|-------| | Target Audience | Cross‑platform CI builders, open‑source maintainers, container image creators. | | Core Feature | Transparent mapping of Finder metadata, HFS+ forks, and NTFS streams to standard xattrs; can output zip/tar/bundle with metadata manifest. | | Tech Stack | Go (core), optional Rust extensions, Docker base‑image plugin. | | Difficulty | High | | Monetization | Revenue-ready: SaaS (cloud API for CI services). |

Notes

  • Commenters lament loss of “principle of least surprise”; this library restores expectation by making any OS behave like a POSIX archive.
  • Can be packaged as a GitHub Action, encouraging discussion in CI communities.

ZeroDSFiles Daemon

Summary

  • System‑wide watcher that auto‑hides and auto‑excludes macOS metadata files (.DS_Store, ._* forks) from user data, while optionally stripping them from archives on the fly.
  • Provides a simple configuration file to customize which hidden patterns are suppressed across the file system.

Details

Key Value
Target Audience macOS power users, backup automation scripts, developers packaging source trees.
Core Feature Inotify‑like daemon (using fswatch) that intercepts creation/modification of hidden pattern files and marks them as “ignored” for archiving tools; can be hooked by tar or rsync.
Tech Stack Swift (CLI daemon), libfswatch, optional C wrapper for integration.
Difficulty Low
Monetization Hobby

Notes

  • Directly answers “never seeing another .DS_Store” frustration voiced on HN.
  • Low barrier encourages community adoption and discussion of extensions (e.g., Windows alternate data streams).

Read Later