Sill: Any window from your Mac, live on your iPhone or iPad
Sill is a free, open-source application that streams any window or the entire desktop from a Mac to an iPhone or iPad, enabling full interaction via touch, Apple Pencil, trackpad, and keyboard.
Intelligence analysis by Gemini 2.5 Flash
This GitHub project offers a direct, server-less solution for extending Mac functionality to iOS/iPadOS devices, leveraging hardware video encoding and encrypted connections. It emphasizes privacy and user control, allowing remote access through various network configurations including personal VPNs like Tailscale.
Imagine your Mac computer screen is like a big TV, and Sill is a clever app that lets you watch and control that TV on your smaller iPhone or iPad, just like a magic remote! You can tap, draw with your Apple Pencil, or type on your phone, and it's like you're doing it right on your Mac, all without needing the internet or anyone else watching your screen.
Analysis
Sill represents a significant open-source contribution to the Apple ecosystem, addressing the need for seamless integration between macOS and iOS/iPadOS devices for productivity and remote interaction. The application's architecture is designed for efficiency and security, utilizing native Apple technologies to deliver a responsive experience. It distinguishes itself by operating without intermediate servers or accounts, ensuring that user data and screen content remain private and directly controlled by the user.
HEVC Video
At its core, Sill leverages Apple's advanced hardware capabilities for video processing. The Mac component captures screen content using ScreenCaptureKit and encodes it into HEVC (High-Efficiency Video Coding) format via VideoToolbox. This hardware-accelerated encoding ensures high-quality video streams with minimal latency and reduced CPU load, crucial for a smooth interactive experience. The encoded video is then transmitted over an encrypted TLS 1.3 connection directly to the iOS/iPadOS device, which decodes and displays it. This direct, secure pipeline is fundamental to Sill's performance and privacy claims, as frames are dropped rather than queued if the connection or encoder falls behind, maintaining currency.
Tailscale
Connectivity is a key strength of Sill, offering multiple methods to suit various user environments. Devices can connect on the same local network using Bonjour, via a USB cable for a wired connection, or through a Direct Wireless Connection for peer-to-peer Wi-Fi when no shared network is available. For users needing to access their Mac remotely, Sill supports connections through a user's own VPN, specifically mentioning Tailscale as an example. This integration with personal VPN solutions allows users to extend their secure network perimeter to include their Mac and mobile devices, enabling remote access without compromising the server-less and private nature of Sill's core design. The pairing process, involving a code scan or manual entry, ensures that only authorized devices can connect, with each end knowing the other's key for pinned connections.
iPhone Duo
Sill is designed with a strong focus on user interaction and device-specific optimizations. It supports a wide range of input methods on the iOS/iPadOS device, including touch gestures, Apple Pencil for precise pointer control, and external keyboards and trackpads. The application translates these inputs into mouse and keyboard events on the Mac through Accessibility services, providing a comprehensive control experience. Notably, Sill includes specific layouts for iPhone Duo devices, adapting its interface to the foldable form factor. When opened flat, the Mac's display fills the inner screen; half-open, the picture is above the fold with controls below; and when closed, Sill runs on the cover display. This thoughtful design ensures an optimized user experience across different Apple devices and form factors, further enhancing its utility as a versatile remote display and control solution.
Key points
- Streams Mac windows or desktop live to iPhone and iPad.
- Supports full interaction via touch, Apple Pencil, trackpad, and keyboard.
- Utilizes HEVC video encoding and TLS 1.3 encrypted direct connections.
- Connects via local network, USB cable, Direct Wireless, or user's own VPN (e.g., Tailscale).
- Free, open source, requires no accounts or intermediate servers, prioritizing privacy.
Sill could significantly enhance productivity for Mac users by transforming their iOS devices into versatile secondary displays or control surfaces, fostering a more integrated Apple ecosystem experience without subscription costs or privacy concerns. Its open-source nature might also encourage community contributions, leading to further innovation and feature enhancements.
The reliance on specific macOS and iOS versions (14/17+) might limit adoption for users with older hardware or software. Performance could be inconsistent depending on network conditions or Mac hardware, and the lack of a central server might make initial setup or troubleshooting more complex for less tech-savvy users.