Feature Request: iPad Microphone and Camera Integration for Moonlight/Sunshine Streaming

[rommelandriotti]

Select Topic Area

Feature Request

Body

Feature Description

I would like to request two important features that would greatly enhance the Sunshine/Moonlight streaming experience when using an iPad as a lapdock (remote screen, keyboard, and trackpad) for a Windows PC:

1. iPad Microphone as Windows Audio Input

Enable the iPad's built-in microphone to function as an audio input device on the Windows host machine during Moonlight streaming sessions. This would allow users to use voice chat, voice commands, and other audio input features directly from their iPad without requiring a separate microphone.

2. iPad Camera as Windows Webcam

Allow the iPad's camera(s) to be recognized and used as a webcam on the Windows host machine through the Moonlight/Sunshine connection. This would enable video conferencing, streaming, and other applications that require a camera without additional hardware.

Use Case

Currently, when using an iPad Pro with Magic Keyboard as a lapdock for a Windows gaming handheld (like ROG Ally X), the keyboard and trackpad work perfectly through Moonlight/Sunshine. However, the audio input and camera capabilities of the iPad remain unused, requiring users to rely on third-party solutions that often have limitations (especially with iOS background app restrictions).

These features would make the iPad a complete lapdock solution, providing:

• Full audio I/O (microphone input + speaker output)
• Video input capabilities
• Seamless integration without additional apps or hardware

Technical Considerations

This would likely require:

• Extending the Sunshine streaming protocol to include microphone audio capture from the client
• Adding camera streaming capabilities from the Moonlight client to the Sunshine host
• Creating virtual audio input and webcam devices on the Windows host

Benefits

• Complete lapdock experience using iPad + Magic Keyboard
• No need for additional third-party apps
• Native integration with Sunshine/Moonlight ecosystem
• Enhanced productivity and communication capabilities

Thank you for considering this feature request!

[ReenigneArcher]

The microphone part is on our roadmap: LizardByte/roadmap#56

The web cam part is probably out of scope, but we accept PRs.