Device
Device-specific inputs like camera capture, screen size, and sensor data. Connect your compositions to the real world.
Audio Analysis
Analyzes audio stream and outputs frequency bands. Attack controls how fast values rise on beats (0 = instant, 0.15 = default). Decay controls how slowly values fall after a beat (0.92 = default, smooth falloff). Sensitivity multiplies all outputs.
Inputs:
| Name | Type | Default | Description |
|---|---|---|---|
| audio | AudioStream | - | Audio stream to analyze |
| sensitivity | Number | 1.00 | Amplitude scaling factor |
| attack | Number | 0.15 | Rise speed (0 = instant, 1 = slow) |
| decay | Number | 0.92 | Fall speed (0 = instant, 1 = never falls) |
Outputs:
| Name | Type | Description |
|---|---|---|
| amplitude | Number | Overall volume level (0–1) |
| bass | Number | Low frequency energy 20–200 Hz (0–1) |
| mid | Number | Mid frequency energy 200–2k Hz (0–1) |
| high | Number | High frequency energy 2k–20k Hz (0–1) |
Related: Audio File, Audio Player, Frequency Band, MIDI Controller, Mic Input
Audio File
Load an audio file for analysis and optional playback. Connect to Audio Analysis to visualize frequency bands. Connect through Audio Player to hear it. Analysis mode controls FFT size: Fast (~32ms latency), Balanced (~43ms, default), Detailed (~85ms). Supports MP3, WAV, AAC, M4A, AIFF, CAF.
Inputs:
| Name | Type | Default | Description |
|---|---|---|---|
| path | String | - | Path to audio file (MP3, WAV, AAC, M4A, AIFF, CAF) |
| time | Number | Scene Time | Playback position in seconds |
| loop | Boolean | true | Loop playback when reaching end |
| latency | Option | Balanced (~43ms) (options: Fast (~32ms), Balanced (~43ms), Detailed (~85ms)) | Analysis quality — Fast: lowest latency (~32ms), Balanced: good tradeoff (~43ms), Detailed: best resolution (~85ms) |
Outputs:
| Name | Type | Description |
|---|---|---|
| audio | AudioStream | Audio stream for analysis or playback |
| duration | Number | Total file duration in seconds |
| progress | Number | Playback progress as 0–1 |
Related: Audio Analysis, Audio Player, Frequency Band, MIDI Controller, Mic Input
Audio Player
Controls audible playback of an audio stream. Adjust volume or mute output. Pass-through: downstream analysis nodes still receive the stream. Muting silences speakers but analysis continues.
Inputs:
| Name | Type | Default | Description |
|---|---|---|---|
| audio | AudioStream | - | Audio stream to play |
| volume | Number | 1.00 | Playback volume (0 = silent, 1 = full) |
| mute | Boolean | false | Mute output without disconnecting |
Outputs:
| Name | Type | Description |
|---|---|---|
| audio | AudioStream | Pass-through audio stream |
Related: Audio Analysis, Audio File, Frequency Band, MIDI Controller, Mic Input
Frequency Band
Extracts energy from a custom frequency range. Use for targeting specific frequencies like sub-bass (20-60Hz), kick drums (60-150Hz), or vocals (300-3000Hz). Attack/decay control smoothing. Trigger fires on onset detection in this band — use for beat-reactive effects scoped to a frequency range.
Inputs:
| Name | Type | Default | Description |
|---|---|---|---|
| audio | AudioStream | - | Audio stream to analyze |
| minFreq | Number | 20.00 | Band lower bound in Hz |
| maxFreq | Number | 200.00 | Band upper bound in Hz |
| sensitivity | Number | 1.00 | Energy scaling factor |
| attack | Number | 0.15 | Rise speed (0 = instant, 1 = slow) |
| decay | Number | 0.92 | Fall speed (0 = instant, 1 = never falls) |
Outputs:
| Name | Type | Description |
|---|---|---|
| energy | Number | Energy level in the frequency range (0–1) |
| trigger | Number | 1.0 on onset in this band, 0.0 otherwise |
Related: Audio Analysis, Audio File, Audio Player, MIDI Controller, Mic Input
Mic Input
Captures live audio from device microphone. Select input device from dropdown. Latency controls FFT size: Fast = lowest latency (~32ms, best for beat triggers), Balanced = good tradeoff (~43ms, default), Detailed = best frequency resolution (~85ms, best for spectrum visualizers).
Inputs:
| Name | Type | Default | Description |
|---|---|---|---|
| latency | Option | Balanced (~43ms) (options: Fast (~32ms), Balanced (~43ms), Detailed (~85ms)) | Analysis quality — Fast: lowest latency (~32ms), Balanced: good tradeoff (~43ms), Detailed: best resolution (~85ms) |
Outputs:
| Name | Type | Description |
|---|---|---|
| audio | AudioStream | Live microphone audio stream |
Related: Audio Analysis, Audio File, Audio Player, Frequency Band, MIDI Controller
MIDI Controller
Learn MIDI controls from a device.
This node is polymorphic - it works with multiple input types automatically.
Inputs:
| Name | Type | Default | Description |
|---|---|---|---|
| device | Option | (No device) (options: (No device)) | MIDI input device to learn from |
Outputs:
No outputs
Related: Audio Analysis, Audio File, Audio Player, Frequency Band, Mic Input
Video Capture
Live camera feed as texture with optional depth (iOS).
This is a surface shader node - it can be connected to rendering nodes.
Inputs:
| Name | Type | Default | Description |
|---|---|---|---|
| camera | Option | FaceTime HD Camera (options: FaceTime HD Camera, iPhone 🙀 Camera) | Camera device |
| mirror | Boolean | true | Horizontally flip the output |
Outputs:
| Name | Type |
|---|---|
| color | Visual Output |
| depth | Visual Output |
| colorDimensions | 2D Vector |
| depthDimensions | 2D Vector |
| intrinsics | Float3x3 |
Related: Audio Analysis, Audio File, Audio Player, Frequency Band, MIDI Controller
Viewport Size
Current viewport size in pixels. Use for responsive layouts.
Inputs:
No inputs
Outputs:
| Name | Type | Description |
|---|---|---|
| result | 2D Vector | Current viewport dimensions in pixels |
Related: Audio Analysis, Audio File, Audio Player, Frequency Band, MIDI Controller