NOESISUser Guide
Guide/NOESIS/Workspaces

Data sources & source settings

Every source has a Record switch, a Live-monitor switch and, where meaningful, its own settings. The settings shown depend on the kind of source, so each panel contains only options that apply.

Open a source's settings#

  1. Open Recording (or the Experiment source matrix on Experiments).

  2. Find the source in Data sources. Use Search sources to jump to it.

  3. Click + Settings on its row. The panel opens beneath the row with the provenance badge first; click − Settings to close it.

Source catalog#

The catalog is built from discovered devices plus every telemetry channel a backend actually produced. Fixed sources:

SourceRecordsClass
MicrophoneRaw audio, digital full scale (mono mix)Direct
Microphone RMSTrailing RMS level (~6.7 Hz)Derived
Microphone SpectrumPeriodic Welch spectra (when enabled)Derived
SpeakerThe exact stimulus samples submitted to the outputDirect
Camera VideoRaw RGB8 framesDirect
Optical Pulse SignalROI mean green (0–1)Derived
Optical Pulse (Candidate)Candidate pulse in bpmPhysiological measurement
Screen StimulusLog of every rendered stimulus frameDirect
Keyboard / Mouse / Touch ScreenWindow input eventsDirect
Game ControllerButtons and axesDirect
Haptic ControllerRumble command logDirect
Serial InterfaceReceived and transmitted bytesDirect
HID Input ReportsRaw reports from one selected device (opt-in)Direct
Bluetooth Signal StrengthBLE advertisement RSSI (opt-in)Direct
RTL-SDR Spectral SurveyAveraged PSD per tuning window (opt-in)Derived
RTL-SDR RF Features17 features per window (opt-in)Derived
RTL-SDR IQ SnippetsRaw 8-bit IQ, lossless (opt-in)Direct
Multimodal SynthesisInterval summaries with missingness and lineageDerived
Raw Input EventsKernel-timestamped evdev streams (Linux)Direct
Telemetry channelsWi-Fi, motion sensors, CPU, GPU, memory, battery, storage, temperatures, fans, backlight… one row per channelDirect

Settings by source type#

Microphone Input device, rate, spectrum, RMS window
  • Input device — System default or a specific endpoint (remembered by a stable ID; a missing device shows “(not present)”).
  • Sample rate — Device default or 8000, 16000, 22050, 44100, 48000, 88200, 96000, 192000 Hz. An unsupported rate is reported as an error; NOESIS never substitutes another rate or device.
  • All input channels are averaged to mono. Set input gain in the OS mixer.
  • Record derived spectrum (Welch PSD) — when ticked: FFT size (256–16384), min / max frequency Hz and spectrum interval s (0.1–10).
  • Advanced — fixed chunk size, supported input formats, and RMS window (samples) (512–48000) for the derived RMS level.
Speaker Output device, rate

Output device and Sample rate as for the microphone. Whenever an experiment drives the speaker, the exact submitted samples are logged.

Camera Video and Optical Pulse Signal Index, format, stride, ROI
  • Camera index, requested resolution (320×240, 640×480, 1280×720, 1920×1080) and frame rate (5, 10, 15, 30, 60 fps). The driver picks the closest supported format; the actual format is logged when the camera opens.
  • Record every Nth frame (1–30) thins the stored video. Acquisition and ROI analysis still use every frame.
  • Optical ROI — x, y, width, height as fractions (0–1) of the frame. It is drawn on the Live Monitor preview.
  • The amber line shows raw video bandwidth before stride; video is stored uncompressed.
Telemetry channels Poll rates, rate cap, processing
  • Shared poll rate for the channel's group: Wi-Fi poll rate (0.5–20 Hz), Motion sensor poll cap (1–200 Hz; the sensor's own rate is used when lower) or System telemetry poll rate (0.5–20 Hz).
  • Recording rate cap — every acquired sample or ≤ 0.5, 1, 2, 5, 10, 50, 100 Hz.
  • Processing — Raw, Filtered or Raw + Filtered. Filtered output is a separate derived channel; raw values are never modified.
  • With filtering: low-pass smoothing τ (0–10 s). Vector sensors add high-pass baseline τ (0–60 s) and, under Advanced · offset correction, per-axis x/y/z offsets subtracted before filtering. With no filter configured, the filtered channel is not produced.
Keyboard Key identities

Record key identities — when off, key events are timestamped but the key is redacted. Only keys pressed while the NOESIS window has focus are seen.

Derived sources RMS, spectrum, pulse

Derived sources are computed from their parent in the analysis worker (~6.7 Hz). The parent must be monitored or recorded.

RTL-SDR sources and Multimodal Synthesis

Configured in RTL-SDR survey & Synthesis settings on the Recording page. See RTL-SDR survey settings and Synthesis settings.

Record vs live monitor#

A source is acquired when either switch is on. Record writes it to the session; Live monitor shows it on screen. Turning both off stops that device's producer entirely, which saves CPU and USB bandwidth.

Technical details#

Tick Show Technical Details in the filter bar (or in Settings) to add a collapsible block to each source with its source key, device ID, backend, driver detail, raw channel name, units and provenance class.

NOESIS · NOESISReader User GuideAn Interdimensional Technology Committee project · interdimensional.tech