High Performance
Fast forward to today. Inference is moving closer to the source of the signal, where insights can inform control systems without requiring a slow, expensive, or unreliable connection to the cloud.
On Prem focuses on Lua and WASM, two runtimes that are proven to deploy reliably over the air, or be embedded into firmware, and are uniquely able to orchestrate performance-sensitive code.
I know of a Go-based software agent that tried to keep up with a 4-channel 24-bit A/D converter, and topped out at around 22,000 samples/sec (almost 20x too slow). That's when I learned that low-latency signal processing is at odds with the garbage collector languages.
Rust provides the agility required to execute projects swiftly, while also keeping the door open to targeting WASM or no-std embedded environments.
Lambdas can be developed interactively via the cloud console, and targeted to run on a software agent running on your laptop, or specialty equipment in your test lab designated as a development environment.
Assets can then be exported as script files plus JSON or YAML metadata, and checked into Git.
Continuous Integration tests can rebuild your environment from scratch for each merge request, using our CLI to import your assets.
No problem. Agents can be configured during a "factory burn-in" process, and then the agent can be configured to disable "phoning home" to the cloud for reconfiguration via downloads of new sealed configuration bundles.
Getting started is free if you're in the mood for self-service. Just download the agent, log into the web console, and get started.
If you're panning to operationalize some Python code that is coming from a data scientist's notebook (necessitating its migration to Rust), or are planning self-service aPaaS capabilities for the customers of your specialty hardware, then you might consider a paid pilot, or a source code license of the On Prem software agent, or a white-labelled license of the On Prem Console.
The Rust ecosystem at crates.io contains a rich assortment of high-performance and memory-safe libraries, ranging from Onnx and Tensorflow runtimes, to image, video, and audio processing libraries. Rust can compile to WASM, and then On Prem is able to deploy it over the air to your edge software agent, or package it as firmware.