Most industrial vision has to run on site: latency, bandwidth and privacy all point the same way. That constrains model size and makes deployment and monitoring genuinely harder.
Cloud inference is simpler in every respect except the ones that matter industrially. A reject decision on a moving line has a latency budget measured in tens of milliseconds, which a round trip cannot meet. A dozen cameras streaming continuously to the cloud is a bandwidth bill nobody approved. And in many facilities, footage of the floor is either commercially sensitive or contains identifiable people, which makes off-site processing a compliance question under the DPDP Act rather than an architectural preference.
So the model runs on site, on an industrial PC or an embedded accelerator, and that changes the engineering. Model size and precision are constrained by the hardware, so quantisation and pruning become part of the work rather than an optimisation afterthought. Deployment is harder because devices sit on segmented industrial networks that may be intermittently reachable, so update infrastructure needs the same A/B and rollback discipline as any field-deployed system.
Monitoring is harder still: you cannot watch a model's behaviour if it runs behind an air gap, so the system must summarise its own health locally — prediction distributions, confidence trends, image quality metrics — and report those upward even when raw footage never leaves. Drift is the specific thing to watch for. When a camera slowly fogs, a light dims, or a supplier's material changes, accuracy degrades gradually and nobody notices until a batch escapes. Automated drift detection on the input distribution catches this early, and it is the monitoring that most deployments lack.
- On-site inference for latency, bandwidth and DPDP-relevant privacy reasons
- Quantisation and pruning as part of the build, not a later optimisation
- A/B partitioned updates with rollback for devices on segmented industrial networks
- Local health summarisation — confidence trends, image quality — reported upward
- Input-distribution drift detection, which catches fogging lenses and dimming lights early