Edge Device Runs RAG Monitoring With Nemotron-3

A dedicated monitoring Jetson Orin Nano collects logs from multiple inference nodes and runs a local Nemotron-3 Nano 4B model to diagnose hardware failures and send structured satellite alerts in a demo deployment. The hybrid Mamba2/transformer architecture reduces KV cache pressure, enabling a 16K token context on an 8 GB device while running FAISS RAG and re-ranking. End-to-end investigations complete in roughly six minutes.