Nvidia Designs Processor For Faster Inference

Nvidia is designing a new inference processor, reported by the Wall Street Journal, and plans to reveal the platform at its GTC developer conference in San Jose in March. The system will incorporate a chip designed by Groq and aims to speed and scale model query responses, with OpenAI reported as a major early customer.