Even a bottom of the barrel N95 has audio acceleration features helping with speech to text, but the LLM inference part still will be far from being efficient.

Plus, you need to keep the card at "ready" state, you can't idle/standby it completely.