20–30 min technical screen + routing (H100 retrieval/memory primitive; reproducible under NDA)

[StanByriukov02]

Hi engineers

I’m looking to get routed to the right engineering owner for a short 20–30 min technical screen.

Public-safe evidence from our H100 runs:

• Explicit N×N fp16 materialization becomes infeasible at large N (measured CUDA OOM at N=500,000; attempted allocation is hundreds of GiB).
• An indexed O(N) retrieval path continues to operate at the same N (no N^2 matrix construction).
• Memoization on repeated queries yields a large hot-path speedup (example: 863×).

Under NDA we can provide a reproducible runbook + evidence bundle (logs/scripts) for a controlled review (no repo handover).

Could you route this to the right CUDA/perf + (Triton/TensorRT-LLM) owner for a 20–30 minute technical screen this week?

Thanks,

Stanislav Byriukov

@mc-nv @rmccorm4