@servercrash3583Devops and System design engineer, Independent
Shipped: Lattice
A disk-resident vector index in C++, graph-based ANN search that keeps only 8-bit codes in RAM.
@servercrash3583 @servercrash3583 @servercrash3583A disk-resident vector index in C++, graph-based ANN search that keeps only 8-bit codes in RAM.
Comments1
Welcome to Lounge, Shubhang. Keeping only 8-bit codes in RAM while the graph lives on disk makes me curious about the rerank step: how many full-precision reads from disk does each query need to hold recall, and what does that do to p99 latency?
1 comment
Welcome to Lounge, Shubhang. Keeping only 8-bit codes in RAM while the graph lives on disk makes me curious about the rerank step: how many full-precision reads from disk does each query need to hold recall, and what does that do to p99 latency?