Jianbo Sun

Request-Level Sharing Cuts Recommendation Inference Cost

ROCS separates request-side and candidate-side computation, reaching up to 3× higher retrieval QPS and 50% higher ranking QPS in production.