tanmaylaud
/

ret-phi2-v0

Sentence Similarity

sentence-transformers

Eval Results (legacy)

Model card Files Files and versions

Phi2 Model Trained for retrieval task using MSMarco Dataset

Trained for 1 epoch using the tevatron library

Ongoing work

Downloads last month: 2,756

Safetensors

Model size

3B params

Tensor type

F32

·

Datasets used to train tanmaylaud/ret-phi2-v0

Spaces using tanmaylaud/ret-phi2-v0 11

Evaluation results

map_at_1 on MTEB ArguAna
test set self-reported

24.609
map_at_10 on MTEB ArguAna
test set self-reported

39.404
map_at_100 on MTEB ArguAna
test set self-reported

40.421
map_at_1000 on MTEB ArguAna
test set self-reported

40.437
map_at_3 on MTEB ArguAna
test set self-reported

34.258
map_at_5 on MTEB ArguAna
test set self-reported

37.078
mrr_at_1 on MTEB ArguAna
test set self-reported

24.822
mrr_at_10 on MTEB ArguAna
test set self-reported

39.480
mrr_at_100 on MTEB ArguAna
test set self-reported

40.498
mrr_at_1000 on MTEB ArguAna
test set self-reported

40.513
mrr_at_3 on MTEB ArguAna
test set self-reported

34.436
mrr_at_5 on MTEB ArguAna
test set self-reported

37.156
ndcg_at_1 on MTEB ArguAna
test set self-reported

24.609
ndcg_at_10 on MTEB ArguAna
test set self-reported

48.274
ndcg_at_100 on MTEB ArguAna
test set self-reported

52.654
ndcg_at_1000 on MTEB ArguAna
test set self-reported

53.037
ndcg_at_3 on MTEB ArguAna
test set self-reported

37.558
ndcg_at_5 on MTEB ArguAna
test set self-reported

42.678
precision_at_1 on MTEB ArguAna
test set self-reported

24.609
precision_at_10 on MTEB ArguAna
test set self-reported

7.688