Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
Meta Comphrehensive RAG Benchmark starter kit
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Wiki
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Package Registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
AIcrowd
Challenges
Meta Comprehensive RAG Benchmark - KDD Cup 2024
Meta Comphrehensive RAG Benchmark starter kit
Graph
e229d386de626c35962b33ee66b804dc2be5d1c1
Select Git revision
Branches
1
master
default
Tags
6
submission-test-0
submission-test-1
submission-test-2
submission-test-3
submission-test-4
submission-test-5
7 results
You can move around the graph by using the arrow keys.
Begin with the selected commit
Created with Raphaël 2.2.0
12
Jun
11
17
May
15
14
13
24
Apr
22
12
11
9
8
7
2
1
31
Mar
30
29
26
25
18
12
4
explicitly set workers_use_ray to ensure vllm doesnt fallback to mp backend, leading to interference with communication with evaluators
master
master
Add KG baseline using MockAPI
Add croissant.json.
update links in baselines doc
Update download_baseline_model_weights.md
Update 3 files
Update batch_prediction_interface.md
Merge branch 'batch_predict_interface_v0' into 'master'
aggregate config params in a single place
update batch prediction docs
update baselines docs
add batch prediction interface
Update dataset.md
Update dataset.md
Update timeout in starterkit docs
Add query_time as a parameter to the generate_answer interface
use lxml parser in baseline
Update README.md
Update doc strings refering to search results
update local evaluation to use the unified data schema
update dev data to use the same schema as the released data
Update rag_llama_baseline.py
Update baselines.md
Update user_config.py
Merge branch 'baseline-v0' into 'master'
add baseline related docs
Update local_evaluation.py
update docs# Please enter the commit message for your changes. Lines starting
update docs
update docs
update readme
update readme
add dataset docs
Update local_evaluation.py
add tokenizer + response trimming
update docs
update submission docs
add docker ignore
fix typo
update local docker run script
Loading