Skip to content
Snippets Groups Projects
Commit 78a20186 authored by aicrowd_team's avatar aicrowd_team
Browse files

Update 3 files

- /models/dummy_model.py
- /models/rag_llama_baseline.py
- /models/vanilla_llama_baseline.py
parent ee289afd
No related branches found
No related tags found
No related merge requests found
......@@ -57,7 +57,7 @@ class DummyModel:
Notes:
- If the correct answer is uncertain, it's preferable to respond with "I don't know" to avoid
the penalty for hallucination.
- Response Time: Ensure that your model processes and responds to each query within 10 seconds.
- Response Time: Ensure that your model processes and responds to each query within 30 seconds.
Failing to adhere to this time constraint **will** result in a timeout during evaluation.
"""
batch_interaction_ids = batch["interaction_id"]
......
......@@ -266,7 +266,7 @@ class RAGModel:
Notes:
- If the correct answer is uncertain, it's preferable to respond with "I don't know" to avoid
the penalty for hallucination.
- Response Time: Ensure that your model processes and responds to each query within 10 seconds.
- Response Time: Ensure that your model processes and responds to each query within 30 seconds.
Failing to adhere to this time constraint **will** result in a timeout during evaluation.
"""
batch_interaction_ids = batch["interaction_id"]
......
......@@ -115,7 +115,7 @@ class InstructModel:
Notes:
- If the correct answer is uncertain, it's preferable to respond with "I don't know" to avoid
the penalty for hallucination.
- Response Time: Ensure that your model processes and responds to each query within 10 seconds.
- Response Time: Ensure that your model processes and responds to each query within 30 seconds.
Failing to adhere to this time constraint **will** result in a timeout during evaluation.
"""
batch_interaction_ids = batch["interaction_id"]
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment