Skip to content

issues Search Results · repo:rlancemartin/auto-evaluator language:Python

Filter by

9 results
 (49 ms)

9 results

inrlancemartin/auto-evaluator (press backspace or delete to remove)

rlancemartin/auto-evaluator
add support for open source models

I would really love to see how the open source embedding instruct models compare to the top from openai: - facebook/tart-full-flan-t5-xl · Hugging Face - hkunlp/instructor-xl · Hugging Face Any chance ...
  • lightningRalf
  • Opened 
    on May 26, 2023
  • #16

rlancemartin/auto-evaluator
Is there a limit on the size of the PDF? A PDF with a size of 200kb reported an error

Traceback (most recent call last): File /Users/helen/code/xiaomi/auto-evaluator/venv/lib/python3.9/site-packages/streamlit/runtime/scriptrunner/script_runner.py , line 565, in _run_script exec(code, module.dict) ...
  • codehelen
  • 1
  • Opened 
    on Apr 26, 2023
  • #15

rlancemartin/auto-evaluator
Expose auto-evaluator as an API?

Use langchain-serve to expose auto-evaluator as an API to enable integration with external services.
  • deepankarm
  • 4
  • Opened 
    on Apr 20, 2023
  • #12

rlancemartin/auto-evaluator
Improve speed of SVM retriever index creation

Currently SVM retriever has a create_index def that will embed a list of chunks: def create_index(contexts: List[str], embeddings: Embeddings) - np.ndarray: return np.array([embeddings.embed_query(split) ...
  • rlancemartin
  • 1
  • Opened 
    on Apr 17, 2023
  • #7

rlancemartin/auto-evaluator
Create HuggingFace space

  • rlancemartin
  • 3
  • Opened 
    on Apr 17, 2023
  • #6

rlancemartin/auto-evaluator
Add WandB integration

  • rlancemartin
  • Opened 
    on Apr 17, 2023
  • #5

rlancemartin/auto-evaluator
Add llama-index support

Add llama-index evaluation: https://gpt-index.readthedocs.io/en/latest/how_to/evaluation/evaluation.html
  • rlancemartin
  • Opened 
    on Apr 17, 2023
  • #4

rlancemartin/auto-evaluator
Would you consider making this a hugging face space?

https://huggingface.co/spaces This way its easy to use for anyone. Happy to help if you are interested and have any questions!
  • datavistics
  • 4
  • Opened 
    on Apr 17, 2023
  • #2

rlancemartin/auto-evaluator
I've passed in the openai_api_key but still getting this validation error

ValidationError: 1 validation error for ChatOpenAI root Did not find openai_api_key, please add an environment variable OPENAI_API_KEY which contains it, or pass openai_api_key as a named parameter. (type=value_error) ...
  • douyujie
  • 1
  • Opened 
    on Apr 17, 2023
  • #1
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Restrict your search to the title by using the in:title qualifier.
Issue search results · GitHub