Skip to content

issues Search Results · repo:rlancemartin/auto-evaluator language:Python

Filter by

9 results
 (49 ms)

9 results

inrlancemartin/auto-evaluator (press backspace or delete to remove)

I would really love to see how the open source embedding instruct models compare to the top from openai: - facebook/tart-full-flan-t5-xl · Hugging Face - hkunlp/instructor-xl · Hugging Face Any chance ...
  • lightningRalf
  • Opened 
    on May 26, 2023
  • #16

Traceback (most recent call last): File /Users/helen/code/xiaomi/auto-evaluator/venv/lib/python3.9/site-packages/streamlit/runtime/scriptrunner/script_runner.py , line 565, in _run_script exec(code, module.dict) ...
  • codehelen
  • 1
  • Opened 
    on Apr 26, 2023
  • #15

Use langchain-serve to expose auto-evaluator as an API to enable integration with external services.
  • deepankarm
  • 4
  • Opened 
    on Apr 20, 2023
  • #12

Currently SVM retriever has a create_index def that will embed a list of chunks: def create_index(contexts: List[str], embeddings: Embeddings) - np.ndarray: return np.array([embeddings.embed_query(split) ...
  • rlancemartin
  • 1
  • Opened 
    on Apr 17, 2023
  • #7

  • rlancemartin
  • 3
  • Opened 
    on Apr 17, 2023
  • #6

  • rlancemartin
  • Opened 
    on Apr 17, 2023
  • #5

Add llama-index evaluation: https://gpt-index.readthedocs.io/en/latest/how_to/evaluation/evaluation.html
  • rlancemartin
  • Opened 
    on Apr 17, 2023
  • #4

https://huggingface.co/spaces This way its easy to use for anyone. Happy to help if you are interested and have any questions!
  • datavistics
  • 4
  • Opened 
    on Apr 17, 2023
  • #2

ValidationError: 1 validation error for ChatOpenAI root Did not find openai_api_key, please add an environment variable OPENAI_API_KEY which contains it, or pass openai_api_key as a named parameter. (type=value_error) ...
  • douyujie
  • 1
  • Opened 
    on Apr 17, 2023
  • #1
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Restrict your search to the title by using the in:title qualifier.
Issue search results · GitHub