Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Models list refactor #14

Closed
dnakov opened this issue Mar 15, 2024 · 6 comments
Closed

Models list refactor #14

dnakov opened this issue Mar 15, 2024 · 6 comments

Comments

@dnakov
Copy link
Collaborator

dnakov commented Mar 15, 2024

          This list is somehow getting too large and confusing for users who start using it. Maybe we can have -mm for the fullist, -m keeping a short/compactist of suggestions ans -m? to document it for humans

Originally posted by @trufae in #12 (comment)

@dnakov
Copy link
Collaborator Author

dnakov commented Mar 15, 2024

Maybe something interactive like this, lmk what you think:
r2ai -P (provider) goes into interactive selection
[*] openai
[ ] anthropic
[ ] local (gguf)
[ ] local (other)

Next is (say you chose openAI):
[ ] gpt-3.5-turbo
[] ... etc

The result would be the same as -m <model_name>
Also, you could do r2ai -P openai and it'll just select the default model for that provider

I think we should keep the -M for a list of all models that we've actually tried running ourselves.

@trufae
Copy link
Contributor

trufae commented Mar 16, 2024

What about -mm instead? This way its easier to remember, but i like the idea of default providers. For local i use utopia a lot but that doesnt work for auto mode, and i think we should simplify the process of choosing the model by giving some defaults because 99% of users wont test and compare all models to choose one

@trufae
Copy link
Contributor

trufae commented Apr 10, 2024

ive added the -MM flag, can you check this out? also i did several more improvement and added a setup.py with the r2ai program. so in theory doing pip install r2ai will make 'r2ai' to be available in the path. its the first time doing this, so i would like to have a double check if you know how that works.

@dnakov
Copy link
Collaborator Author

dnakov commented Apr 10, 2024

setup.py seems good. r2ai works fine with pip install . I made a small update to get the relative path in main.py so that you can still invoke it with r2 -i main.py

@trufae
Copy link
Contributor

trufae commented May 3, 2024

@trufae
Copy link
Contributor

trufae commented Jul 17, 2024

done

@trufae trufae closed this as completed Jul 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants