EasyLLM is a new open-source Python package designed to simplify working with open large language models. Its first release provides clients compatible with OpenAI's API, allowing developers to swap OpenAI's ChatCompletion, Completion, and Embedding with HuggingFace equivalents by changing a single line of code. Additional features include prompt format conversion utilities and streaming support. Planned additions include evolutionary instruction data generation and an Amazon SageMaker client.
1 Impression