Skip to content

Not able to run with OLLAMA #16

@colin-kerkhof

Description

@colin-kerkhof

Hi,

I was trying to run the software using a locally hosted model with Ollama, but I get a KeyError.

It seems Ollama is not actually implement in spite of the instruction in https://github.com/FSoft-AI4Code/AgileCoder/blob/f9924185bcc8db9ba504e588e1a425920d4dd9db/setup_model.md

The model is also not available in this (relevant) enum:

class ModelType(Enum):
    GPT_3_5_TURBO = "gpt-3.5-turbo-16k-0613"
    GPT_4 = "gpt-4"
    GPT_4_32k = "gpt-4-32k"
    STUB = "stub"
    GPT_3_5_AZURE = "gpt-3.5-turbo"
    CLAUDE = 'claude'

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions