Skip to content

TODO: support longer response #7

@howarder3

Description

@howarder3

Currently, since we use max_token = 240. Some sentences will be cut due to the max length.
However, user can say "繼續" to continue the response.

Try to enhance this, there are many methods that can enhance this.

  • Reminder 1: Take care of unlimited responses. For example, use asks chatbot to respond in over 1000000 words. That I think it will be calculated in a REALLY LONG time.
  • Reminder 2: Vercel (Free account) will timeout after 10 secs no response. Take care of this.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions