PricingBlog

Open AI Assitent with Xano

  • isaact7359-1275137353312374874

    IsaacT

    1 year ago

    I have seen that there is a package that works with an AI Chat, but I am specifically looking for a tutorial or documentation to create an assistant in Toddle with Xano and Open AI. Could someone give me some guidance?
  • yoelfdz-1275143582860312689

    yoelfdz

    1 year ago

    What do you mean by assistant? If you mean a chatgpt like interface check the packages channel. If not please explain it further so we can help!
  • isaact7359-1275154992764027041

    IsaacT

    1 year ago

    Thanks for your answer. I've seen the package but I don't think it's what I'm looking for. For production they don't recommend it.

    By assistant I mean this:

    https://platform.openai.com/docs/assistants/overview

    A ChatGPT that I can instruct to respond in a certain way.

    The idea is to capture in Xano the information given by the user from a multi step form.
    Send it to OpenAI, capture the answer in Xano and show it in Toddle.
  • lucasg-1275155119423623301

    Lucas G

    1 year ago

    I'm not familiar with Xano but how easy is it to create functions in it?
  • Some people use something like BuildShip or even n8n/zapier
  • Essentially, a request is submitted in your app then on the backend it is added to xano and sent to an openai assistant to create a message then a run
  • isaact7359-1275155482042175610

    IsaacT

    1 year ago

    @Lucas G Builship is a backend to manage the logic but not a DataBase
  • lucasg-1275155572076970115

    Lucas G

    1 year ago

    Depending on the backend you choose, you'd either subscribe to the run status for an update or just give a delay to check the messages list
  • Well technically buildship does have a database but I wouldn't use it as a database either
  • It should be able to send the data to xano though
  • Via API
  • 637406142665850880-@IsaacT
    Thanks for your answer. I've seen the package but I don't think it's what I'm looking for. For production they don't recommend it.

    By assistant I mean this:

    https://platform.openai.com/docs/assistants/overview

    A ChatGPT that I can instruct to respond in a certain way.

    The idea is to capture in Xano the information given by the user from a multi step form.
    Send it to OpenAI, capture the answer in Xano and show it in Toddle.
    yoelfdz-1275179213896290304

    yoelfdz

    1 year ago

    @IsaacT , I think you are talking about a vectorstore conversational retrieval chain. Meaning that you want to a chatbot with an AI that has access to any kind of knowledge provided.

    If that's the case:
    I would not recommend building that in Xano, 100% use Flowise or Langflow for that. You need to upsert the docs you want as knowledge on a vector store, which is similar to a database that stores vectors, when you upsert you are splitting text chunks into vectors stored there. The best one is probably Supabase's extension pgvector, but any could work. Once done that, you need to set up the chain in Flowise and connect it with your toddle project as you would do with any chat completions api. If you want the api streamed you'll need to do it on a custom action, for now at least.

    If you need each user to upload its own data, you need to create another workflow that upserts their own data with metadata filters so you can filter in each request

    I've played with that quite a lot, apart from the quality of data provided if you combine it with prompt chainning it's really good for many use cases
  • yoelfdz-1275180933674438838

    yoelfdz

    1 year ago

    By the way that's for building it yourself so there are no limitations and works with any model. If you meant how to integrate the assistants api from Openai, then you need to create it on openai platform and it works very similar to the normal chat completions api. I think, I have not used that option, you are limited to Openai models and it's less cost effective.. but easier to implement I guess
  • lucasg-1275188455479181425

    Lucas G

    1 year ago

    It works via API, nothing really needs to be done on OpenAI itself unless you want to manually create the assistant(s) in the UI
    👍1
  • It is definitely significantly easier to implement but tied to their pricing and models
  • greg.irl-1275413368936726565

    Greg IRE

    1 year ago

    Xano now have vector embeddings power by pgVector; https://docs.xano.com/database/field-types/vector-embeddings

    They have a great video on using it here: https://www.youtube.com/watch?v=075_2Lz-Qec
    🙌1