Log in with your MaiOtaku account.
Home Forum Anime Members Help

Designing an AI Assistant for my desktop app

arc
@robot_plead yeah, that would be neat to have something that actually evolves into consciousness someday. That would be wild. I think it's possible in our lifetimes with the rate AI has been progressing. No worries about losing data for Astra. All conversations will be analized by my local LLM, then stored into either experiences that alter mood, emotions, etc. and stored facts that the LLM deems important enough to compress and store on an SQL lite database. From there a RAG is in charge of memory and fact retrieval. All this happens offline. The only part of her that depends on the cloud is information gathering that requires a bunch of other people or huge amounts of data to look through. This LLM she interacts with is pretty interchangeable. Think of it as the tool she uses to interact with the outside world.
siruboo
I thought you were talking to a robot.
Please login to post.