I'm making a local roleplaying model for my girlfriend's community server. It's supposed to do roleplay, have a specific talking style(dry while answering to normal stuff and extensive when talking about lore), never talk out of roleplay, have hundreds of pages of lore and information and their rank in lore( discord roles maybe?). It's basically supposed to be just an LLM you can converse with that answers in a specific talking style and has all the lore info. For now I implemented: 10 ish% of the written lore, and it recognizes 3 people, but by discord ID that i inserted in the system prompt. I'm using GPT 5.6 sol(and well 6 sol now) for doing stuff, but i keep running into a problem. When i reach a nice point where the model has a nice talking style and knows information well enough, i tell Sol to add this new lorebook and this info, here now everything breaks. Talking style is fucked, It doesen't recognise people individually anymore, when asked about other unrelated lore it just gets it wrong or hallucinates, or even starts roleplaying as one of the characters in it's lore book out of nowhere. It's connected to discord through a discord bridge that Sol made and a developer dashboard bot. I'm using GPT OSS20b on MXFP4, single 9070xt and 32gb ddr4. Should I maybe fine tune it? PS. im a beginner in AI so if it wasn't obvious i do NOT know what im doing but im trying my best for her.   submitted by   /u/Fit_Island928 [link]   [comments]