Finally using chat gpt at work and it’s STILL just as underwhelming as it was when I tried it c. t-3
Conversation
Notices
-
Woggy's Zeonic Frolicks (washedoutgundampilot@poa.st)'s status on Thursday, 15-Jun-2023 12:32:51 JST Woggy's Zeonic Frolicks -
Woggy's Zeonic Frolicks (washedoutgundampilot@poa.st)'s status on Thursday, 15-Jun-2023 12:36:23 JST Woggy's Zeonic Frolicks @sj_zero It just screws stuff up too often, I was hoping it could translate portions of technical manuals to0 be able to answer questions for people but I think some of the info is just too funky,
-
sj_zero (sj_zero@social.fbxl.net)'s status on Thursday, 15-Jun-2023 12:36:28 JST sj_zero It demos well but the moment you ask it a question it needs to get right the strings become immediately apparent. -
Ame (americanchampion@poa.st)'s status on Friday, 16-Jun-2023 00:59:20 JST Ame @WashedOutGundamPilot @sj_zero I know a very smart guy who was working on something broadly similar, and he went the route of fine-tuning the system. I'm normally not big on RLHF, but it's increasingly tractable for small things, and it might solve your problem.
My assumption is that your current feedback loop is something like:
> user question -> retrieval system extracts relevant manual portion --> LLM translates manual portion to plain EnglishWoggy's Zeonic Frolicks likes this. -
Woggy's Zeonic Frolicks (washedoutgundampilot@poa.st)'s status on Friday, 16-Jun-2023 01:00:27 JST Woggy's Zeonic Frolicks @AmericanChampion @sj_zero I’m just being lazy and trying to have GPT translate foreign POH’s for client questions. I’m seeing a faint whiff of desperation on the horizon, guys are asking about cheaper foreign aircraft where they’d never have considered it before
-
Ame (americanchampion@poa.st)'s status on Friday, 16-Jun-2023 01:20:40 JST Ame @WashedOutGundamPilot @sj_zero Like, the entire handbook at once? I'd just use translation software at that point, LLMs tend to falter when dealing with large inputs. -
Woggy's Zeonic Frolicks (washedoutgundampilot@poa.st)'s status on Friday, 16-Jun-2023 01:20:40 JST Woggy's Zeonic Frolicks @AmericanChampion @sj_zero No, just pages and stuff. It’s a pain trying to figure out czech stuff when they have spec sheets, now I’m just ballparking it for them. They won’t buy anyways, and I don’t make enough going through the import hassle to do any more legwork than that
-
blaaablaaaa (blaaablaaaa@hermit.cafe)'s status on Friday, 16-Jun-2023 07:46:19 JST blaaablaaaa There's a project that is a private ai that you can ask questions about documents, I didn't dig too much into it but seemed interesting
https://github.com/imartinez/privateGPTWoggy's Zeonic Frolicks likes this.
-