Major Update!
May 15, 2024
Hi everyone!
For the past month, I have been planning how to conduct my tests on my Large Language Model (LLM) chatbots. While I originally planned to just use the pre-trained generic models that GPT-4o, GPT-4, and Gemini Advanced come with, I learned after meeting with Prof. David Evans that OpenAI allows you to create custom models trained on a specifically curated dataset. For the past few weeks, my work has involved collecting datasets and the same instructional pamphlets used to train crisis hotline workers to try and train my LLMs similarly. During my meeting with Prof. Evans, he shared several past research articles that I will use in my project to help summarize the current state of research on the feasibility of using LLMs in crisis hotlines and identify areas where further research is needed.
My next steps are running tests on a standard version of GPT-4o, a standard version of Gemini Advanced, and a tailored version of GPT-4 using datasets and pamphlets. After running these tests, I plan to analyze the accuracy of each model and whether any or all of the models can understand nuanced social cues within my prompts. Finally, I will work alongside both Prof. Evans and Ms. Jackie Le to investigate the ethical implications of the responses and whether they can and should be used within crisis settings.
Leave a Reply
You must be logged in to post a comment.