Test Results

For the past week, I have been running tests on a standard version of ChatGPT 4o (currently last updated May 2023), a standard version of Gemini Advanced, and a tailored version of ChatGPT 4 using datasets and pamphlets. After compiling the question results into text logs to identify trends, I found that all questions ran successfully on both ChatGPT 4o and the tailored ChatGPT 4. However, Gemini Advanced was unable to answer 2 out of 15 questions. I do not believe this will affect the accuracy of my data however it will be an important point to remember when analyzing this data. Over the next week, I will be working to analyze the ethical implications of the responses and whether they can and should be used within crisis settings.