Week 7 Blog: Beginning work on RealtimeSTT and Current Progress Overview

Hello Readers!

This week, I did not have as much time to work as I was visiting CalTech until Wednesday night. Thus, I only fixed some bugs and began looking into the example code for implementing RealtimeSTT into a websocket server so I could use it for my website.

Therefore, I will just give a brief overview on my progress so far. When first loading into the website, this prompt will show up:

Once clicking on the “Browse…” button, the user will be directed to upload a file. The currently supported extensions are .pdf, .jpg/.jpeg, and .png. After the user uploads a file the page will look like this:

The user then can send a message, or browse again to set a different material to be the memorization material. The speak button currently has no implementation but it will be used to implement RealtimeSTT. Once the user sends a message, the AI will provide a response like this:

The user can then continue providing memorizations or switch to a different document or image to memorize.

Overall, I am a little behind again due to not having too much time to work this week but I should be able to catch up next week. I hope to see you at the next blog!