• 6 Posts
  • 188 Comments
Joined 1 year ago
cake
Cake day: June 21st, 2023

help-circle








  • This isn’t an article about mistranslations.

    This is an article focusing on how asking about US election questions in Spanish will give you answers that are for the wrong country, or just wrong in most cases when compared to asking the same question in English.

    One example is that, if someone in Puerto Rico were to ask ChatGPT 4/Claude/Gemini/Llama/Mixtral a US Election question, it would respond with information for Venezuela/Mexico/Spain instead.




  • Rather than making it illegal to use, people need to use these tools responsibly. If any of these companies are using almost any kind of AI/machine learning they need to include a human in the loop that can verify that it’s working correctly. That way if it starts hallucinating things that were never said, it can be caught and corrected.

    I’ve found that Whisper generally does a better job at translating/transcribing audio than other open source tools out there, so it’s not garbage… But it absolutely is a hazard if you’re trying to rely solely on it for official documents (or legal issues).

    As far as promotion goes… It’s open source software, it’s not being sold.








  • Ok, this is a bit more than what the title implies. This isn’t just outputting the code in text, but rather the ability to verify its own answers before responding to the user asking questions using code.

    Claude could attempt these tasks before. But, because it lacked a mechanism to mathematically verify the results, the answers weren’t always incredibly accurate.

    So now if you ask it a math question or for it to create some visual bar chart, it will actually do the work to verify that what it’s saying is valid.

    I’m sure there will still be ways to trip it up, but this is a good step forward.