• 1 Post
  • 65 Comments
Joined 4 years ago
cake
Cake day: July 18th, 2020

help-circle



  • The information it generates comes from the model. The information from the model comes from the internet. The information it generates does not come from the internet. A to B to C, not A to C. I don’t know how to explain this more simply without crayons, the information from the internet does not exist within the model, but the average of the information can be recreated by the model. That is not what a fucking search engine does. A search engine doesn’t tell you the average results for your query, it gives you the most relevant results. At least, they should and used to. I can understand the confusion if you’ve only used a search engine in the past 3 years.


  • ChatGPT is not a search engine, it generates predictions on what is the most likely text completion to your prompt. It does not pull information from a database. It is a mathematical model. Its weights do not contain the training data. It is not indexing anything. You will not find any page from the internet in the model. It is all averaged out and any niche detail is lost, overpowered by more prevalent but less relevant training data. This is why it bullshits. When it bullshits it is not because it searched for something and came up empty, it is because in the training data there simply was not a sufficient number of occurrences of the answer to influence its response against the weight of all the other more prevalent training data. ChatGPT does not search anything.



  • This is like saying the library search engine and Bob the drunkard who looked at the shelf labels and swears up and down he knows where everything is are the same thing.

    Look, ChatGPT is an averaging machine. Yes it has ingested a significant chunk of the text on the internet, but it does not reproduce text exactly as it found it, it produces an average of all the text it has seen, weighted towards what seems like it make sense for the situation. For really common information this is fine. For niche information, it is bullshitting without any indication.







  • We needed to get this shit done 10 years ago. Any delay in removing all fossil fuel emissions now is just a matter of how bad we want climate change to get, rather than preventing it. Net zero by 2050 is a fucking eternity away and is a shit goal, and all the projections that get us on track to 1.5 °C of warming have us extensively using carbon capture which is entirely unrealistic.

    Existing nuclear plants in France work, they can load follow to some degree, and renewables can make up the difference with minimal energy storage. But at a certain point you have to stop investing in renewables if you have minimal energy storage and your electricity solution is working.

    I am going to emphasize that last part: IF you can’t get enough energy storage, and IF your energy mix is fine, you must stop investment in renewable installations. Without enough storage, the baseload+peak paradigm works, you just have to regulate it.