Artificial intelligence: Difference between revisions
Change from unarchivable xcancel to archivable nitter catsarch links and fix archive links |
section about system-prompts and lack of transparency |
||
| (One intermediate revision by the same user not shown) | |||
| Line 7: | Line 7: | ||
[[wikipedia:Generative artificial intelligence|Generative artificial intelligence]] models are trained through vast amounts of existing human-generated content. LLMs gather statistics on word patterns, which allows the model to generate sequences of words that seem similar to what a person might have written. However, an LLM does not understand anything; they cannot reason. They generate randomly modulated pattern of tokens. In this way, they function similarly to autocomplete. | [[wikipedia:Generative artificial intelligence|Generative artificial intelligence]] models are trained through vast amounts of existing human-generated content. LLMs gather statistics on word patterns, which allows the model to generate sequences of words that seem similar to what a person might have written. However, an LLM does not understand anything; they cannot reason. They generate randomly modulated pattern of tokens. In this way, they function similarly to autocomplete. | ||
People reading sequences of tokens sometimes perceive things they think are true. Sequences that do not make sense to the reader, or that are false, are called [[wikipedia:Hallucination (artificial intelligence)|hallucinations]]. LLMs are typically trained to produce output that is pleasing to people, exhibiting [[dark patterns]]. For example, they produce output which seems confidently written, use patterns which praise the user (sycophancy), and employ emotionally manipulative language. | People reading sequences of tokens sometimes perceive things they think are true. Sequences that do not make sense to the reader, or that are false, are called [[wikipedia:Hallucination (artificial intelligence)|hallucinations]]. LLMs are typically trained to produce output that is pleasing to people, exhibiting [[Dark pattern|dark patterns]]. For example, they produce output which seems confidently written, use patterns which praise the user (sycophancy), and employ emotionally manipulative language. | ||
People are accustomed to interacting with others, and many overestimate the abilities of things that exhibit complex, person-like patterns. Promoters of “AI” systems take advantage of this tendency, using suggestive names (like “reasoning” and “learning”) and grand claims (“PhD level”), which make it harder for people to understand these systems. | People are accustomed to interacting with others, and many overestimate the abilities of things that exhibit complex, person-like patterns. Promoters of “AI” systems take advantage of this tendency, using suggestive names (like “reasoning” and “learning”) and grand claims (“PhD level”), which make it harder for people to understand these systems. | ||
| Line 32: | Line 32: | ||
Due to heavy investments into and increased use of generative AI and LLMs, many data centers have been constructed to host LLMs. These data centers consume large amounts of power and water, in order to power and cool the computer systems running the models. Residents that live in cities where AI data centers have been constructed have complained of an increase in their electricity bills despite no change in their personal usage.<sup>[<nowiki/>[[Consumer Rights Wiki:Verifiability|citation needed]]]</sup> According to a research video by Benn Jordan, these data centers (as well as fracking operations and natural occurrences) cause a high amount of sound pollution, which can cause various symptoms.<ref> https://www.youtube.com/watch?v=_bP80DEAbuo ([https://preservetube.com/watch?v=_bP80DEAbuo Archived])</ref> | Due to heavy investments into and increased use of generative AI and LLMs, many data centers have been constructed to host LLMs. These data centers consume large amounts of power and water, in order to power and cool the computer systems running the models. Residents that live in cities where AI data centers have been constructed have complained of an increase in their electricity bills despite no change in their personal usage.<sup>[<nowiki/>[[Consumer Rights Wiki:Verifiability|citation needed]]]</sup> According to a research video by Benn Jordan, these data centers (as well as fracking operations and natural occurrences) cause a high amount of sound pollution, which can cause various symptoms.<ref> https://www.youtube.com/watch?v=_bP80DEAbuo ([https://preservetube.com/watch?v=_bP80DEAbuo Archived])</ref> | ||
=== Hidden directives === | |||
Most AI apps include an initial "root"/"system" prompt given to the AI, which is hidden from the user. Some corporations go to great lengths to keep those prompts hidden, and to avoid leaking it to the user. Some projects attempt to bring back transparency to these tools, in spite of the restrictions.<ref>https://github.com/elder-plinius/CL4R1T4S</ref> | |||
==Further reading== | ==Further reading== | ||
*[[Automatic content recognition]] | *[[Automatic content recognition]] | ||