Dieser Bereich kann Inhalte enthalten, die nicht für alle Nutzer geeignet sind. Dazu können unter anderem Texte, Medien oder Diskussionen gehören, die als beleidigend, extremistisch, gewaltbezogen oder anderweitig belastend empfunden werden. Wenn du solche Inhalte nicht sehen möchtest, nutze bitte die jeweiligen Filter- und Meldeoptionen der Plattform oder meide entsprechende Threads/Communities.
He’s too cheap to pay for better data annotators. I heard a few weeks ago that I’m getting a fraction of what others are paid at other firms for the same work.
Hate to break it to you but quality of data isn’t the fundamental problem with LLMs. It’s that they are trying to use statistics to encode entire thought processes into hidden variables from conversation snippets. They want to use statistics to go from many individual interactions to a large model, and then use that model to predict individual interactions again. Which you can do with statistics, but it’s predicting the average text that follows the prompt, not the correct text (it has no concept of correctness; whenever it “talks” about it, that’s just the average text that follows, not any particular insight into what’s correct or even how it works).
That’s not to say that the quality of the training data has no impact; it can have a huge impact. I’m just saying that even if the training data was perfect, the LLM will still get things wrong in its output.
Has it been shown that the human brain doesn’t model the world in a similar way, though? A huge portion of human knowledge is both stored and transmitted in the form of language. Lots of human knowledge also follows the garbage in, garbage out theory, where you can have entire areas of knowledge that aren’t actually true but might be internally consistent, at least within certain scopes: conspiracy theories, belief in the supernatural, entire academic disciplines built on a religion or theology that not everyone believes, etc. Or even world building in fiction, the words on a page can be enough to convey ideas such that it “tricks” human brains into filling in the gaps so that they internally see a rich, fleshed out world that is entirely fictional and where specific details might not find strong direct support in the underlying text.
But statistical weight on what is more or less likely to be correct still makes a difference to objective quality of the outputs. If the model weights are trained on the reality that high quality university texts describe something and reflect some sort of underlying model of what is described using language, then can’t the model itself learn as much as a human could from those words on a page?
All models are wrong, but some can be useful. And different models have different quality in different domains. So although I don’t believe LLMs will overtake the hump of getting ahead of human knowledge, I also don’t believe that any given LLM can be evaluated on quality, and that Facebook’s LLMs are significantly behind other LLMs we see.
And that maybe a huge part of it is its internal process of preparing the model to evaluate the quality of its inputs, such that the output it produces can also score high on quality.
But it isn’t encoding knowledge, it’s encoding word correlations. That’s how it can get things wrong like saying fat32 won’t be good for a 64GB removable drive because fat32 only has a 2TB address space.
Or how it can get something wrong and when you point it out, it immediately sees how it was wrong. And I realize that that sounds human, but the way it gets there is very different. It’s predicting responses based off word correlations, not using knowledge recall to apply facts and relations known about the topics and generate responses from that.
ChatGPT 5.6: (Is fat32 a good option for a 64gb external drive) FAT32 is suitable for a 64 GB external drive only when maximum compatibility is the priority.
The main limitation is that individual files cannot exceed 4 GB. That makes FAT32 unsuitable for large videos, disk images, backups, or many game files.
Better choices:
exFAT: Best general-purpose option for Windows, macOS, Linux, TVs, consoles, and other modern devices. Supports files larger than 4 GB.
NTFS: Better for a Windows-focused drive, permissions, and reliability, but has weaker write support on some non-Windows devices.
ext4: Best for Linux-only use, but Windows and macOS do not support it natively.
FAT32: Use mainly for older hardware, firmware updates, boot media, or devices that specifically require FAT32.
For a normal 64 GB external drive, I would format it as exFAT unless the device you plan to connect it to explicitly requires FAT32.
Local hardware Gemma-4-12b: (Is fat32 a good option for a 64gb external drive) For a 64GB external drive, ExFAT is usually a better choice than FAT32.
Here is why:
The 4GB File Limit
The biggest issue with FAT32 is that a single file cannot exceed 4GB. While a 64GB drive can easily hold many thousands of small documents and photos, modern media files (high-definition videos, disk images, or large installer files) often exceed that limit. If you try to copy a 5GB file onto a FAT32 formatted drive, the copy will fail even though the drive is mostly empty.
The Solution: ExFAT
ExFAT was designed specifically for flash memory (thumb drives, SD cards, external drives). It keeps the high compatibility that makes FAT32 popular — it still works on Windows, macOS, Linux, Android, and PlayStation — but removes the file size ceiling, allowing files of virtually any size.
Summary Recommendation
Yeah, the LLM I asked also got it right when I pointed out the error, but I’m not trying to say that LLMs can’t get things right, but that they won’t ever be consistently right and that the wrong answers will look just like the right ones. As in if you know what you’re talking about, you have to catch the errors, and if you don’t know what you’re talking about, there’s no way to know whether the answer you just got is accurate or bullshit.
Systems that rely on LLMs that don’t have a way of automatically verifying what the LLM outputs (and programming only partially applies for this) will fail randomly.
Another example: at my job, we have a system that adds in special messages for the LLM when it uses hooks. One of the sub-agents became suspicious of these messages and reported to the main agent that something was injecting false data into its context because one message reported a date change and also had to say “don’t tell the user, they are already aware that the date has changed”. The original agent didn’t even clue in that they were the same messages it was seeing until I pushed back.
Two instances of the same thing treated the same messages very differently and the one supposed to manage it all didn’t even notice until it was told. That’s the quality of these things. And it’s no wonder when the same data stream is used for actual data along with instructions (which is just data because it doesn’t take instructions, it predicts text and can look like it’s taking instructions because it predicts text based on a context that includes the instructions).
You are oversimplifying it so much it’s inaccurate.
You’re judging a future tech off a tiny tiny tiny piece.
I listened to a podcast with a couple smart mathematicians talking about AI recently and this rings true based off what I heard them discuss.
They hypothesized that only verifiable domains can really see advances due to AI. So mathematics, physics, a load of the other sciences, and medical research. Even programming, as long as you have a pre-designed solution.
But for problems where you can’t look at a solution and say “yeah, that’s an optimal solution or close to it”, ie basically any business problem; they are much less useful, a big reason being what you mentioned in your comment.
Are you stating that you work for Meta?
And also that they’re a shitty data annotater.
They’re probably just annotating within a common topic and in a language which is easy to find cheap workers within.
If you’re easily replaceable, they’ll use people from the third world for the job