• 2 Posts
  • 37 Comments
Joined 1 year ago
cake
Cake day: June 30th, 2023

help-circle











  • I’ve always thought the mid-late Roman Republic was more interesting than the imperial era, and the Gracchi are easily the most fascinating chapter. Noble aristocrats becoming populist ideologues, the increasingly bitter struggle over creaky governmental norms (like their weaponization of the tribunal veto to shut down the city), the introduction of political violence. Very instructive for our current era, imho.


  • IIRC based on the source paper the “verbatim” text is common stuff like legal boilerplate, shared code snippets, book jacket blurbs, alphabetical lists of countries, and other text repeated countless times across the web. It’s the text equivalent of DALL-E “memorizing” a meme template or a stock image – it doesn’t mean all or even most of the training data is stored within the model, just that certain pieces of highly duplicated data have ascended to the level of concept and can be reproduced under unusual circumstances.





  • Tbh, I block ads when I can but have a hard time getting angry about this. YouTube is both incredibly useful and incredibly expensive to operate – seriously, what other service lets you upload hours of HD video which anyone in the world can access instantly, indefinitely, for free, and at the same scale YT does? It’s a peerless engineering marvel and it would be a tragedy if it were to shut down. If seeing some short skippable ads is what it takes to keep that resource viable, that’s honestly pretty fair.