noroute ,

After reading this article, I predict Firefox AI software ChatGPT feature built into Firefox in the future. This can be very useful if done right. Just hope there is an OFF switch for anyone who doesn’t want to use it.

falken ,
@falken@qoto.org avatar

@noroute @yoasif local LLM execution times can be very fast on recent consumer hardware. No need to send anywhere, just like their translation - do it all on-device.
As an example, with no optimization or GPU support, my @frameworkcomputer (AMD) generates around 5 characters/sec from a 4 gigabyte pre-quantized model.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • firefox
  • kamenrider
  • pixo
  • jeremy
  • Lexington
  • cragsand
  • mead
  • RetroGamingNetwork
  • MidnightClan
  • neondivide
  • xyz
  • PowerRangers
  • AnarchoCapitalism
  • WatchParties
  • WarhammerFantasy
  • supersentai
  • Rutgers
  • Teensy
  • itdept
  • space_engine
  • steinbach
  • learnviet
  • bjj
  • loren
  • AgeRegression
  • khanate
  • mauerstrassenwetten
  • electropalaeography
  • Mordhau
  • All magazines