The situation is somewhat different and nuanced. With weights there are tools for fine-tuning, LoRA/LoHa, PEFT, etc., which presents a different situation as with binaries for programs. You can see that despite e.g. LLaMA being “compiled”, others can significantly use it to make models that surpass the previous iteration (see e.g. recently WizardLM 2 in relation to LLaMA 2). Weights are also to a much larger degree architecturally independent than binaries (you can usually cross train/inference on GPU, Google TPU, Cerebras WSE, etc. with the same weights).
This is a very shallow analogy. Fine-tuning is rather the standard technical approach to reduce compute, even if you have access to the code and all training data. Hence there has always been a rich and established ecosystem for fine-tuning, regardless of “source.” Patching closed-source binaries is not the standard approach, since compilation is far less computational intensive than today’s large scale training.
Java byte codes are a far fetched example. JVM does assume a specific architecture that is particular to the CPU-dominant world when it was developed, and Java byte codes cannot be trivially executed (efficiently) on a GPU or FPGA, for instance.
And by the way, the issue of weight portability is far more relevant than the forced comparison to (simple) code can accomplish. Usually today’s large scale training code is very unique to a particular cluster (or TPU, WSE), as opposed to the resulting weight. Even if you got hold of somebody’s training code, you often have to reinvent the wheel to scale it to your own particular compute hardware, interconnect, I/O pipeline, etc.. This is not commodity open source on your home PC or workstation.
Sam Altman Clearly Freaked Out by Reaction to News of OpenAI Silencing Former Employees ( futurism.com )
College Presidents Are Getting in Trouble for Cutting Deals With Protesters ( www.chronicle.com )
Without paywall: https://archive.ph/D7SOU
Gentoo and NetBSD ban 'AI' code, but Debian doesn't – yet ( www.theregister.com )
Open Source Initiative tries to define Open Source AI ( www.theregister.com )
Open Source Initiative tries to define Open Source AI ( www.theregister.com )
Students Show Up to Graduation, Find Commencement Speaker Is an AI Robot ( futurism.com )
Students Show Up to Graduation, Find Commencement Speaker Is an AI Robot ( futurism.com )
ChatGPT can talk, but OpenAI employees sure can’t ( www.vox.com )
GPT-4o’s Chinese token-training data is polluted by spam and porn websites ( www.technologyreview.com )
Not Dead Yet: WD Releases New 6TB 2.5-Inch External Hard Drives - First Upgrade in Seven Years ( www.extremetech.com )
Not Dead Yet: WD Releases New 6TB 2.5-Inch External Hard Drives - First Upgrade in Seven Years ( www.extremetech.com )
Intel Gaudi 2 Complete Servers from Supermicro for $90K ( www.servethehome.com )
Intel Gaudi 2 Complete Servers from Supermicro for $90K ( www.servethehome.com )
Stability AI in talks to raise money from investor group ( www.reuters.com )
Intel Readies Xeon Phi Removal For GCC 15 ( www.phoronix.com )
Intel's OpenVINO Now Available In openSUSE ( www.phoronix.com )
Aleph Alpha enlists Cerebras waferscale supers to train AI for German military ( www.theregister.com )
Valve's Linux Graphics Engineers Begin Prepping RADV Driver For AMD RDNA4 "GFX12" ( www.phoronix.com )
Germany's Sovereign Tech Fund Now Supporting FFmpeg ( www.phoronix.com )
Half Of PlayStation Players Still Haven't Upgraded To PS5 ( kotaku.com )
Ubisoft insists yet again that its uncanny AI-generated 'NEO-NPCs' will make games 'more alive and richer', whatever that means ( www.pcgamer.com )
Grand Theft Auto VI Now Targeting Fall 2025 Release, Take-Two Confirms ( kotaku.com )
Take-Two boss claims publisher hasn't shut down OlliOlli and Kerbal Space Program 2 studios ( www.eurogamer.net )
Exclusive: Dell XPS roadmap confirms "Panther Lake" laptops in 2026, "Nova Lake" systems in 2027 ( videocardz.com )
Raw Milk Enthusiasts Demand Milk Infected With H5N1 ( futurism.com )
Raw Milk Enthusiasts Demand Milk Infected With H5N1 ( futurism.com )
IBM open-sources its Granite AI models - and they mean business ( www.zdnet.com )
IBM open-sources its Granite AI models - and they mean business ( www.zdnet.com )
Fallout 4 Fans Are Begging Bethesda To Stop Updating The Game ( kotaku.com )
Marvel Rivals: Content Creators Asked to Sign Contract That Prohibits Saying Anything Negative to Gain Access to Playtest ( mp1st.com )
Ordered back to the office, top tech talent left instead, study finds ( www.washingtonpost.com )
Without paywall: https://archive.ph/0KvTq
NVIDIA's Open GPU Linux Kernel Driver Will Soon Be The Default For Turing & Newer GPUs ( www.phoronix.com )
Cyberpunk 2077 director thanks fans as the game hits a 95% positive review rating on Steam ( www.eurogamer.net )
Cyberpunk 2077 director thanks fans as the game hits a 95% positive review rating on Steam ( www.eurogamer.net )
Ghost of Tsushima on PC Won't Be Released in Specific Countries Due to PSN Restrictions and Here's the List ( mp1st.com )
AMD Aims For AMF Decode In FFmpeg, Questioned Over Vulkan Video Commitment ( www.phoronix.com )
SteamOS 3.6: How the Steam Deck atomic updates are improving ( www.collabora.com )
President of Xbox at Microsoft asked about the closure of Hi-Fi Rush developer Tango Gameworks, spends close to a minute saying almost nothing ( www.pcgamer.com )
The Real Reason Your Favourite Game Studios Are Getting Closed Instead Of Sold ( www.thegamer.com )
And it begins. OpenAI mulls NSFW AI model output ( www.theregister.com )
Mozilla's Llamafile 0.8.2 Scores Big With New AVX2 Performance Optimizations ( www.phoronix.com )
SteamOS 3.6 Preview Released With Linux 6.5, Updated Arch Linux & Mesa 24.1 ( www.phoronix.com )
Helldivers 2 remains delisted in 177 countries and territories even as Sony backs down on PSN requirement, Arrowhead CEO says 'I won't rest in my desire to have it available everywhere' ( www.pcgamer.com )
Student protesters face same suspensions as those who bring assault rifles to campus ( www.latimes.com )
Student protesters face same suspensions as those who bring assault rifles to campus ( www.latimes.com )
Leaked Deck Reveals How OpenAI Is Pitching Publisher Partnerships ( www.adweek.com )