NVIDIA AI GPUs trained Meta's new Llama 3 model for the cloud, edge, and RTX PCs

Anthony Garreffa | Artificial Intelligence | Apr 18, 2024 11:00 PM CDT

NVIDIA has just announced optimizations across all of its platforms to accelerate Meta Llama 3, Meta's latest-generation large language model (LLM).

NVIDIA AI GPUs trained Meta's new Llama 3 model for the cloud, edge, and RTX PCs

The new Llama 3 model combined with NVIDIA accelerated computing provides developers, researchers, and businesses with innovation across various applications. Meta engineers trained their new Llama 3 on a computing cluster featuring 24,576 NVIDIA H100 AI GPUs linked through the NVIDIA Quantum-2 InfiniBand network; with support from NVIDIA, Meta tuned its network, software, and model architectures for its flagship Llama 3 LLM.

To further advance the state-of-the-art generative AI, Meta recently described plans to scale its AI GPU infrastructure to an astonishing 350,000 NVIDIA H100 AI GPUs. That's a lot of AI computing power, a ton of silicon, probably a city's worth of power, and an incredible sum of money on AI GPUs ordered by Meta from NVIDIA.

Continue reading: NVIDIA AI GPUs trained Meta's new Llama 3 model for the cloud, edge, and RTX PCs (full post)

Don't miss out: GEEKOM Mini IT12 Mini PC on sale for $440 off - grab yours today!

Sponsored Content | Deals | Apr 17, 2024 3:48 PM CDT

GEEKOM is dishing up a banging deal for TweakTown readers on its Mini IT12 mini PC. Powered by Intel's 12th-Gen Core i7-12650H processor, the GEEKOM Mini IT12 comes equipped with an impressive 32GB of RAM, 1TB of SSD storage, and the fast Bluetooth 5.2 and W-Fi 6E wireless technologies.

Don't miss out: GEEKOM Mini IT12 Mini PC on sale for $440 off - grab yours today!

This GEEKOM Mini IT12 can be yours for just $469, including free shipping in the United States, and it comes with Microsoft Windows 11 Pro pre-installed. When not on sale, this highly capable SFF computer sells for $909, but right now, you can save a huge $440 when buying it from GEEKOM. That's almost 52% off the normal price!

Enter coupon code tweaktownit12off at the checkout and save!

Continue reading: Don't miss out: GEEKOM Mini IT12 Mini PC on sale for $440 off - grab yours today! (full post)

Meta launches early versions of Llama 3 to fight with OpenAI and Google in the AI battle

Anthony Garreffa | Artificial Intelligence | Apr 18, 2024 10:32 PM CDT

Meta has a nice surprise today: its latest large language model (LLM), Llama 3. The company explains its new Llama 3 8B contains 8 billion parameters, while its Llama 3 70B features 70 billion parameters.

Meta launches early versions of Llama 3 to fight with OpenAI and Google in the AI battle

Meta promises a gigantic increase in performance over the previous Llama 2 8B and Llama 2 70B models, with the company claiming that Llama 3 8B and Llama 3 70B are some of the best-performing generative AI models available today, trained on two custom-built 24,000 GPU clusters.

The company trained its new Llama 3 model on over 15 trillion tokens that were all collected from "publicly available sources," and that Met'a training dataset is 7x larger than what was used for Llama 2, and that includes 4x more code.

Continue reading: Meta launches early versions of Llama 3 to fight with OpenAI and Google in the AI battle (full post)

AI startup: AMD Instinct MI300X is 'far superior' option to NVIDIA Hopper H100 AI GPU

Anthony Garreffa | Artificial Intelligence | Apr 18, 2024 10:00 PM CDT

AI startup TensorWave is one of the first with a publically deployed setup powered by AMD Instinct MI300X AI accelerators, and its CEO says they're a far better option than NVIDIA's dominant Hopper H100 AI GPU.

AI startup: AMD Instinct MI300X is 'far superior' option to NVIDIA Hopper H100 AI GPU

TensorWave started racking up AI systems powered by AMD's just-released Instinct MI300X AI accelerator, which it plans to lease the MI300X chips at a fraction of the cost of NVIDIA's Hopper H100 AI GPU. TensorWave plans to have 20,000 of AMD's new Instinct MI300X AI accelerators before the end of the year across two facilities, and has plans to have liquid-cooled systems online in 2025.

Continue reading: AI startup: AMD Instinct MI300X is 'far superior' option to NVIDIA Hopper H100 AI GPU (full post)

Samsung unveils world's fastest LPDDR5X memory: 10.7Gbps speeds, 32GB capacities per package

Anthony Garreffa | RAM | Apr 18, 2024 9:31 PM CDT

Samsung has just announced that it has developed the industry's first LPDDR5X memory, supporting the industry's highest performance at up to 10.7Gbps.

Samsung unveils world's fastest LPDDR5X memory: 10.7Gbps speeds, 32GB capacities per package

The South Korean giant uses 12nm-class process technology, with Samsung achieving the smallest chip size among existing LPDDR memory, which the company says solidifies its technological leadership in the low-power DRAM market. We have all seen the insatiable demand for AI, with on-device AI being a big future for processing AI workloads on devices, which is where low-power, high-performance LPDDR memory steps in.

YongCheol Bae, Executive Vice President of Memory Product Planning of the Memory Business at Samsung Electronics, said: "As demand for low-power, high-performance memory increases, LPDDR DRAM is expected to expand its applications from mainly mobile to other areas that traditionally require higher performance and reliability such as PCs, accelerators, servers and automobiles. Samsung will continue to innovate and deliver optimized products for the upcoming on-device AI era through close collaboration with customers".

Continue reading: Samsung unveils world's fastest LPDDR5X memory: 10.7Gbps speeds, 32GB capacities per package (full post)

SK hynix and TSMC to work together with HBM4 and next-gen semiconductor packaging technology

Anthony Garreffa | Business, Financial & Legal | Apr 18, 2024 9:03 PM CDT

SK hynix has just announced it signed a memorandum of understanding with TSMC for collaboration to make next-generation HBM memory and enhance logic and HBM integration through advanced packaging technology.

SK hynix and TSMC to work together with HBM4 and next-gen semiconductor packaging technology

The South Korean giant is working on HBM4 right now, the sixth generation in the HBM family, and is expected for mass production in 2026 with the help of TSMC. SK hynix said that working with TSMC, combining the global leader in the AI memory space with the top global logic factory in the world, will lead to "more innovations" in HBM technology.

The collaboration is expected to enable breakthroughs in memory performance through a trilateral collaboration in product design, foundry, and memory provider with the combined powers of SK hynix and TSMC. The two companies will first focus on improving the performance of the base die that is mounted at the very bottom of the HBM package.

Continue reading: SK hynix and TSMC to work together with HBM4 and next-gen semiconductor packaging technology (full post)

Intel finishes assembly of ASML's first High-NA EUV tool, ready for Intel 14A process in 2025

Anthony Garreffa | CPU, APU & Chipsets | Apr 18, 2024 8:42 PM CDT

Intel Foundry has announced that it's completed the assembly of the industry's first commercial High Numerical Aperture (High-NA) Extreme Ultraviolet (EUV) lithography machine.

Intel finishes assembly of ASML's first High-NA EUV tool, ready for Intel 14A process in 2025

ASML provided Intel, its first customer, with the $380 million Twinscan EXE:5000 High-NA lithography machine. Yesterday, it shipped its second High-NA EUV lithography machine to a mystery customer. Intel has now assembled its High-NA EUV lithography machine at its D1X fab in Oregon, a milestone for Intel as this prepares the company for its Intel 14A process node in 2025.

The new ASML Twinscan EXE:5000 machine will allow Intel to print features up to 1.7x smaller than what's possible with existing EUV tools, eventually letting Intel shrink down to smaller transistors than what's possible with standard Low-LA EUV machines, which will provide huge 2.9x transistor density improvement for a single exposure.

Continue reading: Intel finishes assembly of ASML's first High-NA EUV tool, ready for Intel 14A process in 2025 (full post)

Intel Granite Rapids-AP CPU: LGA 7529 socket, up to 128 cores, up to 500W power

Anthony Garreffa | CPU, APU & Chipsets | Apr 18, 2024 7:46 PM CDT

Intel's fleet of next-gen "Granite Rapids-AP" processors in the future Xeon 6 family of CPUs have leaked details, with the flagship Xeon 6 processor featuring up to 128 P-Cores and CPU clocks of up to 3.2GHz.

Intel Granite Rapids-AP CPU: LGA 7529 socket, up to 128 cores, up to 500W power

The information on the Granite Rapids-AP processors comes from RainNymph, a member of the Intel Insiders Community. The four SKUs that have been leaked are the Xeon 6980P, 6979P, 6972P, and 6960P, which all feature differing core counts.

It starts with 72 cores for the Xeon 6960P, 96 cores with the Xeon 6972P, 120 cores for the Xeon 6979P, and finally, 128 cores for the Xeon 6980P. All of these new Xeon 6 processors are based on the new Redwood Cove P-Core architecture, the same one found inside Intel's new Meteor Lake CPUs. Intel's new Xeon 6 processors are rated at up to 500W of power, with boost clocks ranging between 2.7GHz and 3.5GHz

Continue reading: Intel Granite Rapids-AP CPU: LGA 7529 socket, up to 128 cores, up to 500W power (full post)

Blizzard praises Microsoft's 'let it be' hands-off approach to management

Derek Strickland | Gaming | Apr 18, 2024 6:04 PM CDT

Microsoft isn't in a rush to disrupt its new billion-dollar publishing triumvirate--the company appears to be taking the old phrase 'if it's not broken, don't fix it' to heart.

Blizzard praises Microsoft's 'let it be' hands-off approach to management

Business consolidations can often be messy things, leading to hundreds of layoffs, product cancellations, and big interruptions. But that isn't the case with Microsoft's $70 billion buyout of Activision Blizzard King. The three-armed unit is indeed owned by Microsoft, but ABK operates as a limited-integration company--similar to ZeniMax/Bethesda, ABK has its own budgets, creates its own projects, and balances its own books.

Blizzard is apparently enjoying the transition over to Microsoft's employ. In a recent interview with VideoGamesChronicle, World of Warcraft VP Holly Longdale says that the trillion-dollar tech giant hasn't come in and starting telling everyone what to do. WoW is doing great right now, and Microsoft doesn't want to get in the way. In short, Microsoft wants Blizzard to just keep doing what it's doing--making hundreds of millions of dollars per quarter from successful live service games.

Continue reading: Blizzard praises Microsoft's 'let it be' hands-off approach to management (full post)

Target confirms plans to reduce physical media, but games are unaffected

Derek Strickland | Gaming | Apr 18, 2024 5:16 PM CDT

Target has confirmed plans to significantly reduce the amount of physical media that it sells on store shelves, but video games will not be impacted.

Target confirms plans to reduce physical media, but games are unaffected

Last night, a social media post went viral that lamented the death of disc-based media at Target. "Exclusive: Target sources are telling me they reportedly will stop selling physical media in-store and online by 2025," the so-called President of Physical Media said on Twitter. It turns out this is only half true.

Target delivered a statement to IGN that clarified a few things.

Continue reading: Target confirms plans to reduce physical media, but games are unaffected (full post)

Fallout 4 conquers PlayStation Plus charts amid TV show success

Derek Strickland | Gaming | Apr 18, 2024 3:25 PM CDT

On the heels of the big new Amazon Prime adaptation, Fallout games are headlining Sony's PlayStation Plus subscription service.

Fallout 4 conquers PlayStation Plus charts amid TV show success

Thanks to the new Fallout TV show, millions of people are talking about the series. People are also buying and playing the games en masse--much to Microsoft's delight. We've already seen Fallout games skyrocket on Steam and now the same thing is happening on PlayStation.

According to listings on the PlayStation 5 console, the Fallout games are among the most popular titles on PlayStation Plus in the United States. Fallout 4 headlines the top 10 list with the #1 spot, and Fallout 76 is close behind at #3.

Continue reading: Fallout 4 conquers PlayStation Plus charts amid TV show success (full post)