Public
- Public
- Network
- Groups
- Popular
- People

Conversation

Notices

Adrian Cochrane (alcinnz@floss.social)'s status on Sunday, 12-Mar-2023 03:02:51 JST Adrian Cochrane

Running LLaMA 7B and 13B on a 64GB M2 MacBook Pro with llama.cpp - Simon Willison: https://til.simonwillison.net/llms/llama-7b-m2
Summarised on his main blog: https://simonwillison.net/2023/Mar/11/running-llama-7b-on-a-64gb-m2-macbook-pro-with-llamacpp/
In conversation Sunday, 12-Mar-2023 03:02:51 JST from floss.social permalink
Attachments
1. Running LLaMA 7B and 13B on a 64GB M2 MacBook Pro with llama.cpp
  
  from @simonw
  
  Facebook's [LLaMA](https://research.facebook.com/publications/llama-open-and-efficient-foundation-language-models/) is a "collection of foundation language models ranging from 7B to 65B parameters", r
2. Running LLaMA 7B on a 64GB M2 MacBook Pro with llama.cpp
  
  from @simonw
  
  I got Facebook's LLaMA 7B to run on my MacBook Pro using llama.cpp (a "port of Facebook's LLaMA model in C/C++") by Georgi Gerganov. It works! I've been hoping to …

Feeds