Show HN: Finetune Llama-3.1 2x faster in a Colab https://ift.tt/YkH051Q

By Mustansir Malik
Show HN: Finetune Llama-3.1 2x faster in a Colab Just added Llama-3.1 support! Unsloth https://ift.tt/IyZ6wGX makes finetuning Llama, Mistral, Gemma & Phi 2x faster, and use 50 to 70% less VRAM with no accuracy degradation. There's a custom backprop engine which reduces actual FLOPs, and all kernels are written in OpenAI's Triton language to reduce data movement. Also have an 2x faster inference only notebook in a free Colab as well! https://ift.tt/ha8K9yP... https://ift.tt/iarOZFn July 24, 2024 at 02:00AM

Comments

Post a Comment

Popular posts from this blog

Coalition government deal in Pakistan leaves Imran Khan’s party out of power - CNN

By Mustansir Malik
Image
* Coalition government deal in Pakistan leaves Imran Khan’s party out of power  CNN * Pakistan election: Imran Khan's rivals PML-N and PPP reach deal to form government  BBC.com * Pakistan party nominates Shehbaz Sharif as prime minister, ending deadlock  NPR * Imran Khan's Opponents Reach Deal to Shut His Allies Out of Government  The New York Times * Pakistan Party Nominates Shehbaz Sharif as PM, Ending Deadlock  Bloomberg http://dlvr.it/T2kDKS
Read more