Meta Llama 3

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 3

    News Categories Events Webinars & Resources Work With Us Subscribe / Login More TechForge News


h
GO
Upcoming Events

Meta raises the bar with open source Llama 3 LLM JOIN OUR COMMUNITY

Create your free account now to


access all our premium content
and recieve the latest tech news to
your inbox.

SUBSCRIBE NOW

LATEST ARTICLES

Meta raises the bar with open


source Llama 3 LLM
Meta (Facebook)

Mixtral 8x22B sets new


benchmark for open models
Artificial Intelligence

SAS aims to make AI


accessible regardless of skill
set with packaged AI models
Development

80% of AI decision makers


About the Author By Ryan Daws | April 19, 2024 https://twitter.com/gadget_ry
Categories: Artificial Intelligence, Companies, Development, Meta (Facebook),
are worried about data
privacy and security
Ryan Daws is a senior editor at TechForge Media, with a seasoned background spanning over a decade in tech journalism. His Security

expertise lies in identifying the latest technological trends, dissecting complex topics, and weaving compelling narratives
around the most cutting-edge developments. His articles and interviews with leading industry figures have gained him Samsung aims to boost on-
recognition as a key influencer by organisations such as Onalytica. Publications under his stewardship have since gained device AI with LPDDR5X
recognition from leading analyst houses like Forrester for their performance. Find him on X (@gadget_ry) or Mastodon DRAM
Artificial Intelligence
(@gadgetry@techhub.social)

Meta has introduced Llama 3, the next generation of its state-of-the-art open source large language model (LLM). The tech giant claims Llama 3
establishes new performance benchmarks, surpassing previous industry-leading models like GPT-3.5 in real-world scenarios.

“With Llama 3, we set out to build the best open models that are on par with the best proprietary models available today,” said Meta in a blog
post announcing the release.

The initial Llama 3 models being opened up are 8 billion and 70 billion parameter versions. Meta says its teams are still training larger 400
billion+ parameter models which will be released over the coming months, alongside research papers detailing the work.

Llama 3 has been over two years in the making with significant resources dedicated to assembling high-quality training data, scaling up
distributed training, optimising the model architecture, and innovative approaches to instruction fine-tuning.

Meta’s 70 billion parameter instruction fine-tuned model outperformed GPT-3.5, Claude, and other LLMs of comparable scale in human
evaluations across 12 key usage scenarios like coding, reasoning, and creative writing. The company’s 8 billion parameter pretrained model also
sets new benchmarks on popular LLM evaluation tasks:

t
    News Categories Events Webinars & Resources Work With Us Subscribe / Login More TechForge News
h
 Upcoming Events

“We believe these are the best open source models of their class, period,” stated Meta.

The tech giant is releasing the models via an “open by default” approach to further an open ecosystem around AI development. Llama 3 will be
available across all major cloud providers, model hosts, hardware manufacturers, and AI platforms.

Victor Botev, CTO and co-founder of Iris.ai, said: “With the global shift towards AI regulation, the launch of Meta’s Llama 3 model is notable. By
embracing transparency through open-sourcing, Meta aligns with the growing emphasis on responsible AI practices and ethical development.

”Moreover, this grants the opportunity for wider community education as open models facilitate insights into development and the ability to
scrutinise various approaches, with this transparency feeding back into the drafting and enforcement of regulation.”

Accompanying Meta’s latest models is an updated suite of AI safety tools, including the second iterations of Llama Guard for classifying risks and
CyberSec Eval for assessing potential misuse. A new component called Code Shield has also been introduced to filter insecure code suggestions
at inference time.

“However, it’s important to maintain perspective – a model simply being open-source does not automatically equate to ethical AI,” Botev
continued. “Addressing AI’s challenges requires a comprehensive approach to tackling issues like data privacy, algorithmic bias, and societal
impacts – all key focuses of emerging AI regulations worldwide.

”While open initiatives like Llama 3 promote scrutiny and collaboration, their true impact hinges on a holistic approach to AI governance
compliance and embedding ethics into AI systems’ lifecycles. Meta’s continuing efforts with the Llama model is a step in the right direction, but
ethical AI demands sustained commitment from all stakeholders.”

Meta says it has adopted a “system-level approach” to responsible AI development and deployment with Llama 3. While the models have
undergone extensive safety testing, the company emphasises that developers should implement their own input/output filtering in line with
their application’s requirements.

The company’s end-user product integrating Llama 3 is Meta AI, which Meta claims is now the world’s leading AI assistant thanks to the new
models. Users can access Meta AI via Facebook, Instagram, WhatsApp, Messenger and the web for productivity, learning, creativity, and general
queries.

Multimodal versions of Meta AI integrating vision capabilities are on the way, with an early preview coming to Meta’s Ray-Ban smart glasses.

Despite the considerable achievements of Llama 3, some in the AI field have expressed scepticism over Meta’s motivation being an open
approach “for the good of society.”

However, just a day after Mistral AI set a new benchmark for open source models with Mixtral 8x22B, Meta’s release does once again raise the
bar for openly-available LLMs.

See also: SAS aims to make AI accessible regardless of skill set with packaged AI models

Want to learn more about AI and big data from industry leaders? Check out AI & Big Data Expo taking place in Amsterdam, California, and
London. The comprehensive event is co-located with other leading events including BlockX, Digital Transformation Week, and Cyber Security &
Cloud Expo.

Explore other upcoming enterprise technology events and webinars powered by TechForge here.

Tags: ai, artificial intelligence, large language model, llama 3, llm, meta, open source
    News Categories Events Webinars & Resources Work With Us Subscribe / Login More TechForge News
VIEW COMMENTS LEAVE A COMMENT h
 Upcoming Events

OTHER NEWS EVENTS CATEGORIES

Artificial Intelligence News AI World Solutions Summit Deep & Reinforcement Learning

Blockchain News AI & Big Data Expo Machine Learning

Cloud Computing News #DMWF Digital Marketing World Forum Robotics

Developer News Developer Events Voice Recognition

IoT News IoT Events

Telecoms News Marketing Events

Edge Computing News Telecoms Events

Cookie Policy (UK)

AI News provides artificial intelligence news and jobs, industry analysis and digital media insight around numerous marketing disciplines; mobile strategy, email marketing, SEO, analytics, social media and much more.

Please follow this link for our privacy policy.

Copyright © 2024 AI News. All Rights Reserved.

You might also like