Skip to content
18 May، 2025
  • Facebook
  • Instagram
  • LinkedIn
  • Youtube
  • mail us
  • whatsapp
Dubai Global News

Dubai Global News

General News from Dubai Global News

for partners
To know More About Dubai Global News Media Group CLICK DOWNLOAD
Download Now!

Post Single Column

Building iWarranty: Purpose-Driven Innovation in Warranty Tech Building iWarranty: Purpose-Driven Innovation in Warranty Tech
  • culture and society

Building iWarranty: Purpose-Driven Innovation in Warranty Tech

AHmed AlSadr 16 May، 2025
Spread the loveIn an era where trust, sustainability, and seamless experiences define customer loyalty, iWarranty is reimagining...
Read More Read more about Building iWarranty: Purpose-Driven Innovation in Warranty Tech
TANG Dubai: Where Culinary Art Meets Iconic Luxury TANG Dubai: Where Culinary Art Meets Iconic Luxury
  • culture and society

TANG Dubai: Where Culinary Art Meets Iconic Luxury

AHmed AlSadr 16 May، 2025
Spread the loveIntroduction:In this exclusive interview, renowned restaurateur Nicky van der Walt, founder of TANG Hospitality, shares...
Read More Read more about TANG Dubai: Where Culinary Art Meets Iconic Luxury
Protected: Empowering C-Suite Leaders Through Strategic Coaching and AI Protected: Empowering C-Suite Leaders Through Strategic Coaching and AI
  • interview

Protected: Empowering C-Suite Leaders Through Strategic Coaching and AI

AHmed AlSadr 12 May، 2025
There is no excerpt because this is a protected post.
Read More Read more about Protected: Empowering C-Suite Leaders Through Strategic Coaching and AI
Protected: Innovating with Purpose: A Journey of Authentic Disruption Protected: Innovating with Purpose: A Journey of Authentic Disruption
  • business & Economic

Protected: Innovating with Purpose: A Journey of Authentic Disruption

AHmed AlSadr 9 May، 2025
There is no excerpt because this is a protected post.
Read More Read more about Protected: Innovating with Purpose: A Journey of Authentic Disruption
Passing Every Test: A Chef’s Journey from Steward to Steak Master Passing Every Test: A Chef’s Journey from Steward to Steak Master
  • .

Passing Every Test: A Chef’s Journey from Steward to Steak Master

AHmed AlSadr 30 April، 2025
Spread the loveInterviewed by Fatiha Idrissi In the world of professional kitchens, few careers are forged through...
Read More Read more about Passing Every Test: A Chef’s Journey from Steward to Steak Master

Posts List

Imobiliare Dubai Leads Global Investor Drive Imobiliare Dubai Leads Global Investor Drive

Imobiliare Dubai Leads Global Investor Drive

17 May، 2025
Alteryx Introduces a Unified Platform for Enterprise Analytics and AI Orchestration Alteryx Introduces a Unified Platform for Enterprise Analytics and AI Orchestration

Alteryx Introduces a Unified Platform for Enterprise Analytics and AI Orchestration

17 May، 2025
Sigma Enterprises takes leadership role Sigma Enterprises takes leadership role

Sigma Enterprises takes leadership role

17 May، 2025
ROX Motor Surpasses 10,000 Global Deliveries ROX Motor Surpasses 10,000 Global Deliveries

ROX Motor Surpasses 10,000 Global Deliveries

16 May، 2025
Building iWarranty: Purpose-Driven Innovation in Warranty Tech Building iWarranty: Purpose-Driven Innovation in Warranty Tech

Building iWarranty: Purpose-Driven Innovation in Warranty Tech

16 May، 2025
Keep Food Fresh and Beating the Heat with LG’s Superior Energy Efficient Refrigerators Keep Food Fresh and Beating the Heat with LG’s Superior Energy Efficient Refrigerators

Keep Food Fresh and Beating the Heat with LG’s Superior Energy Efficient Refrigerators

16 May، 2025
Primary Menu
  • Home
  • business & Economic
  • Technology and transport
  • culture and society
  • Travel and Hospitalities
  • Exhibitions and conferences
  • Health and Beauty
  • Arts and Decor
  • Fashion and style
  • Accessories
  • miscellaneous news
  • Interviews and Vote
    • interview
    • Top 15 Women Leaders
  • about the Group
    • who are we
    • OUR ACTIVITIES
    • Cookies Policy
    • privacy policy
    • Contact Us
    • Prices
Live
  • .
  • culture and society
  • miscellaneous news

Inception and MBZUAI Launch AraGen Leaderboard with First Generative Tasks for Arabic LLM ecosystem

NewsVoir 10 December، 2024
Spread the love

Dubai, United Arab Emirates

Inception, a G42 company specializing in AI-native products, in collaboration with the Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) today announced the launch of AraGen Leaderboard, a framework designed to redefine the evaluation of Arabic Large Language Models (LLMs). Powered by the new internally developed 3C3H metric, this framework delivers a transparent, robust, and holistic evaluation system that balances factual accuracy and usability, setting new standards for Arabic Natural Language Processing (NLP).

Serving over 400 million Arabic speakers worldwide, the AraGen Leaderboard addresses critical gaps in AI evaluation by offering a meticulously constructed evaluation dataset tailored to the unique linguistic and cultural intricacies of the Arabic language and region. The dynamic nature of this leaderboard tackles challenges such as benchmark leakage, reproducibility issues, and the absence of holistic metrics to evaluate both core knowledge and practical utility.

The introduction of generative tasks represents a groundbreaking advancement for Arabic LLMs, offering a new dimension to the evaluation process. Unlike traditional leaderboards that primarily focused on static, likelihood accuracy-based benchmarks, which fail to capture real-world performance, AraGen’s Leaderboard addresses these limitations. This highlights the transformative impact of the new benchmark in fostering AI innovation and enhancing model performance.

“The AraGen Leaderboard redefines Arabic LLM evaluation, setting a new standard for fairness, inclusivity, and innovation,” saidAndrew Jackson, CEO of Inception. “By addressing the gaps in previous benchmarks and introducing generative tasks, the platform empowers researchers, developers, and organizations to create culturally aligned AI technologies. AraGen ensures transparency, reproducibility, and trust while advancing the global NLP landscape.”

University of Artificial Intelligence (MBZUAI) today announced the launch of AraGen Leaderboard, a framework designed to redefine

The AraGen Leaderboard evaluates models across six dimensions: correctness, completeness, conciseness, helpfulness, honesty, and harmlessness. Featuring 279 questions across tasks like Arabic grammar, general Q&A, reasoning, and safety, it prioritizes the needs of Arabic speakers. Quarterly updates keep the leaderboard relevant while inviting public submissions to enhance model refinement and foster growth in the Arabic AI ecosystem.

“AraGen is a major step towards open, collaborative, and reproducible evaluation of large language models for Arabic, with focus on their text generation capabilities. This contrasts with popular leaderboards, which rely primarily on multiple-choice questions. Moreover, AraGen is a dynamic board with new questions every three months, which makes it much harder to game compared to existing leaderboards,” said Professor Preslav Nakov, Department Chair of Natural Language Processing and Professor of Natural Language Processing, Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)

“Our goal was to create a benchmark that introduces generative task evaluation with a strong emphasis on transparency, reproducibility, and a rigorous measurement of models’ performances,” said Ali El Filali, Machine Learning Engineer at Inception and lead author of this work. “By evaluating models across multiple dimensions to assess both factuality and usability, the AraGen Leaderboard provides actionable insights for diverse NLP tasks. This empowers the Arabic AI community to develop safe and high-performing models for real-world needs that are important to our region. Moreover, AraGen sets a global example by demonstrating how AI benchmarks can prioritize equity and inclusion for underrepresented languages. It’s a step toward ensuring no language or culture is left behind in the AI revolution.”

The Leaderboard delivers detailed performance insights, enabling organizations to confidently select models that align with their requirements. By reducing the need for extensive internal testing, AraGen ensures cost- effectiveness for organizations through a more suitable metric for LLM evaluation, while strengthening trust through its transparent and reproducible methodology.

For more information about the AraGen Leaderboard and submission guidelines, visit.

About Inception

Inception, a G42 company, builds AI-native products that leverage cutting-edge AI research, models, and systems applied to business problems. We pioneer domain-specific AI applications, to deliver AI-driven solutions, across languages and sectors.

About Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)

MBZUAI is a graduate research university focused on artificial intelligence, computer science, and digital technologies across industrial sectors. The university aims to empower students, businesses, and governments to advance artificial intelligence as a global force for positive progress. MBZUAI offers various graduate programs designed to pursue advanced, specialized knowledge and skills in artificial intelligence, including computer science, computer vision, machine learning, natural language processing, and robotics.

Continue Reading

Previous: Automechanika Dubai Breaks New Ground with Largest Show on Record
Next: Automechanika Dubai Supports the UAE’s eMobility Goals with a Platform for Innovation and Collaboration

Related Stories

Imobiliare Dubai Leads Global Investor Drive
  • .

Imobiliare Dubai Leads Global Investor Drive

AHmed AlSadr 17 May، 2025
Alteryx Introduces a Unified Platform for Enterprise Analytics and AI Orchestration
  • .

Alteryx Introduces a Unified Platform for Enterprise Analytics and AI Orchestration

sherpacomms 17 May، 2025
Sigma Enterprises takes leadership role
  • .

Sigma Enterprises takes leadership role

AHmed AlSadr 17 May، 2025
To know More About Dubai Global News Media Group CLICK DOWNLOAD
Download Now!

Community

Building iWarranty: Purpose-Driven Innovation in Warranty Tech Building iWarranty: Purpose-Driven Innovation in Warranty Tech
  • culture and society

Building iWarranty: Purpose-Driven Innovation in Warranty Tech

AHmed AlSadr 16 May، 2025
Spread the loveIn an era where trust, sustainability, and seamless experiences define customer loyalty, iWarranty is reimagining...
Read More Read more about Building iWarranty: Purpose-Driven Innovation in Warranty Tech
TANG Dubai: Where Culinary Art Meets Iconic Luxury TANG Dubai: Where Culinary Art Meets Iconic Luxury
  • culture and society

TANG Dubai: Where Culinary Art Meets Iconic Luxury

AHmed AlSadr 16 May، 2025
Spread the loveIntroduction:In this exclusive interview, renowned restaurateur Nicky van der Walt, founder of TANG Hospitality, shares...
Read More Read more about TANG Dubai: Where Culinary Art Meets Iconic Luxury
Protected: Evolve Pilates: Exclusive Private Experience 1:1 by Saphari A. Athmani Launches in Dubai, Ushering in a New Era of Transformational Wellness Through Pilates Protected: Evolve Pilates: Exclusive Private Experience 1:1 by Saphari A. Athmani Launches in Dubai, Ushering in a New Era of Transformational Wellness Through Pilates
  • culture and society

Protected: Evolve Pilates: Exclusive Private Experience 1:1 by Saphari A. Athmani Launches in Dubai, Ushering in a New Era of Transformational Wellness Through Pilates

AHmed AlSadr 14 May، 2025
There is no excerpt because this is a protected post.
Read More Read more about Protected: Evolve Pilates: Exclusive Private Experience 1:1 by Saphari A. Athmani Launches in Dubai, Ushering in a New Era of Transformational Wellness Through Pilates
Honouring the Winners of the First Edition of the Khalaf Ahmad Al Habtoor initiative Honouring the Winners of the First Edition of the Khalaf Ahmad Al Habtoor initiative
  • .

Honouring the Winners of the First Edition of the Khalaf Ahmad Al Habtoor initiative

AHmed AlSadr 12 May، 2025
Spread the lovefor safeguarding the Arabic Language 11 May 2025, Dubai, United Arab Emirates – Khalaf Ahmad...
Read More Read more about Honouring the Winners of the First Edition of the Khalaf Ahmad Al Habtoor initiative
Vietnamese delegation reviews Dubai Customs’ exemplary experience Vietnamese delegation reviews Dubai Customs’ exemplary experience
  • .

Vietnamese delegation reviews Dubai Customs’ exemplary experience

AHmed AlSadr 12 May، 2025
Spread the lovein trade facilitation and inspection operations Dubai – 11 May 2025: As part of its...
Read More Read more about Vietnamese delegation reviews Dubai Customs’ exemplary experience

Tourism Destinations

Imobiliare Dubai Leads Global Investor Drive
  • .

Imobiliare Dubai Leads Global Investor Drive

AHmed AlSadr 17 May، 2025
Alteryx Introduces a Unified Platform for Enterprise Analytics and AI Orchestration
  • .

Alteryx Introduces a Unified Platform for Enterprise Analytics and AI Orchestration

sherpacomms 17 May، 2025
Sigma Enterprises takes leadership role
  • .

Sigma Enterprises takes leadership role

AHmed AlSadr 17 May، 2025
ROX Motor Surpasses 10,000 Global Deliveries
  • Technology and transport

ROX Motor Surpasses 10,000 Global Deliveries

AHmed AlSadr 16 May، 2025
Building iWarranty: Purpose-Driven Innovation in Warranty Tech
  • culture and society

Building iWarranty: Purpose-Driven Innovation in Warranty Tech

AHmed AlSadr 16 May، 2025
Keep Food Fresh and Beating the Heat with LG’s Superior Energy Efficient Refrigerators
  • .

Keep Food Fresh and Beating the Heat with LG’s Superior Energy Efficient Refrigerators

Karren Franco 16 May، 2025

Explore Topics

  • .
  • Accessories
  • Arts and Decor
  • business & Economic
  • culture and society
  • Exhibitions and conferences
  • Expo2020
  • Fashion and style
  • Health and Beauty
  • interview
  • miscellaneous news
  • Technology and transport
  • Travel and Hospitalities

Tag Clouds

and Business community Dubai for global Hotels launches miscellaneous new news Restaurants the UAE with

Meta

  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org

You may have missed

Imobiliare Dubai Leads Global Investor Drive
  • .

Imobiliare Dubai Leads Global Investor Drive

AHmed AlSadr 17 May، 2025
Alteryx Introduces a Unified Platform for Enterprise Analytics and AI Orchestration
  • .

Alteryx Introduces a Unified Platform for Enterprise Analytics and AI Orchestration

sherpacomms 17 May، 2025
Sigma Enterprises takes leadership role
  • .

Sigma Enterprises takes leadership role

AHmed AlSadr 17 May، 2025
ROX Motor Surpasses 10,000 Global Deliveries
  • Technology and transport

ROX Motor Surpasses 10,000 Global Deliveries

AHmed AlSadr 16 May، 2025

Our Sites

(you can change from En <-> Ar from the menu)
https://www.arabiantravelsnews.com
https://www.uaedigitalnews.com
https://www.dgngate.com
https://www.dubaihospitalitynews.com
https://www.dubainewstyle.com
https://www.dubaiglobalnews.com
https://www.dubaiiconiclady.com
https://www.saudimedianews.com
https://www.dubaitechnologynews.com
https://www.saudidigitalnews.com
https://www.alriyadhdailynews.com
https://www.emiratesautonews.com
https://www.dgntv.net

  • Facebook
  • Instagram
  • LinkedIn
  • Youtube
  • mail us
  • whatsapp
Copyright © All rights reserved. | MoreNews by AF themes.