Skip to content
Smart Lead Tech
Home
Services
Our work
Saudi Arabia
About us
Blog
Contact us
🇸🇦العربيةContact now
Smart Lead Tech

Smart software solutions

Follow us

Company

  • About us
  • Our work
  • Our services
  • Saudi Arabia
  • Restaurant POS
  • Contact us
  • Book a call

Quick links

  • Blogs
  • Pricing
  • Refund policy
  • Privacy policy
  • Terms and conditions
  • Data deletion

Contact us

  • Egypt — Head Office

    Office 6, Bldg 23, Makkah Al-Mukarramah St., Omraneya, Giza 3540203, Egypt
  • Saudi Arabia — Branch

    Bldg 2646, Secondary 123, Street 7697, Ishbiliyah Dist., Jubail 35416, Kingdom of Saudi Arabia
  • Email address

    help@smartleadtech.com
  • Phone number 🇪🇬

    +20 102 201 4671
  • Phone number 🇸🇦

    +966 53 044 7112

© 2026 Smart Lead Tech. All rights reserved.

  • Smart Lead Tech Information Technology LLC·Commercial Register ⁦61239⁩·Tax ID ⁦774-391-316⁩

  • Smart Lead Tech Software Establishment·CR ⁦7054902585⁩·VAT

Lab report: GPT‑5, Claude Opus 5 and Gemini on Arabic — who actually understands our dialects?

This is a lab report, not an opinion piece. BrandBoost AI (our bilingual marketing copilot) and Kaleem (speech therapy for children) depend entirely on language models, so we re-evaluate every quarter against a fixed tes…

07/28/2026 — 10 min read

Comparison table of three language models on Arabic tasks

This is a lab report, not an opinion piece. BrandBoost AI (our bilingual marketing copilot) and Kaleem (speech therapy for children) depend entirely on language models, so we re-evaluate every quarter against a fixed test set: 420 Arabic tasks spread across Modern Standard Arabic, Gulf and Egyptian dialects, with double human grading.

Methodology

  • Understanding: extracting customer intent from real (anonymised) WhatsApp messages in different dialects.
  • Generation: writing an Arabic ad in a specified tone, then matching it against the brand guide.
  • Constrained summarisation: summarising a real-estate contract without dropping a single financial clause.
  • Diacritics and pronunciation: generating fully vowelled sentences for children’s exercises — Kaleem’s hardest task.

Results in brief

  1. Claude Opus 5: most accurate on constrained summarisation and on holding a specified tone. Fewest diacritic errors. Occasionally over-cautious in short replies.
  2. GPT‑5: fastest at catching intent in dialect messages, especially Egyptian, and best at producing many ad variants quickly. Sometimes slips on Gulf legal terminology.
  3. Gemini (latest generation): strongest on multimodal tasks — reading an ad image and judging its language — and good in MSA, but weaker on fine-grained dialect.
There is no “best model”. There is the best model for this task, at this cost, at this latency.

What we actually changed in our products

In BrandBoost AI, first-pass generation now uses a fast model and the final brand-compliance review uses a more accurate one — two steps instead of one, at roughly 35% lower cost. In Kaleem, diacritics stay exclusively with the lowest-error model, because one mistake in a child’s pronunciation exercise costs all of the parents’ trust.

Three lessons specific to Arabic

  • Dialect needs examples, not instructions. “Write in Gulf Arabic” is not enough; five real examples work wonders.
  • Numbers and dates are a source of silent errors. We enforce one format and verify it programmatically after generation.
  • RTL is not the model’s problem, it is your UI’s. Half the “errors” users reported were rendering, not text.

How to repeat this yourself

Start with fifty real tasks from your business, not from the internet. Grade them by hand once, then automate the re-run monthly. Models change faster than your product roadmap, and a fixed test set is the only thing that turns change into good news instead of a surprise.

Share

Projects related to this article

  • AI SystemsFlutter

    Kaleem — AI-Powered Speech Therapy for Kids

    A playful, AI-powered speech-therapy app for children, with interactive exercises and a friendly mascot to keep them engaged.

    Show more
    Kaleem — AI speech therapy for children
  • AI SystemsPythonNext.jsDocker

    SLT OCR — Arabic-first Document Data Extraction

    An Arabic-first computer-vision engine that turns invoices, purchase orders, receipts, ID cards and KYC packs into data you can trust — a verification model per field, human review when needed, processed in memory only.

    Show more
    SLT OCR — product landing on desktop and phone
  • Real EstateLaravel

    Real Estates Matcher — AI-Powered Property Matching

    A smart real-estate platform that matches demand and supply using AI and data analytics.

    Show more
    Real Estates Matcher — smart demand-supply matching

Related Blogs

  • An industrial robot extending its hand towards a screen displaying AI data with a map of the GCC and Egypt in the background, symbolizing innovation and opportunities in the region.

    AI in GCC and Egypt: Sector Opportunities and Governance Risks in 2026

    The technological landscape in the GCC and Egypt is undergoing rapid transformation, driven by massive investments in artificial intelligence (AI) and its adoption across vital sectors such as industry, tourism, and cons…

    09/29/2026 — 8 min read

  • Diagram of an agent that plans, retrieves and verifies before answering

    From RAG to agentic RAG: when the assistant stops “search then answer” and starts reasoning

    A year ago we described RAG as “search your data, then answer”. That was true and enough for a support bot. But it fails on a question like: “What is the right learning path for a new sales hire who failed the product te…

    06/02/2026 — 9 min read

  • Architectural diagram of the RAG pattern

    What is RAG and why it matters for every LLM-powered product

    You have heard Retrieval-Augmented Generation (RAG) in every recent tech conference. Here is the pragmatic version: when do you actually need it, and how do you build it safely on top of your own data?Why not just use an…

    02/10/2025 — 9 min read