Services
Contact Us
Ekrem Sarı

Ekrem Sarı

AI Researcher
35 Articles
Stay up-to-date on B2B Tech

Ekrem is an AI Researcher and Data Analyst at AIMultiple. He designs and runs hands-on benchmarks for AI and LLM systems.

Professional Experience

At AIMultiple, Ekrem benchmarks end-to-end AI systems and builds the data workflows and dashboards used to track benchmark and product metrics. His benchmarks cover embedding and reranker models, vector and graph databases, inference engines, quantization, GPU concurrency and multi-GPU scaling, cloud GPU pricing and providers, text-to-SQL, and RAG and agentic RAG frameworks.

Before AIMultiple, he worked as an Assessor at Yandex, where he evaluated search quality and labeled large volumes of data against detailed guidelines to support ranking and model quality.

Research Interest

Ekrem's work focuses on the MLOps and LLMOps lifecycle and on measuring the performance of AI systems. He compares models, frameworks, and infrastructure on metrics such as accuracy, throughput, API cost, and scalability, across the stack from embedding models and vector databases to GPU and cloud infrastructure. His MSc thesis automates systematic literature reviews with a RAG-based pipeline.

Education

Ekrem holds a BA from Hacettepe University and is completing an MSc at Başkent University.

Latest Articles from Ekrem

Cybersecurity
Benchmark
Aug 12

Bot Detection: 9 Anti-Bot Vendors Benchmarked

We ran two benchmarks against live websites, then identified the anti-bot company in front of every domain and measured how often each company’s domains returned the content we requested. That covers over 3,800 labeled domains and over 50,000 requests. The first benchmark fetched product and search pages on 100 e-commerce domains, 50 URLs each. The…

AI
Feature Comparison
Aug 11

Top 30+ AI Chip Makers: NVIDIA & Its Competitors

Based on our experience running AIMultiple’s cloud GPU benchmark with 10 different GPU models in 4 different scenarios, these are the top AI hardware companies for data center workloads. *Selected AI chip is the part, platform, or announced project that best represents each vendor. Some entries are systems, services or licensable IP rather than a…

AI
Benchmark
Aug 11

Agentic RAG Benchmark: Multi-Database Routing Across 36 LLMs

We benchmarked 36 large language models on cross-database routing. Each model receives a natural language question and 11 SQL databases described at paragraph level, then has to decide which database holds the answer before it writes any SQL. The 11 databases were drawn from 80 BIRD-SQL candidates by clustering their description embeddings, so the candidates…

AI
Open World Evaluation
Aug 11

Top 70+ Cloud GPU Providers in 2026

Cloud GPU providers fall into three tiers. Hyperscalers run broad cloud platforms with GPU rental as one product among many. Specialist neoclouds focus on GPU and AI infrastructure as their core product. Community marketplaces aggregate inventory from many small operators, often at the floor of the published price spread. Pick a GPU model and a…

AI
Benchmark
Aug 11

Open Source Embedding Models Benchmark for RAG

NVIDIA Llama-Embed-Nemotron-8B leads in accuracy. On cost, Google’s EmbeddingGemma-300m runs roughly 4x cheaper than Nemotron at the cost of a small accuracy loss. nDCG@3: Normalized discounted cumulative gain at cutoff 3. With one relevant document per query, it is 1 / log2(rank + 1) when the gold document lands in the top 3, and 0…

AI
Benchmark
Aug 11

Benchmark of 40+ LLMs in Finance: Claude Fable 5 & GPT-5.6 Sol

We evaluated LLMs on 238 hard questions from the FinanceReasoning benchmark (Tang et al.).212 This subset targets the most challenging financial-reasoning tasks, assessing complex, multi-step quantitative reasoning involving financial concepts and formulas. Our evaluation employed a custom prompt design and scoring criteria of accuracy and token consumption. For a detailed explanation of how these metrics…

AI
Benchmark
Aug 10

Embedding Models: OpenAI vs Gemini vs Voyage

We benchmarked 15 English text-embedding models and a BM25 baseline on over 500 manually curated queries across three retrieval domains: legal contracts (CUAD), customer support (IBM TechQA), and healthcare (MedRAG PubMed). Voyage-3.5 ranks first overall. Perplexity Embed V1 0.6b reaches the upper-mid tier at the lowest price point in our benchmark. nDCG@3: Normalized discounted cumulative…

AI
Benchmark
Aug 9

Text-to-SQL: Comparison of LLM Accuracy

We ran 36 large language models over 759 questions from BIRD-SQL, each model writing SQL against a database it had to identify for itself out of 11 candidates. Every parseable query was executed against the real database and its result set compared with the result set of BIRD’s gold query. Missing, malformed and execution-failing queries…

Data
Benchmark
Aug 7

E-Commerce Scraper: 5 Providers Benchmarked

We benchmarked five web data providers across 100 e-commerce domains, fetching 65,000 product and search pages each at 5 to 5,000 concurrent requests. Averaged across concurrency levels, Decodo recorded the fastest median response, about 7 seconds, at a 59% success rate, while Bright Data reached the highest success rate (76%) at a 16-second median. Apify…

AI
Benchmark
Aug 4

Multimodal Embedding Models: Apple vs Meta vs OpenAI

Multimodal embedding models excel at identifying objects but struggle with relationships. Current models struggle to distinguish “phone on a map” from “map on a phone.” We benchmarked 7 leading models across MS-COCO and Winoground to measure this specific limitation. To ensure a fair comparison, we evaluated every model under identical conditions using NVIDIA A40 hardware…