Premium
Services
Premium
Ekrem Sarı

Ekrem Sarı

AI Researcher
37 Articles
Stay up-to-date on B2B Tech

Ekrem is an AI Researcher and Data Scientist at AIMultiple. He designs and runs hands-on benchmarks for AI and LLM systems.

Professional Experience

At AIMultiple, Ekrem benchmarks end-to-end AI systems and builds the data workflows and dashboards used to track benchmark and product metrics. His benchmarks cover embedding and reranker models, vector and graph databases, inference engines, quantization, GPU concurrency and multi-GPU scaling, cloud GPU pricing and providers, text-to-SQL, and RAG and agentic RAG frameworks.

Before AIMultiple, he worked as a Data Scientist at Yandex, where he queried and analyzed large datasets with SQL to evaluate search and ranking quality against detailed guidelines.

Research Interest

Ekrem's work focuses on measuring how LLM and retrieval systems perform in practice. He designs the test harness, runs the workloads on real hardware, and compares models, frameworks, and infrastructure on accuracy, throughput, latency, cost, and scalability, across the stack from embedding models and vector databases to inference engines and GPU infrastructure. His MSc thesis automates systematic literature reviews with a RAG-based pipeline.

Education

Ekrem holds an MSc in Management Information Systems from Başkent University, where his thesis automated systematic literature reviews with a RAG-based pipeline, and is pursuing a second MSc in Data and Knowledge Engineering at Hacettepe University.

Latest Articles from Ekrem

AI
Benchmark
Sep 24

Benchmark of 40+ LLMs in Finance: Claude Opus 5.5 & GPT-6 Astra

We evaluated LLMs on 238 hard questions from the FinanceReasoning benchmark (Tang et al.).1 This subset targets the most challenging financial-reasoning tasks, assessing complex, multi-step quantitative reasoning involving financial concepts and formulas. Our evaluation employed a custom prompt design and scoring criteria of accuracy and token consumption. For a detailed explanation of how these metrics…

AI
Benchmark
Sep 23

Agentic RAG Benchmark: Routing Across 11 SQL Databases

Routing accuracy is the percentage of scored questions for which the model explicitly names the correct database in its final answer. The headline uses the 184 questions flagged as difficult by both our similarity test and a jury of three LLMs. Missing explicit declarations receive no credit. Qwen3.8-max answered 153 of 184 hard routing questions…

Cybersecurity
Benchmark
Sep 22

Backup software benchmark: Acronis vs NinjaOne vs Comet vs MSP360

We benchmarked NinjaOne Backup, Acronis Cyber Protect Cloud Backup, Comet Backup, and MSP360 Managed Backup on identical AWS infrastructure. Each vendor ran a file-mode backup of the same 625,946-file / 50 GB workload and a full image backup of the system disk, then restored the 15 GB medium subdirectory. Here are the four backup products…

AI
Benchmark
Sep 22

Text-to-SQL Benchmark: SQL Accuracy Across 35+ LLMs

SQL accuracy is the percentage of scored queries that return the reference result. Incorrect routes and references flagged as broken are excluded. A reference query is the SQL supplied as the expected answer. Each model reaches a different set of SQL questions because scoring depends on its database choices. Differences in these subsets and execution…

AI
Feature Comparison
Sep 22

Cloud GPU Rental Price Index

Last released has the largest price increase among the three groups. Its on-demand median rose from $2.12 per GPU-hour in October 2024 to $4.72 in September 2026. Over the same period, the Modern group moved from $1.35 to $1.45, while Legacy fell from $1.77 to $0.95. Each median uses the listings present that month. Providers,…

AI
Benchmark
Sep 22

Reranker Benchmark: Top 8 Models Compared

We retrieved top-100 candidates with multilingual-e5-base, reranked them with each model, and evaluated the top-10 results against 300 queries, each referencing concrete details from its source review. The best reranker lifted Hit@1 from 62.67% to 83.00% (+20.33pp). Metrics explained: ΔHit@1 / ΔHit@10 shows the improvement over the baseline (no reranker) in percentage points (pp). For…

AI
Feature Comparison
Sep 21

Top 30+ AI Chip Makers: NVIDIA & Its Competitors

Based on our experience running AIMultiple’s cloud GPU benchmark, we compare chip makers by product, availability and architecture, covering data center GPUs, mobile chips, edge accelerators and foundries. Each row names a representative product, its type and its availability. Availability distinguishes hardware offered for sale, cloud services, internal deployments and announced products. Dates refer to…

Cybersecurity
Benchmark
Sep 21

Bot Detection: 9 Anti-Bot Vendors Benchmarked

We identified the anti-bot company protecting top ~3,800 domains and measured how often each domain blocked our bots through 50,000 requests. Cloudflare defends 73.3% of the 3,859 domains and recorded a 6.7% block rate. Imperva defends 3.7% and recorded 46.6%. The two measures rank the nine companies in close to opposite orders. Metrics explained: Block…

Data
Benchmark
Sep 21

Remote Browsers: Web Infra for AI Agents Compared

AI agents rely on remote browsers to automate web tasks without being blocked by anti-scraping measures. The performance of this browser infrastructure is critical to an agent’s success. We benchmarked 8 providers on success rate, speed, and features. To do this, we executed 160 automated tasks, running 4 distinct scenarios 5 times for each service…

Data
Benchmark
Sep 21

Large-Scale Web Scraping: 7 Providers Benchmarked

We ran two benchmarks against live websites, from 5 to 5,000 concurrent requests. The first sent 260,000 requests through four web unblockers across the Tranco top 10,000 domains, plus a markdown extraction test on 10,000 URLs. The second fetched 65,000 product and search pages from each of five scraping providers across 100 e-commerce domains. Metrics…