Premium
Services
Premium
Ekrem Sarı

Ekrem Sarı

AI Researcher
37 Articles
Stay up-to-date on B2B Tech

Ekrem is an AI Researcher and Data Scientist at AIMultiple. He designs and runs hands-on benchmarks for AI and LLM systems.

Professional Experience

At AIMultiple, Ekrem benchmarks end-to-end AI systems and builds the data workflows and dashboards used to track benchmark and product metrics. His benchmarks cover embedding and reranker models, vector and graph databases, inference engines, quantization, GPU concurrency and multi-GPU scaling, cloud GPU pricing and providers, text-to-SQL, and RAG and agentic RAG frameworks.

Before AIMultiple, he worked as a Data Scientist at Yandex, where he queried and analyzed large datasets with SQL to evaluate search and ranking quality against detailed guidelines.

Research Interest

Ekrem's work focuses on measuring how LLM and retrieval systems perform in practice. He designs the test harness, runs the workloads on real hardware, and compares models, frameworks, and infrastructure on accuracy, throughput, latency, cost, and scalability, across the stack from embedding models and vector databases to inference engines and GPU infrastructure. His MSc thesis automates systematic literature reviews with a RAG-based pipeline.

Education

Ekrem holds an MSc in Management Information Systems from Başkent University, where his thesis automated systematic literature reviews with a RAG-based pipeline, and is pursuing a second MSc in Data and Knowledge Engineering at Hacettepe University.

Latest Articles from Ekrem

Data
Benchmark
Sep 28

Large-Scale Web Scraping: 7 Providers Benchmarked

We ran two benchmarks against live websites, from 5 to 5,000 concurrent requests. The first sent 260,000 requests through four web unblockers across the Tranco top 10,000 domains, plus a markdown extraction test on 10,000 URLs. The second fetched 65,000 product and search pages from each of five scraping providers across 100 e-commerce domains. Metrics…

Data
Benchmark
Sep 28

E-Commerce Scraper: 4 Providers Benchmarked

We benchmarked four web data providers across 100 e-commerce domains, fetching 65,000 product and search pages each at 5 to 5,000 concurrent requests. Averaged across concurrency levels, Bright Data reached the highest success rate (76%) at a 16-second median. Apify recorded the highest median response time at 46 seconds. Response time is reported as the…

AI
Benchmark
Sep 27

Open Source Embedding Models: 11 Models Benchmarked for Retrieval

nDCG@10 scores the placement of recorded relevant passages within the first ten search results. A score of 1 represents the ideal ranking for the recorded positives. Passages nearer the top receive more weight. PPLX Embed v1 4B led the comparison at 0.741 nDCG@10, followed by PPLX Embed v1 0.6B at 0.698. Multilingual E5 Large ranked…

Cybersecurity
Benchmark
Sep 22

Backup software benchmark: Acronis vs NinjaOne vs Comet vs MSP360

We benchmarked NinjaOne Backup, Acronis Cyber Protect Cloud Backup, Comet Backup, and MSP360 Managed Backup on identical AWS infrastructure. Each vendor ran a file-mode backup of the same 625,946-file / 50 GB workload and a full image backup of the system disk, then restored the 15 GB medium subdirectory. Here are the four backup products…

AI
Feature Comparison
Sep 22

Cloud GPU Rental Price Index

Last released has the largest price increase among the three groups. Its on-demand median rose from $2.12 per GPU-hour in October 2024 to $4.72 in September 2026. Over the same period, the Modern group moved from $1.35 to $1.45, while Legacy fell from $1.77 to $0.95. Each median uses the listings present that month. Providers,…

AI
Benchmark
Sep 22

Reranker Benchmark: Top 8 Models Compared

We retrieved top-100 candidates with multilingual-e5-base, reranked them with each model, and evaluated the top-10 results against 300 queries, each referencing concrete details from its source review. The best reranker lifted Hit@1 from 62.67% to 83.00% (+20.33pp). Metrics explained: ΔHit@1 / ΔHit@10 shows the improvement over the baseline (no reranker) in percentage points (pp). For…

AI
Open World Evaluation
Sep 21

Top 70+ Cloud GPU Providers

Cloud GPU providers fall into three tiers. Hyperscalers run broad cloud platforms with GPU rental as one product among many. Specialist neoclouds focus on GPU and AI infrastructure as their core product. Community marketplaces aggregate inventory from many small operators, often at the floor of the published price spread. Column definitions: Ranking: Subscribers are linked…

AI
Insight
Sep 21

LLM VRAM Calculator for Self-Hosting

Self-hosting an LLM means running inference on hardware the operator controls rather than via a third-party API, which changes the cost, data control, and privacy profile. Whether a model runs at all depends on memory. The calculator estimates the VRAM or unified memory a model needs to run locally, based on the model, its precision,…

AI
Benchmark
Sep 21

Multi-GPU Benchmark: B200 vs H200 vs H100 vs MI300X

For over two decades, optimizing compute performance has been a cornerstone of my work. We benchmarked NVIDIA’s B200, H200, H100, and AMD’s MI300X to assess how well they scale for Large Language Model (LLM) inference. Using the vLLM framework with the meta-llama/Llama-3.1-8B-Instruct model, we ran tests on 1, 2, 4, and 8 GPUs. We analyzed…

AI
Benchmark
Sep 21

GPU Concurrency Benchmark: H100 vs H200 vs B200 vs MI300X

I have spent the last 20 years focusing on system-level computational performance optimization. We benchmarked the latest NVIDIA GPUs, including the NVIDIA’s H100, H200, and B200, and AMD’s MI300X, for concurrency scaling analysis. Using the vLLM framework with the gpt-oss-20b model, we tested how these GPUs handle concurrent requests, from 1 to 512. By measuring…