Ekrem Sarı
Ekrem is an AI Researcher and Data Scientist at AIMultiple. He designs and runs hands-on benchmarks for AI and LLM systems.
Professional Experience
At AIMultiple, Ekrem benchmarks end-to-end AI systems and builds the data workflows and dashboards used to track benchmark and product metrics. His benchmarks cover embedding and reranker models, vector and graph databases, inference engines, quantization, GPU concurrency and multi-GPU scaling, cloud GPU pricing and providers, text-to-SQL, and RAG and agentic RAG frameworks.
Before AIMultiple, he worked as a Data Scientist at Yandex, where he queried and analyzed large datasets with SQL to evaluate search and ranking quality against detailed guidelines.
Research Interest
Ekrem's work focuses on measuring how LLM and retrieval systems perform in practice. He designs the test harness, runs the workloads on real hardware, and compares models, frameworks, and infrastructure on accuracy, throughput, latency, cost, and scalability, across the stack from embedding models and vector databases to inference engines and GPU infrastructure. His MSc thesis automates systematic literature reviews with a RAG-based pipeline.
Education
Ekrem holds an MSc in Management Information Systems from Başkent University, where his thesis automated systematic literature reviews with a RAG-based pipeline, and is pursuing a second MSc in Data and Knowledge Engineering at Hacettepe University.
Latest Articles from Ekrem
DGX Spark alternatives: RTX, Ryzen AI Halo and Mac Studio
We compare published DGX Spark, RTX and Ryzen AI Halo inference benchmarks, covering prompt processing, token generation and longer contexts. Alternatives include Framework Desktop, Mac Studio and GB10 systems from other manufacturers. Decode speed measures output tokens generated per second. Higher values mean faster response generation. All six results use GPT-OSS 20B MXFP4 in Ollama…
Free Cloud GPUs: Models, Limits and Access Requirements
Free cloud GPUs are available through Python notebooks, AI demos and monthly compute credits. Compare GPU hardware, free allowances and access requirements, or check which services suit your workload. Two T4s provide two separate 16 GB memory allocations. Running a model across both requires software that distributes the workload. The combined capacity does not make…
Compare Relational Foundation Models
We benchmarked SAP-RPT-1-OSS against gradient boosting (LightGBM, CatBoost) on 17 tabular datasets spanning the semantic-numeral spectrum, small/high-semantic tables, mixed business datasets, and large low-semantic numerical datasets. Our goal is to measure where a relational LLM’s pretrained semantic priors may provide advantages over traditional tree models and where they face challenges under scale or low-semantic structure.…
Disaster Recovery Benchmark: Acronis vs Comet vs MSP360
We benchmarked Acronis Cyber Protect Cloud, Comet Backup, and MSP360 Managed Backup on disaster recovery. Each vendor imaged a live Windows Server 2022 and a live Ubuntu 24.04 server carrying the same deterministic workload, a web service, a 10,000-row database, and 50 files, then recovered the whole machine onto a separate server after a ransomware-style…
Vector Database Benchmark: 7 Open-Source Engines for RAG
We benchmarked seven open-source, self-hosted vector databases as the retrieval layer of a RAG pipeline, each run one at a time on identical bge-m3 embeddings and real medical and technical queries, so the database index was the sole variable. The workload spanned MedRAG-50k, TechQA-28k, and a 2.25M-vector corpus across eight dimensions, from accuracy and retrieval…
Cloud GPU Pricing, Performance & Provider Comparison
Cloud GPU list prices for the same model can differ several times over from one provider to another. We curated the lowest rate, provider, market range, and median for 40+ GPU configurations across all three pricing tiers, plus a throughput-per-dollar benchmark on 10 models. See the most cost-effective GPU for your workload across 13 hyperscaler…
RAG Frameworks: LangChain vs LangGraph vs LlamaIndex
We benchmarked 5 RAG frameworks: LangChain, LangGraph, LlamaIndex, Haystack, and DSPy, by building the same agentic RAG workflow with standardized components: identical models (GPT-4.1-mini), embeddings (BGE-small), retriever (Qdrant), and tools (Tavily web search). This isolates each framework’s true overhead and token efficiency. The benchmark consisted of 100 queries, with each framework running the full set…
Best RAG Tools, Frameworks, and Libraries
RAG improves LLM responses by grounding them in external data instead of just what the model memorized in training. We benchmarked the components a RAG system is built from and gathered the results in one place, with a practical guide to choosing each part of the stack. See our benchmark results for each RAG component,…
Agentic Search: Benchmark 8 Search APIs for Agents
Agentic search plays a crucial role in bridging the gap between traditional search engines and AI search capabilities. Search APIs are the first layer of an agentic tool, where performance caps the quality of everything downstream. We benchmarked 8 search APIs across 100 real-world AI/LLM queries, evaluating 4,000 retrieved results with an LLM judge that…
Multimodal Embedding Models: Apple vs Meta vs OpenAI
Multimodal embedding models excel at identifying objects but struggle with relationships. Current models struggle to distinguish “phone on a map” from “map on a phone.” We benchmarked 7 leading models across MS-COCO and Winoground to measure this specific limitation. To ensure a fair comparison, we evaluated every model under identical conditions using NVIDIA A40 hardware…
AIMultiple Newsletter
1 free email per week with the latest B2B tech news & expert insights to accelerate your enterprise.